2024-09-10T04:40:07.259 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T04:40:07.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T04:40:07.363 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7898669' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9786 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkepYLxJZ5hn9KFPpko3KxYm+/+G4HZD2phL7VhWyzBfi8HedWsdw1+IRpyaDDv4jcbfwHBZ6Sg+yUemujIhn4= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmQXSQcHdSdFQEYntx3CSgQiehzT0kFxZiNg2dmMGxFMJPPgUxSqXSdMjSu1bFBdHIAToXBE+ZWqZk2eIbJHpA= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:21:45 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T04:40:07.363 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-10T04:40:07.364 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-10T04:40:07.364 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T04:40:07.366 INFO:teuthology.task.internal:Checking packages... 2024-09-10T04:40:07.387 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-10T04:40:07.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T04:40:07.388 INFO:teuthology.packaging:ref: None 2024-09-10T04:40:07.388 INFO:teuthology.packaging:tag: None 2024-09-10T04:40:07.388 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-10T04:40:07.388 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T04:40:07.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-10T04:40:07.550 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-10T04:40:07.552 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T04:40:07.563 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T04:40:07.564 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T04:40:07.639 INFO:teuthology.task.internal:Saving configuration 2024-09-10T04:40:07.650 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T04:40:07.670 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T04:40:07.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 04:33:14.601928', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkepYLxJZ5hn9KFPpko3KxYm+/+G4HZD2phL7VhWyzBfi8HedWsdw1+IRpyaDDv4jcbfwHBZ6Sg+yUemujIhn4='} 2024-09-10T04:40:07.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 04:33:14.602964', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmQXSQcHdSdFQEYntx3CSgQiehzT0kFxZiNg2dmMGxFMJPPgUxSqXSdMjSu1bFBdHIAToXBE+ZWqZk2eIbJHpA='} 2024-09-10T04:40:07.718 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T04:40:07.729 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-10T04:40:07.729 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-10T04:40:07.730 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T04:40:07.807 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f33a03b7ac0>, signals=[15]) 2024-09-10T04:40:07.807 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T04:40:07.818 INFO:teuthology.task.internal:Opening connections... 2024-09-10T04:40:07.818 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T04:40:07.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:40:07.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:40:07.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:40:07.970 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T04:40:07.981 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-10T04:40:08.000 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-10T04:40:08.000 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-10T04:40:08.058 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-10T04:40:08.058 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-10T04:40:08.058 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T04:40:08.059 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T04:40:08.060 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-10T04:40:08.083 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-10T04:40:08.101 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-10T04:40:08.102 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-10T04:40:08.159 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-10T04:40:08.159 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-10T04:40:08.159 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T04:40:08.160 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T04:40:08.161 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-10T04:40:08.183 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T04:40:08.193 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T04:40:08.228 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T04:40:08.228 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-10T04:40:08.231 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-10T04:40:08.247 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T04:40:08.260 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T04:40:08.260 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-10T04:40:08.289 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-10T04:40:08.371 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T04:40:08.421 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T04:40:08.439 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T04:40:08.439 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T04:40:08.439 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T04:40:08.439 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T04:40:08.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:40:08.456 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-10T04:40:08.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:40:08.457 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-10T04:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-10T04:40:08.514 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-10T04:40:08.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-10T04:40:08.516 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-10T04:40:08.516 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-10T04:40:08.516 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-10T04:40:10.944 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-10T04:40:12.402 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-10T04:40:13.571 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-10T04:40:14.253 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-10T04:40:17.945 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T04:40:18.521 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-10T04:40:19.972 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-10T04:40:20.154 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-10T04:40:20.784 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-10T04:40:21.142 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-10T04:40:26.149 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T04:40:26.606 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T04:40:28.163 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T04:40:28.164 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T04:40:28.242 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:40:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-10T04:40:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:40:28.255 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-10T04:40:28.255 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-10T04:40:28.255 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:40:28.620 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T04:40:28.621 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T04:40:28.633 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 82 kB/s | 23 kB 00:00 2024-09-10T04:40:28.703 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:40:28.709 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:40:28.709 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-10T04:40:28.709 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-10T04:40:28.710 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:40:28.711 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-10T04:40:28.711 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-10T04:40:28.711 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:40:28.807 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 299 kB/s | 23 kB 00:00 2024-09-10T04:40:30.517 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-10T04:40:30.675 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-10T04:40:32.026 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 8.4 MB/s | 29 MB 00:03 2024-09-10T04:40:32.026 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:40:32.026 INFO:teuthology.orchestra.run.smithi098.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-10T04:40:32.710 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:40:32.915 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-10T04:40:33.065 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:40:33.066 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:40:34.042 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:40:34.042 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:40:36.190 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-10T04:40:36.505 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:40:37.163 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T04:40:37.253 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:40:37.773 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-10T04:40:37.773 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:40:37.774 INFO:teuthology.orchestra.run.smithi145.stdout:Total 8.7 MB/s | 79 MB 00:09 2024-09-10T04:40:38.455 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:40:38.834 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:40:38.834 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:40:39.777 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:40:39.778 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:40:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:40:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:40:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:40:42.872 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T04:40:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:40:45.022 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:40:45.065 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:40:45.760 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:40:45.894 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:40:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:40:50.732 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:40:50.770 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:40:55.628 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:27.905 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:27.945 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:28.336 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:28.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T04:41:28.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:41:28.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:41:29.144 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:41:29.490 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T04:41:29.564 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.565 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T04:41:29.565 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T04:41:29.565 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T04:41:29.565 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T04:41:29.565 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T04:41:29.565 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T04:41:29.565 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T04:41:29.624 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:29.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T04:41:29.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-10T04:41:29.665 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-10T04:41:29.665 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T04:41:29.666 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:41:29.667 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T04:41:29.668 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T04:41:29.668 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-505.el9.x86_64 2024-09-10T04:41:29.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T04:41:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-10T04:41:31.569 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T04:41:31.597 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-10T04:41:31.602 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-10T04:41:31.618 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.4HCIFuWbAA 2024-09-10T04:41:31.618 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4HCIFuWbAA 2024-09-10T04:41:31.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.4HCIFuWbAA 2024-09-10T04:41:31.835 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.4HCIFuWbAA is 6KB 2024-09-10T04:41:31.887 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.4HCIFuWbAA 2024-09-10T04:41:31.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T04:41:31.964 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T04:41:31.964 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T04:41:31.964 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T04:41:31.964 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T04:41:31.966 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T04:41:32.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-10T04:41:34.107 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:34.146 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:34.494 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:34.495 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T04:41:34.495 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T04:41:34.495 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T04:41:35.373 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T04:41:35.373 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:41:35.373 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:41:35.373 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.374 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.374 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.374 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.374 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:41:35.374 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:41:35.769 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T04:41:35.862 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T04:41:35.863 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T04:41:35.863 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T04:41:35.863 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T04:41:35.863 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-10T04:41:35.863 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T04:41:35.863 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T04:41:35.921 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T04:41:35.922 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T04:41:35.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-10T04:41:35.954 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T04:41:35.955 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-10T04:41:35.956 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:41:35.956 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T04:41:35.956 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T04:41:35.956 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-505.el9.x86_64 2024-09-10T04:41:35.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T04:41:36.608 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-10T04:41:37.966 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T04:41:37.991 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-10T04:41:37.994 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-10T04:41:38.009 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.w1cc85gWDH 2024-09-10T04:41:38.010 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.w1cc85gWDH 2024-09-10T04:41:38.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.w1cc85gWDH 2024-09-10T04:41:38.229 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.w1cc85gWDH is 6KB 2024-09-10T04:41:38.276 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.w1cc85gWDH 2024-09-10T04:41:38.291 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T04:41:38.353 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T04:41:38.353 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T04:41:38.353 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T04:41:38.353 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T04:41:38.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T04:41:38.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-10T04:42:02.141 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T04:42:02.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:42:02.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:42:08.537 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-10T04:42:08.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:42:08.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:42:20.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T04:42:27.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-10T04:42:29.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:42:29.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:42:32.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T04:42:36.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:42:36.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:42:39.073 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-10T04:42:44.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:42:44.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:42:51.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:42:51.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:43:03.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T04:43:18.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:43:18.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:43:18.453 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-10T04:43:18.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:43:18.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T04:43:18.886 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-10T04:43:18.902 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-505.el9.x86_64 2024-09-10T04:43:18.902 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T04:43:18.903 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T04:43:18.903 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T04:43:19.904 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T04:43:19.904 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T04:43:20.030 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-10T04:43:20.051 DEBUG:teuthology.parallel:result is None 2024-09-10T04:43:22.919 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-10T04:43:23.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:43:23.298 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-10T04:43:23.299 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-10T04:43:23.313 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-505.el9.x86_64 2024-09-10T04:43:23.314 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T04:43:23.314 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T04:43:23.314 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T04:43:24.314 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-10T04:43:24.314 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T04:43:24.446 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-10T04:43:24.465 DEBUG:teuthology.parallel:result is None 2024-09-10T04:43:24.465 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T04:43:24.473 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T04:43:24.473 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T04:43:24.476 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T04:43:24.526 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T04:43:24.532 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T04:43:24.559 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T04:43:24.559 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T04:43:24.562 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T04:43:24.605 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T04:43:24.612 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T04:43:24.612 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T04:43:24.631 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T04:43:24.663 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T04:43:24.674 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T04:43:24.707 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T04:43:24.752 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T04:43:24.754 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T04:43:24.761 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T04:43:24.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T04:43:24.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T04:43:24.830 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T04:43:24.840 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T04:43:24.840 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T04:43:24.842 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T04:43:24.876 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T04:43:24.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T04:43:24.988 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T04:43:25.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T04:43:25.111 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:43:25.112 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T04:43:25.177 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T04:43:25.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T04:43:25.293 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T04:43:25.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T04:43:25.410 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:43:25.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T04:43:25.472 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-10T04:43:25.476 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-10T04:43:25.519 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T04:43:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T04:43:26.331 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T04:43:26.339 INFO:teuthology.task.internal:Starting timer... 2024-09-10T04:43:26.340 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T04:43:26.380 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T04:43:26.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-10T04:43:26.461 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-10T04:43:26.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-10T04:43:26.517 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-10T04:43:26.519 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T04:43:26.519 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-10T04:43:26.540 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-10T04:43:26.541 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-10T04:43:26.573 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-10T04:43:26.573 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-09-10T04:43:26.573 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T04:43:26.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:43:26.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T04:43:26.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:43:26.636 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T04:43:26.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-10T04:43:26.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-10T04:43:26.716 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T04:43:26.725 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T04:43:26.737 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T04:43:26.738 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T04:47:07.654 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-10T04:47:07.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:47:07.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:47:07.733 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-10T04:47:07.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T04:47:07.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:47:07.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T04:47:07.901 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-10T04:47:07.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-10T04:47:07.978 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T04:47:07.988 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T04:47:07.988 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T04:47:07.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T04:47:07.991 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T04:47:07.992 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T04:47:08.018 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T04:47:08.032 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T04:47:08.050 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T04:47:08.055 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-10T04:47:08.065 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T04:47:08.066 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-10T04:47:08.081 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T04:47:08.090 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-10T04:47:08.095 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T04:47:08.102 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-10T04:47:08.116 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T04:47:08.130 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T04:47:08.149 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.153 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.183 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.187 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:47:08.187 INFO:teuthology.run_tasks:Running task install... 2024-09-10T04:47:08.195 DEBUG:teuthology.task.install:project ceph 2024-09-10T04:47:08.195 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-10T04:47:08.196 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-10T04:47:08.196 INFO:teuthology.task.install:Using flavor: default 2024-09-10T04:47:08.201 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T04:47:08.201 INFO:teuthology.task.install:extra packages: [] 2024-09-10T04:47:08.202 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-10T04:47:08.202 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T04:47:08.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-10T04:47:08.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T04:47:08.347 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-10T04:47:08.347 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-10T04:47:08.351 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-10T04:47:08.352 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-10T04:47:08.458 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T04:47:08.458 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:47:08.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T04:47:08.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T04:47:08.463 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:47:08.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T04:47:08.485 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T04:47:08.485 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T04:47:08.488 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T04:47:08.489 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T04:47:08.551 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T04:47:08.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T04:47:08.628 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T04:47:08.630 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T04:47:08.692 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-10T04:47:08.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-10T04:47:08.694 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-10T04:47:08.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-10T04:47:08.931 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-10T04:47:08.940 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-10T04:47:08.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2024-09-10T04:47:08.967 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw 2024-09-10T04:47:09.727 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 173 kB/s | 84 kB 00:00 2024-09-10T04:47:09.729 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-09-10T04:47:10.105 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 72 kB/s | 24 kB 00:00 2024-09-10T04:47:10.111 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 70 kB/s | 24 kB 00:00 2024-09-10T04:47:10.386 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T04:47:10.403 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-10T04:47:10.895 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-10T04:47:11.147 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-10T04:47:15.230 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-10T04:47:16.640 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-10T04:47:20.347 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-10T04:47:21.764 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-10T04:47:22.032 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T04:47:22.910 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T04:47:23.566 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 19 kB 00:00 2024-09-10T04:47:24.970 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T04:47:28.392 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T04:47:30.493 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T04:47:30.777 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-10T04:47:30.789 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-10T04:47:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T04:47:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:30.792 INFO:teuthology.orchestra.run.smithi098.stdout:Install 30 Packages 2024-09-10T04:47:30.793 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2024-09-10T04:47:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:30.793 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 61 M 2024-09-10T04:47:30.793 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:47:31.668 INFO:teuthology.orchestra.run.smithi098.stdout:(1/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9. 15 MB/s | 11 MB 00:00 2024-09-10T04:47:31.710 INFO:teuthology.orchestra.run.smithi098.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 607 kB/s | 25 kB 00:00 2024-09-10T04:47:31.793 INFO:teuthology.orchestra.run.smithi098.stdout:(3/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 8.9 MB/s | 756 kB 00:00 2024-09-10T04:47:32.036 INFO:teuthology.orchestra.run.smithi098.stdout:(4/32): ceph-common-19.3.0-4762.gbad475c1.el9.x 20 MB/s | 22 MB 00:01 2024-09-10T04:47:32.069 INFO:teuthology.orchestra.run.smithi098.stdout:(5/32): libradosstriper1-19.3.0-4762.gbad475c1. 1.8 MB/s | 508 kB 00:00 2024-09-10T04:47:32.161 INFO:teuthology.orchestra.run.smithi098.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 493 kB/s | 45 kB 00:00 2024-09-10T04:47:32.253 INFO:teuthology.orchestra.run.smithi098.stdout:(7/32): python3-ceph-common-19.3.0-4762.gbad475 1.5 MB/s | 143 kB 00:00 2024-09-10T04:47:32.328 INFO:teuthology.orchestra.run.smithi098.stdout:(8/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_6 19 MB/s | 5.5 MB 00:00 2024-09-10T04:47:32.353 INFO:teuthology.orchestra.run.smithi098.stdout:(9/32): python3-cephfs-19.3.0-4762.gbad475c1.el 1.6 MB/s | 161 kB 00:00 2024-09-10T04:47:32.387 INFO:teuthology.orchestra.run.smithi098.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 5.4 MB/s | 321 kB 00:00 2024-09-10T04:47:32.412 INFO:teuthology.orchestra.run.smithi098.stdout:(11/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 5.1 MB/s | 305 kB 00:00 2024-09-10T04:47:32.438 INFO:teuthology.orchestra.run.smithi098.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T04:47:32.521 INFO:teuthology.orchestra.run.smithi098.stdout:(13/32): ceph-base-19.3.0-4762.gbad475c1.el9.x8 3.5 MB/s | 5.5 MB 00:01 2024-09-10T04:47:32.572 INFO:teuthology.orchestra.run.smithi098.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 672 kB/s | 107 kB 00:00 2024-09-10T04:47:32.630 INFO:teuthology.orchestra.run.smithi098.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T04:47:32.655 INFO:teuthology.orchestra.run.smithi098.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 160 kB 00:00 2024-09-10T04:47:32.697 INFO:teuthology.orchestra.run.smithi098.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T04:47:32.723 INFO:teuthology.orchestra.run.smithi098.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 630 kB/s | 42 kB 00:00 2024-09-10T04:47:32.748 INFO:teuthology.orchestra.run.smithi098.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T04:47:32.773 INFO:teuthology.orchestra.run.smithi098.stdout:(20/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-10T04:47:32.799 INFO:teuthology.orchestra.run.smithi098.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-10T04:47:32.824 INFO:teuthology.orchestra.run.smithi098.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 624 kB/s | 47 kB 00:00 2024-09-10T04:47:32.878 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:47:32.889 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:32.889 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:47:32.889 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T04:47:32.890 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T04:47:32.891 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout:Install 30 Packages 2024-09-10T04:47:32.892 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 2 Packages 2024-09-10T04:47:32.893 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:32.893 INFO:teuthology.orchestra.run.smithi098.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 497 kB/s | 26 kB 00:00 2024-09-10T04:47:32.893 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 61 M 2024-09-10T04:47:32.893 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:47:32.916 INFO:teuthology.orchestra.run.smithi098.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-09-10T04:47:32.942 INFO:teuthology.orchestra.run.smithi098.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-09-10T04:47:32.958 INFO:teuthology.orchestra.run.smithi098.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-10T04:47:32.992 INFO:teuthology.orchestra.run.smithi098.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-10T04:47:33.042 INFO:teuthology.orchestra.run.smithi098.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T04:47:33.110 INFO:teuthology.orchestra.run.smithi098.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T04:47:33.260 INFO:teuthology.orchestra.run.smithi098.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-10T04:47:33.310 INFO:teuthology.orchestra.run.smithi098.stdout:(31/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 16 MB/s | 3.2 MB 00:00 2024-09-10T04:47:33.577 INFO:teuthology.orchestra.run.smithi098.stdout:(32/32): librados2-19.3.0-4762.gbad475c1.el9.x8 6.5 MB/s | 3.5 MB 00:00 2024-09-10T04:47:33.582 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:47:33.582 INFO:teuthology.orchestra.run.smithi098.stdout:Total 22 MB/s | 61 MB 00:02 2024-09-10T04:47:33.619 INFO:teuthology.orchestra.run.smithi145.stdout:(1/32): ceph-base-19.3.0-4762.gbad475c1.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-10T04:47:33.669 INFO:teuthology.orchestra.run.smithi145.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 506 kB/s | 25 kB 00:00 2024-09-10T04:47:33.690 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:47:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:47:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:47:33.761 INFO:teuthology.orchestra.run.smithi145.stdout:(3/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 8.1 MB/s | 756 kB 00:00 2024-09-10T04:47:33.845 INFO:teuthology.orchestra.run.smithi145.stdout:(4/32): libradosstriper1-19.3.0-4762.gbad475c1. 6.0 MB/s | 508 kB 00:00 2024-09-10T04:47:34.162 INFO:teuthology.orchestra.run.smithi145.stdout:(5/32): ceph-common-19.3.0-4762.gbad475c1.el9.x 20 MB/s | 22 MB 00:01 2024-09-10T04:47:34.204 INFO:teuthology.orchestra.run.smithi145.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 1.1 MB/s | 45 kB 00:00 2024-09-10T04:47:34.287 INFO:teuthology.orchestra.run.smithi145.stdout:(7/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_6 12 MB/s | 5.5 MB 00:00 2024-09-10T04:47:34.313 INFO:teuthology.orchestra.run.smithi145.stdout:(8/32): python3-ceph-common-19.3.0-4762.gbad475 1.3 MB/s | 143 kB 00:00 2024-09-10T04:47:34.338 INFO:teuthology.orchestra.run.smithi145.stdout:(9/32): python3-cephfs-19.3.0-4762.gbad475c1.el 3.1 MB/s | 161 kB 00:00 2024-09-10T04:47:34.363 INFO:teuthology.orchestra.run.smithi145.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 6.3 MB/s | 321 kB 00:00 2024-09-10T04:47:34.389 INFO:teuthology.orchestra.run.smithi145.stdout:(11/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 5.9 MB/s | 305 kB 00:00 2024-09-10T04:47:34.400 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:47:34.400 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:47:34.414 INFO:teuthology.orchestra.run.smithi145.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T04:47:34.531 INFO:teuthology.orchestra.run.smithi145.stdout:(13/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9 7.6 MB/s | 11 MB 00:01 2024-09-10T04:47:34.590 INFO:teuthology.orchestra.run.smithi145.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-09-10T04:47:34.623 INFO:teuthology.orchestra.run.smithi145.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 494 kB/s | 45 kB 00:00 2024-09-10T04:47:34.657 INFO:teuthology.orchestra.run.smithi145.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 660 kB/s | 160 kB 00:00 2024-09-10T04:47:34.690 INFO:teuthology.orchestra.run.smithi145.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-10T04:47:34.715 INFO:teuthology.orchestra.run.smithi145.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 722 kB/s | 42 kB 00:00 2024-09-10T04:47:34.749 INFO:teuthology.orchestra.run.smithi145.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-10T04:47:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-10T04:47:34.800 INFO:teuthology.orchestra.run.smithi145.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 427 kB/s | 36 kB 00:00 2024-09-10T04:47:34.825 INFO:teuthology.orchestra.run.smithi145.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-10T04:47:34.892 INFO:teuthology.orchestra.run.smithi145.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 493 kB/s | 26 kB 00:00 2024-09-10T04:47:34.920 INFO:teuthology.orchestra.run.smithi145.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-09-10T04:47:34.953 INFO:teuthology.orchestra.run.smithi145.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 799 kB/s | 49 kB 00:00 2024-09-10T04:47:34.978 INFO:teuthology.orchestra.run.smithi145.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-10T04:47:35.012 INFO:teuthology.orchestra.run.smithi145.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-10T04:47:35.045 INFO:teuthology.orchestra.run.smithi145.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-10T04:47:35.154 INFO:teuthology.orchestra.run.smithi145.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T04:47:35.213 INFO:teuthology.orchestra.run.smithi145.stdout:(30/32): librados2-19.3.0-4762.gbad475c1.el9.x8 21 MB/s | 3.5 MB 00:00 2024-09-10T04:47:35.355 INFO:teuthology.orchestra.run.smithi145.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-10T04:47:35.405 INFO:teuthology.orchestra.run.smithi145.stdout:(32/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-10T04:47:35.409 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:47:35.410 INFO:teuthology.orchestra.run.smithi145.stdout:Total 24 MB/s | 61 MB 00:02 2024-09-10T04:47:35.507 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:47:35.542 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:47:35.543 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:47:35.902 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:47:35.986 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-10T04:47:36.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-10T04:47:36.049 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-10T04:47:36.071 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T04:47:36.094 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T04:47:36.215 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:47:36.215 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:47:36.265 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T04:47:36.318 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T04:47:36.655 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-10T04:47:36.759 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:36.852 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:36.949 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-10T04:47:36.977 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T04:47:37.024 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T04:47:37.061 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-10T04:47:37.105 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-10T04:47:37.175 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T04:47:37.205 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T04:47:37.252 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T04:47:37.287 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-10T04:47:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-10T04:47:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-10T04:47:37.479 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-10T04:47:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-10T04:47:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-10T04:47:37.598 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-10T04:47:37.716 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:47:37.805 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-10T04:47:37.834 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-10T04:47:37.860 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-10T04:47:37.882 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T04:47:37.904 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T04:47:37.922 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-10T04:47:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T04:47:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T04:47:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-10T04:47:38.094 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T04:47:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-10T04:47:38.146 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T04:47:38.550 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-10T04:47:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-10T04:47:38.611 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T04:47:38.685 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T04:47:38.688 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:38.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-10T04:47:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-10T04:47:38.805 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T04:47:38.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-10T04:47:38.851 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T04:47:38.888 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-10T04:47:38.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-10T04:47:39.001 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T04:47:39.032 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T04:47:39.104 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T04:47:39.147 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-10T04:47:39.264 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-10T04:47:39.298 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-10T04:47:39.365 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-10T04:47:39.397 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-10T04:47:39.426 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-10T04:47:39.458 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-10T04:47:39.788 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-10T04:47:39.830 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T04:47:39.928 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T04:47:39.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-10T04:47:39.996 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-10T04:47:40.493 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-10T04:47:40.524 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T04:47:40.595 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T04:47:40.674 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-10T04:47:40.710 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-10T04:47:41.103 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:41.146 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:41.722 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:41.758 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T04:47:41.850 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T04:47:41.850 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T04:47:41.850 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T04:47:41.850 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:41.884 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:43.010 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:43.047 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:43.618 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T04:47:43.659 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T04:47:43.756 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T04:47:43.757 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T04:47:43.757 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T04:47:43.757 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:43.785 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:51.990 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:51.990 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-10T04:47:51.990 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-10T04:47:51.990 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-10T04:47:51.990 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-10T04:47:51.991 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-10T04:47:51.991 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-10T04:47:51.991 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-10T04:47:51.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:53.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T04:47:53.040 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T04:47:53.040 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:47:53.040 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T04:47:53.040 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T04:47:53.040 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T04:47:53.041 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:53.042 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T04:47:53.125 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T04:47:53.125 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-10T04:47:53.780 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-10T04:47:53.781 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-10T04:47:53.781 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:54.333 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:54.333 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-10T04:47:54.333 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-10T04:47:54.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-10T04:47:54.335 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-10T04:47:54.336 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-10T04:47:54.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-10T04:47:54.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-10T04:47:54.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:54.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-10T04:47:54.337 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-10T04:47:54.777 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T04:47:54.804 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:54.806 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T04:47:54.888 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T04:47:54.888 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:55.334 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-10T04:47:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T04:47:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:55.337 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:47:55.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T04:47:56.163 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-10T04:47:56.164 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-10T04:47:56.165 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-10T04:47:56.275 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:28 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:47:56.408 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:56.409 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 46 M 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 201 M 2024-09-10T04:47:56.410 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:47:56.814 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-10T04:47:56.856 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-10T04:47:56.898 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 700 kB/s | 161 kB 00:00 2024-09-10T04:47:57.061 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T04:47:57.061 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:57.061 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-10T04:47:57.061 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.061 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.062 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T04:47:57.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:57.064 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:47:57.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-test 2024-09-10T04:47:57.956 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:27 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:47:58.088 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:47:58.089 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:47:58.090 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 46 M 2024-09-10T04:47:58.091 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 201 M 2024-09-10T04:47:58.091 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:47:58.131 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 31 MB/s | 45 MB 00:01 2024-09-10T04:47:58.133 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:47:58.134 INFO:teuthology.orchestra.run.smithi098.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-10T04:47:58.161 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:47:58.181 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:47:58.181 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:47:58.342 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 784 kB/s | 161 kB 00:00 2024-09-10T04:47:58.534 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:47:58.534 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:47:58.692 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-09-10T04:47:58.718 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 523 kB/s | 304 kB 00:00 2024-09-10T04:47:59.038 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:47:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T04:47:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T04:47:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T04:47:59.568 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 32 MB/s | 45 MB 00:01 2024-09-10T04:47:59.570 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:47:59.570 INFO:teuthology.orchestra.run.smithi145.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-10T04:47:59.598 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:47:59.618 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:47:59.618 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:47:59.970 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:47:59.971 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:00.492 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:00.577 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T04:48:00.617 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T04:48:00.645 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T04:48:03.502 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T04:48:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T04:48:05.002 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T04:48:05.084 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T04:48:05.946 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T04:48:05.946 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-10T04:48:05.946 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-10T04:48:05.947 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T04:48:06.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T04:48:06.268 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:06.268 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:06.268 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:06.269 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:06.269 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T04:48:06.269 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T04:48:06.269 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:06.269 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:06.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2024-09-10T04:48:07.109 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:39 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:07.261 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-10T04:48:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T04:48:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T04:48:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:07.267 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:07.268 INFO:teuthology.orchestra.run.smithi098.stdout:Install 37 Packages 2024-09-10T04:48:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:07.268 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 31 M 2024-09-10T04:48:07.268 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 109 M 2024-09-10T04:48:07.268 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:07.539 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T04:48:07.539 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-10T04:48:07.539 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-10T04:48:07.539 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T04:48:07.880 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T04:48:07.880 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:07.880 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:07.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:07.881 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:07.881 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T04:48:07.881 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T04:48:07.881 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:07.881 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:08.009 INFO:teuthology.orchestra.run.smithi098.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-10T04:48:08.175 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph 2024-09-10T04:48:08.184 INFO:teuthology.orchestra.run.smithi098.stdout:(2/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-10T04:48:08.293 INFO:teuthology.orchestra.run.smithi098.stdout:(3/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 5.9 MB/s | 2.4 MB 00:00 2024-09-10T04:48:08.385 INFO:teuthology.orchestra.run.smithi098.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 3.1 MB/s | 291 kB 00:00 2024-09-10T04:48:08.452 INFO:teuthology.orchestra.run.smithi098.stdout:(5/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-10T04:48:08.619 INFO:teuthology.orchestra.run.smithi098.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-10T04:48:08.750 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:38 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:08.803 INFO:teuthology.orchestra.run.smithi098.stdout:(7/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-10T04:48:08.828 INFO:teuthology.orchestra.run.smithi098.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-09-10T04:48:08.878 INFO:teuthology.orchestra.run.smithi098.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-10T04:48:08.890 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:08.893 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:08.893 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:08.893 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T04:48:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T04:48:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T04:48:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout:Install 37 Packages 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:08.897 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 31 M 2024-09-10T04:48:08.898 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 109 M 2024-09-10T04:48:08.898 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:08.912 INFO:teuthology.orchestra.run.smithi098.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-10T04:48:08.937 INFO:teuthology.orchestra.run.smithi098.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-10T04:48:08.979 INFO:teuthology.orchestra.run.smithi098.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 768 kB/s | 135 kB 00:00 2024-09-10T04:48:09.038 INFO:teuthology.orchestra.run.smithi098.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-10T04:48:09.063 INFO:teuthology.orchestra.run.smithi098.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T04:48:09.088 INFO:teuthology.orchestra.run.smithi098.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-09-10T04:48:09.113 INFO:teuthology.orchestra.run.smithi098.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-10T04:48:09.138 INFO:teuthology.orchestra.run.smithi098.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-10T04:48:09.172 INFO:teuthology.orchestra.run.smithi098.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-09-10T04:48:09.206 INFO:teuthology.orchestra.run.smithi098.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-10T04:48:09.231 INFO:teuthology.orchestra.run.smithi098.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-10T04:48:09.265 INFO:teuthology.orchestra.run.smithi098.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 480 kB/s | 43 kB 00:00 2024-09-10T04:48:09.290 INFO:teuthology.orchestra.run.smithi098.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-10T04:48:09.316 INFO:teuthology.orchestra.run.smithi098.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-10T04:48:09.341 INFO:teuthology.orchestra.run.smithi098.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-10T04:48:09.366 INFO:teuthology.orchestra.run.smithi098.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-10T04:48:09.391 INFO:teuthology.orchestra.run.smithi098.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-10T04:48:09.417 INFO:teuthology.orchestra.run.smithi098.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-10T04:48:09.427 INFO:teuthology.orchestra.run.smithi145.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 57 kB/s | 6.6 kB 00:00 2024-09-10T04:48:09.442 INFO:teuthology.orchestra.run.smithi098.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-10T04:48:09.467 INFO:teuthology.orchestra.run.smithi098.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-10T04:48:09.493 INFO:teuthology.orchestra.run.smithi098.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-10T04:48:09.518 INFO:teuthology.orchestra.run.smithi098.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-10T04:48:09.543 INFO:teuthology.orchestra.run.smithi098.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-10T04:48:09.568 INFO:teuthology.orchestra.run.smithi098.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-10T04:48:09.594 INFO:teuthology.orchestra.run.smithi098.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-10T04:48:09.619 INFO:teuthology.orchestra.run.smithi145.stdout:(2/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 5.0 MB/s | 1.5 MB 00:00 2024-09-10T04:48:09.619 INFO:teuthology.orchestra.run.smithi098.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-10T04:48:09.644 INFO:teuthology.orchestra.run.smithi098.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T04:48:09.669 INFO:teuthology.orchestra.run.smithi145.stdout:(3/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 6.6 MB/s | 2.4 MB 00:00 2024-09-10T04:48:09.677 INFO:teuthology.orchestra.run.smithi098.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-10T04:48:09.681 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:09.681 INFO:teuthology.orchestra.run.smithi098.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-10T04:48:09.753 INFO:teuthology.orchestra.run.smithi145.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 3.4 MB/s | 291 kB 00:00 2024-09-10T04:48:09.836 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:09.876 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:09.876 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:09.886 INFO:teuthology.orchestra.run.smithi145.stdout:(5/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86_ 10 MB/s | 4.8 MB 00:00 2024-09-10T04:48:09.953 INFO:teuthology.orchestra.run.smithi145.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-10T04:48:09.987 INFO:teuthology.orchestra.run.smithi145.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-09-10T04:48:10.029 INFO:teuthology.orchestra.run.smithi145.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-10T04:48:10.071 INFO:teuthology.orchestra.run.smithi145.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-10T04:48:10.113 INFO:teuthology.orchestra.run.smithi145.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-09-10T04:48:10.296 INFO:teuthology.orchestra.run.smithi145.stdout:(11/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86 25 MB/s | 17 MB 00:00 2024-09-10T04:48:10.329 INFO:teuthology.orchestra.run.smithi145.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-09-10T04:48:10.347 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:10.347 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:10.597 INFO:teuthology.orchestra.run.smithi145.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 130 kB/s | 35 kB 00:00 2024-09-10T04:48:10.714 INFO:teuthology.orchestra.run.smithi145.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 314 kB/s | 188 kB 00:00 2024-09-10T04:48:10.781 INFO:teuthology.orchestra.run.smithi145.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 420 kB/s | 77 kB 00:00 2024-09-10T04:48:10.805 INFO:teuthology.orchestra.run.smithi145.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 338 kB/s | 172 kB 00:00 2024-09-10T04:48:10.831 INFO:teuthology.orchestra.run.smithi145.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-09-10T04:48:10.881 INFO:teuthology.orchestra.run.smithi145.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-10T04:48:10.907 INFO:teuthology.orchestra.run.smithi145.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 331 kB/s | 42 kB 00:00 2024-09-10T04:48:10.932 INFO:teuthology.orchestra.run.smithi145.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 864 kB/s | 43 kB 00:00 2024-09-10T04:48:10.965 INFO:teuthology.orchestra.run.smithi145.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-10T04:48:10.999 INFO:teuthology.orchestra.run.smithi145.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T04:48:11.024 INFO:teuthology.orchestra.run.smithi145.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 188 kB/s | 11 kB 00:00 2024-09-10T04:48:11.041 INFO:teuthology.orchestra.run.smithi145.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 442 kB/s | 18 kB 00:00 2024-09-10T04:48:11.066 INFO:teuthology.orchestra.run.smithi145.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.8 MB/s | 358 kB 00:00 2024-09-10T04:48:11.083 INFO:teuthology.orchestra.run.smithi145.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 394 kB/s | 23 kB 00:00 2024-09-10T04:48:11.100 INFO:teuthology.orchestra.run.smithi145.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 329 kB/s | 19 kB 00:00 2024-09-10T04:48:11.117 INFO:teuthology.orchestra.run.smithi145.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 388 kB/s | 20 kB 00:00 2024-09-10T04:48:11.134 INFO:teuthology.orchestra.run.smithi145.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 914 kB/s | 46 kB 00:00 2024-09-10T04:48:11.160 INFO:teuthology.orchestra.run.smithi145.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-10T04:48:11.176 INFO:teuthology.orchestra.run.smithi145.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-10T04:48:11.193 INFO:teuthology.orchestra.run.smithi145.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-10T04:48:11.219 INFO:teuthology.orchestra.run.smithi145.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-10T04:48:11.244 INFO:teuthology.orchestra.run.smithi145.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T04:48:11.261 INFO:teuthology.orchestra.run.smithi145.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T04:48:11.289 INFO:teuthology.orchestra.run.smithi145.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T04:48:11.314 INFO:teuthology.orchestra.run.smithi145.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.4 MB/s | 427 kB 00:00 2024-09-10T04:48:11.319 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:11.319 INFO:teuthology.orchestra.run.smithi145.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-10T04:48:11.472 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:11.512 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:11.512 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:11.747 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T04:48:11.797 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T04:48:11.825 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T04:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T04:48:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T04:48:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T04:48:12.020 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:12.020 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T04:48:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T04:48:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T04:48:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T04:48:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T04:48:12.301 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T04:48:12.342 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T04:48:12.391 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T04:48:12.426 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T04:48:12.461 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T04:48:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T04:48:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T04:48:12.617 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T04:48:12.756 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T04:48:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T04:48:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T04:48:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T04:48:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T04:48:13.040 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T04:48:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T04:48:13.274 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T04:48:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T04:48:13.431 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T04:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T04:48:13.492 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T04:48:13.525 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T04:48:13.553 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T04:48:13.609 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T04:48:13.625 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T04:48:13.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T04:48:13.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T04:48:13.779 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-10T04:48:13.793 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T04:48:13.809 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T04:48:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T04:48:13.835 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:13.835 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T04:48:13.836 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T04:48:13.836 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T04:48:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:13.873 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T04:48:13.920 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T04:48:13.956 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T04:48:13.986 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T04:48:14.020 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T04:48:14.053 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T04:48:14.094 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T04:48:14.137 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T04:48:14.172 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T04:48:14.220 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T04:48:14.252 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T04:48:14.325 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T04:48:14.464 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T04:48:14.551 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T04:48:14.605 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T04:48:14.643 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T04:48:14.700 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T04:48:14.757 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T04:48:14.951 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T04:48:15.007 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T04:48:15.085 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T04:48:15.173 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T04:48:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T04:48:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T04:48:15.321 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T04:48:15.321 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:15.321 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T04:48:15.321 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T04:48:15.322 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T04:48:15.324 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:15.343 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T04:48:15.511 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-10T04:48:15.541 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T04:48:15.567 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T04:48:15.567 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:15.567 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T04:48:15.568 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T04:48:15.568 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T04:48:15.568 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:15.760 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T04:48:15.784 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T04:48:15.784 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:15.785 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T04:48:15.785 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T04:48:15.785 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T04:48:15.785 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:16.011 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T04:48:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T04:48:16.035 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:16.036 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T04:48:16.036 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T04:48:16.036 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T04:48:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T04:48:17.025 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T04:48:17.052 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:17.500 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T04:48:17.524 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T04:48:17.524 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:17.524 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T04:48:17.525 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T04:48:17.525 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T04:48:17.525 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:17.745 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T04:48:17.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-10T04:48:17.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T04:48:17.746 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T04:48:17.747 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T04:48:17.748 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T04:48:17.748 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T04:48:17.748 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T04:48:17.748 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T04:48:17.749 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T04:48:17.749 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T04:48:17.749 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T04:48:17.749 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T04:48:17.749 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T04:48:17.751 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T04:48:17.775 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:17.841 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T04:48:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T04:48:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T04:48:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T04:48:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:18.697 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:19.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2024-09-10T04:48:19.645 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:51 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T04:48:19.684 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T04:48:19.685 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T04:48:19.686 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T04:48:19.734 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:48:19.776 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:19.776 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:48:19.777 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:19.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2024-09-10T04:48:20.394 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:52 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:20.525 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:20.526 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:20.526 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:20.526 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 783 k 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 789 k 2024-09-10T04:48:20.527 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:20.629 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T04:48:20.630 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T04:48:20.631 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:20.632 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:20.808 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.7 MB/s | 783 kB 00:00 2024-09-10T04:48:20.808 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:20.809 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-10T04:48:20.809 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:20.814 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:20.814 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:20.820 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:20.820 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:21.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-base 2024-09-10T04:48:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:21.595 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:51 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:21.685 INFO:teuthology.orchestra.run.smithi145.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:48:21.727 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:21.728 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:48:21.728 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:21.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install cephadm 2024-09-10T04:48:21.847 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:22.102 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:22.319 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T04:48:22.363 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:52 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:22.496 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:22.497 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:22.498 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:48:22.498 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:22.498 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 783 k 2024-09-10T04:48:22.498 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 789 k 2024-09-10T04:48:22.498 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:22.775 INFO:teuthology.orchestra.run.smithi145.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-10T04:48:22.776 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:22.776 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-10T04:48:22.776 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:22.781 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:22.781 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:22.787 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:22.787 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:22.862 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:22.887 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:54 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:23.022 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:48:23.023 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:23.024 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 145 k 2024-09-10T04:48:23.024 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 432 k 2024-09-10T04:48:23.024 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:23.231 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 700 kB/s | 145 kB 00:00 2024-09-10T04:48:23.232 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:23.232 INFO:teuthology.orchestra.run.smithi098.stdout:Total 694 kB/s | 145 kB 00:00 2024-09-10T04:48:23.232 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:23.240 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:23.240 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:23.297 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:23.297 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:23.320 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:23.429 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:23.533 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:23.534 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:23.534 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T04:48:23.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:23.831 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:24.085 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:24.305 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:24.466 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:24.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2024-09-10T04:48:24.885 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:54 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:25.021 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-10T04:48:25.022 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 145 k 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 432 k 2024-09-10T04:48:25.023 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:25.224 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 724 kB/s | 145 kB 00:00 2024-09-10T04:48:25.224 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:25.225 INFO:teuthology.orchestra.run.smithi145.stdout:Total 718 kB/s | 145 kB 00:00 2024-09-10T04:48:25.225 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:25.232 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:25.232 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:25.272 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:57 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:25.289 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:25.289 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:25.363 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:48:25.406 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:25.407 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:48:25.407 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:25.439 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:25.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T04:48:25.517 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:25.542 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:25.542 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T04:48:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:26.020 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:26.152 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-10T04:48:26.153 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:26.154 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:26.155 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:26.155 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-10T04:48:26.155 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:26.155 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 19 M 2024-09-10T04:48:26.155 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 159 M 2024-09-10T04:48:26.156 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:26.427 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4762.gba 235 kB/s | 34 kB 00:00 2024-09-10T04:48:26.461 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4762.gbad 91 kB/s | 16 kB 00:00 2024-09-10T04:48:26.509 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T04:48:26.510 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:26.510 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:26.510 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:48:26.510 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:26.510 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:26.752 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr 2024-09-10T04:48:26.945 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4762.gbad475c 21 MB/s | 14 MB 00:00 2024-09-10T04:48:27.111 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.1 MB/s | 863 kB 00:00 2024-09-10T04:48:27.162 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-10T04:48:27.187 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-10T04:48:27.271 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 25 MB/s | 2.0 MB 00:00 2024-09-10T04:48:27.296 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-10T04:48:27.321 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-10T04:48:27.323 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:57 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:27.346 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-10T04:48:27.372 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 296 kB/s | 269 kB 00:00 2024-09-10T04:48:27.417 INFO:teuthology.orchestra.run.smithi145.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:48:27.460 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:27.461 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:48:27.461 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:27.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T04:48:27.555 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 916 kB/s | 1.0 MB 00:01 2024-09-10T04:48:27.559 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:27.559 INFO:teuthology.orchestra.run.smithi098.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-10T04:48:27.607 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:27.627 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:27.627 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:27.895 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:27.895 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:28.101 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:28.234 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:28.235 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:28.235 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T04:48:28.236 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout:Install 12 Packages 2024-09-10T04:48:28.237 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:28.238 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 19 M 2024-09-10T04:48:28.238 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 159 M 2024-09-10T04:48:28.238 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:28.487 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:28.589 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T04:48:28.624 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T04:48:28.670 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T04:48:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T04:48:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T04:48:28.952 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T04:48:29.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T04:48:29.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T04:48:29.118 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T04:48:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-10T04:48:29.177 INFO:teuthology.orchestra.run.smithi145.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4762.gbad 104 kB/s | 16 kB 00:00 2024-09-10T04:48:29.202 INFO:teuthology.orchestra.run.smithi145.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4762.gba 187 kB/s | 34 kB 00:00 2024-09-10T04:48:29.669 INFO:teuthology.orchestra.run.smithi145.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4762.gbad475c 22 MB/s | 14 MB 00:00 2024-09-10T04:48:29.694 INFO:teuthology.orchestra.run.smithi145.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 547 kB/s | 269 kB 00:00 2024-09-10T04:48:29.753 INFO:teuthology.orchestra.run.smithi145.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-10T04:48:29.778 INFO:teuthology.orchestra.run.smithi145.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-10T04:48:29.854 INFO:teuthology.orchestra.run.smithi145.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-10T04:48:29.879 INFO:teuthology.orchestra.run.smithi145.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-10T04:48:29.913 INFO:teuthology.orchestra.run.smithi145.stdout:(9/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-09-10T04:48:29.938 INFO:teuthology.orchestra.run.smithi145.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-09-10T04:48:29.988 INFO:teuthology.orchestra.run.smithi145.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-10T04:48:30.621 INFO:teuthology.orchestra.run.smithi145.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 907 kB/s | 863 kB 00:00 2024-09-10T04:48:30.627 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:30.627 INFO:teuthology.orchestra.run.smithi145.stdout:Total 8.1 MB/s | 19 MB 00:02 2024-09-10T04:48:30.680 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:30.701 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:30.701 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:30.974 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:30.974 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:31.599 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:31.680 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T04:48:31.715 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T04:48:31.762 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T04:48:31.792 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T04:48:31.895 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T04:48:32.027 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T04:48:32.112 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T04:48:32.180 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T04:48:32.209 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T04:48:32.241 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-10T04:48:32.327 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-10T04:48:32.380 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T04:48:34.356 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T04:48:34.356 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-10T04:48:34.356 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T04:48:34.357 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T04:48:34.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T04:48:34.666 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:34.666 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:34.666 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T04:48:34.666 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:34.667 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:34.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T04:48:35.406 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-10T04:48:35.462 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T04:48:35.479 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:07 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:35.612 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:35.613 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-10T04:48:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:35.613 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-10T04:48:35.613 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T04:48:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 38 M 2024-09-10T04:48:35.615 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 212 M 2024-09-10T04:48:35.616 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:36.013 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-10T04:48:36.113 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-10T04:48:36.139 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-10T04:48:36.180 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-10T04:48:36.231 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-10T04:48:36.356 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-10T04:48:36.423 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-10T04:48:36.540 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-09-10T04:48:36.615 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-10T04:48:36.649 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 837 kB/s | 245 kB 00:00 2024-09-10T04:48:36.674 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-10T04:48:36.916 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 54 MB/s | 16 MB 00:00 2024-09-10T04:48:36.917 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:36.917 INFO:teuthology.orchestra.run.smithi098.stdout:Total 29 MB/s | 38 MB 00:01 2024-09-10T04:48:37.272 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:37.299 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:37.299 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T04:48:37.534 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T04:48:37.535 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T04:48:37.535 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T04:48:37.535 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T04:48:37.535 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T04:48:37.733 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:37.733 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:37.863 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T04:48:37.863 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:37.863 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:37.863 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T04:48:37.864 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:37.865 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:38.115 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T04:48:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T04:48:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T04:48:38.697 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:08 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:38.729 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T04:48:38.766 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T04:48:38.836 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:38.837 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-10T04:48:38.837 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T04:48:38.838 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout:Install 12 Packages 2024-09-10T04:48:38.839 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:38.840 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 38 M 2024-09-10T04:48:38.840 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 212 M 2024-09-10T04:48:38.840 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:38.951 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T04:48:38.998 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T04:48:39.075 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T04:48:39.178 INFO:teuthology.orchestra.run.smithi145.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 999 kB/s | 191 kB 00:00 2024-09-10T04:48:39.286 INFO:teuthology.orchestra.run.smithi145.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-09-10T04:48:39.337 INFO:teuthology.orchestra.run.smithi145.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-10T04:48:39.445 INFO:teuthology.orchestra.run.smithi145.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-10T04:48:39.537 INFO:teuthology.orchestra.run.smithi145.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 91 kB/s | 18 kB 00:00 2024-09-10T04:48:39.562 INFO:teuthology.orchestra.run.smithi145.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 330 kB/s | 38 kB 00:00 2024-09-10T04:48:39.621 INFO:teuthology.orchestra.run.smithi145.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-10T04:48:39.671 INFO:teuthology.orchestra.run.smithi145.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-10T04:48:39.733 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T04:48:39.738 INFO:teuthology.orchestra.run.smithi145.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-09-10T04:48:39.805 INFO:teuthology.orchestra.run.smithi145.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-10T04:48:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T04:48:39.906 INFO:teuthology.orchestra.run.smithi145.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 13 MB/s | 4.9 MB 00:00 2024-09-10T04:48:40.206 INFO:teuthology.orchestra.run.smithi145.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-10T04:48:40.206 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:40.207 INFO:teuthology.orchestra.run.smithi145.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-10T04:48:40.559 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:40.586 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:40.586 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:41.031 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:41.031 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:41.090 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T04:48:41.788 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:41.859 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T04:48:41.904 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T04:48:42.002 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T04:48:42.046 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T04:48:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T04:48:42.148 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T04:48:42.238 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T04:48:42.270 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T04:48:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T04:48:43.011 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T04:48:43.125 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T04:48:44.372 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T04:48:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T04:48:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-10T04:48:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T04:48:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T04:48:45.210 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:45.211 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:45.414 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T04:48:45.445 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T04:48:45.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2024-09-10T04:48:46.143 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:18 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:46.275 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T04:48:46.277 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2024-09-10T04:48:46.278 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:46.279 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.2 M 2024-09-10T04:48:46.279 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 26 M 2024-09-10T04:48:46.279 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:46.800 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 220 kB/s | 19 kB 00:00 2024-09-10T04:48:46.817 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 246 kB/s | 26 kB 00:00 2024-09-10T04:48:46.884 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 288 kB/s | 49 kB 00:00 2024-09-10T04:48:46.909 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-10T04:48:46.935 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T04:48:46.952 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-09-10T04:48:46.986 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 639 kB/s | 32 kB 00:00 2024-09-10T04:48:47.002 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 281 kB/s | 14 kB 00:00 2024-09-10T04:48:47.027 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-09-10T04:48:47.061 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-10T04:48:47.086 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-10T04:48:47.103 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-09-10T04:48:47.145 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-10T04:48:47.148 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:47.148 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-10T04:48:47.211 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:47.226 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:47.226 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:47.314 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:47.314 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:47.826 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:47.993 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T04:48:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T04:48:48.033 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T04:48:48.033 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T04:48:48.033 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T04:48:48.033 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T04:48:48.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T04:48:48.101 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T04:48:48.131 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T04:48:48.180 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T04:48:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T04:48:48.439 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:48.440 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:48.442 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T04:48:48.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T04:48:48.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-rook 2024-09-10T04:48:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T04:48:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T04:48:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T04:48:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T04:48:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T04:48:49.434 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:19 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:49.567 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:49.568 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:49.568 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:49.568 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T04:48:49.569 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout:Install 13 Packages 2024-09-10T04:48:49.570 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:49.571 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 2.2 M 2024-09-10T04:48:49.571 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 26 M 2024-09-10T04:48:49.571 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:49.945 INFO:teuthology.orchestra.run.smithi145.stdout:(1/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 313 kB/s | 49 kB 00:00 2024-09-10T04:48:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T04:48:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T04:48:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T04:48:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T04:48:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T04:48:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T04:48:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T04:48:50.053 INFO:teuthology.orchestra.run.smithi145.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 96 kB/s | 26 kB 00:00 2024-09-10T04:48:50.078 INFO:teuthology.orchestra.run.smithi145.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 66 kB/s | 19 kB 00:00 2024-09-10T04:48:50.345 INFO:teuthology.orchestra.run.smithi145.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T04:48:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:50.357 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:50.429 INFO:teuthology.orchestra.run.smithi145.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 796 kB/s | 279 kB 00:00 2024-09-10T04:48:50.454 INFO:teuthology.orchestra.run.smithi145.stdout:(6/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 436 kB/s | 222 kB 00:00 2024-09-10T04:48:50.479 INFO:teuthology.orchestra.run.smithi145.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 401 kB/s | 54 kB 00:00 2024-09-10T04:48:50.530 INFO:teuthology.orchestra.run.smithi145.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-10T04:48:50.555 INFO:teuthology.orchestra.run.smithi145.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 141 kB/s | 14 kB 00:00 2024-09-10T04:48:50.580 INFO:teuthology.orchestra.run.smithi145.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T04:48:50.605 INFO:teuthology.orchestra.run.smithi145.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-10T04:48:50.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T04:48:50.630 INFO:teuthology.orchestra.run.smithi145.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-10T04:48:50.664 INFO:teuthology.orchestra.run.smithi145.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-10T04:48:50.667 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:50.667 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-10T04:48:50.731 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:50.746 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:50.746 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:50.833 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:50.835 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:51.177 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:23 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:51.310 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T04:48:51.311 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:51.312 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 7.0 M 2024-09-10T04:48:51.313 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 33 M 2024-09-10T04:48:51.313 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:51.343 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:51.501 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T04:48:51.556 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T04:48:51.620 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T04:48:51.658 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T04:48:51.699 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T04:48:51.799 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T04:48:51.898 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-10T04:48:51.901 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T04:48:51.949 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-10T04:48:51.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T04:48:51.974 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-10T04:48:51.999 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 679 kB/s | 154 kB 00:00 2024-09-10T04:48:52.025 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-10T04:48:52.116 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-10T04:48:52.118 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:52.118 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.7 MB/s | 7.0 MB 00:00 2024-09-10T04:48:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:52.199 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:52.199 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:52.299 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:52.304 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:52.614 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:52.677 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T04:48:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T04:48:52.773 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T04:48:52.789 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T04:48:52.822 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T04:48:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T04:48:52.843 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T04:48:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T04:48:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T04:48:53.531 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T04:48:53.556 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T04:48:53.655 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T04:48:53.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-10T04:48:53.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T04:48:53.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T04:48:53.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T04:48:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:53.995 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:54.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T04:48:54.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T04:48:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T04:48:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:54.649 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:54.871 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:48:54.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2024-09-10T04:48:55.004 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:48:55.005 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:55.005 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:48:55.005 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout:Install 6 Packages 2024-09-10T04:48:55.006 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:55.007 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 7.0 M 2024-09-10T04:48:55.007 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 33 M 2024-09-10T04:48:55.007 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:48:55.461 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:27 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:55.533 INFO:teuthology.orchestra.run.smithi145.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 708 kB/s | 154 kB 00:00 2024-09-10T04:48:55.591 INFO:teuthology.orchestra.run.smithi145.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-10T04:48:55.594 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:55.594 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:55.594 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:55.594 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2024-09-10T04:48:55.595 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:55.596 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 980 k 2024-09-10T04:48:55.596 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 2.9 M 2024-09-10T04:48:55.596 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:55.616 INFO:teuthology.orchestra.run.smithi145.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-10T04:48:55.641 INFO:teuthology.orchestra.run.smithi145.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-10T04:48:55.744 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 800 kB/s | 80 kB 00:00 2024-09-10T04:48:55.892 INFO:teuthology.orchestra.run.smithi145.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 430 kB/s | 248 kB 00:00 2024-09-10T04:48:55.952 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 2.9 MB/s | 900 kB 00:00 2024-09-10T04:48:55.953 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:55.953 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.7 MB/s | 980 kB 00:00 2024-09-10T04:48:55.965 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:55.987 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:55.987 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:56.068 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:56.068 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:56.256 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T04:48:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T04:48:56.909 INFO:teuthology.orchestra.run.smithi145.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-10T04:48:56.911 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:56.911 INFO:teuthology.orchestra.run.smithi145.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-09-10T04:48:56.985 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:48:56.997 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:48:56.997 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:48:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T04:48:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-10T04:48:57.098 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:48:57.099 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:48:57.348 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T04:48:57.348 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:57.349 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:48:57.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T04:48:57.349 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:57.349 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:48:57.407 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:48:57.585 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T04:48:57.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-volume 2024-09-10T04:48:57.636 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T04:48:58.153 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T04:48:58.202 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:30 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:48:58.246 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T04:48:58.314 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T04:48:58.339 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T04:48:58.339 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:48:58.340 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-10T04:48:58.340 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:58.340 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:48:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 285 k 2024-09-10T04:48:58.341 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 1.3 M 2024-09-10T04:48:58.342 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:48:58.575 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-10T04:48:58.575 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:48:58.575 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-10T04:48:58.576 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:48:58.583 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:48:58.584 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:48:58.614 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:48:58.614 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:48:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:48:58.901 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:48:58.917 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:48:58.918 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T04:48:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:48:59.141 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T04:48:59.142 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-10T04:48:59.142 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T04:48:59.142 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T04:48:59.142 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T04:48:59.142 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T04:48:59.429 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T04:48:59.430 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:48:59.430 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:48:59.716 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-fuse 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:00.039 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:00.279 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:30 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:00.360 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2024-09-10T04:49:00.411 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:00.412 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout:Install 2 Packages 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 980 k 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 2.9 M 2024-09-10T04:49:00.413 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:00.552 INFO:teuthology.orchestra.run.smithi145.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 675 kB/s | 80 kB 00:00 2024-09-10T04:49:00.736 INFO:teuthology.orchestra.run.smithi145.stdout:(2/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 2.9 MB/s | 900 kB 00:00 2024-09-10T04:49:00.736 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:00.736 INFO:teuthology.orchestra.run.smithi145.stdout:Total 3.0 MB/s | 980 kB 00:00 2024-09-10T04:49:00.747 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:00.767 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:00.768 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:00.847 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:00.847 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:00.943 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:32 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:01.033 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:01.077 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:01.077 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-10T04:49:01.077 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:49:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:01.079 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 126 k 2024-09-10T04:49:01.079 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 456 k 2024-09-10T04:49:01.079 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:49:01.171 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T04:49:01.235 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T04:49:01.289 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 602 kB/s | 126 kB 00:00 2024-09-10T04:49:01.289 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:01.290 INFO:teuthology.orchestra.run.smithi098.stdout:Total 597 kB/s | 126 kB 00:00 2024-09-10T04:49:01.290 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:49:01.295 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:49:01.296 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:49:01.359 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:49:01.359 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:49:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:49:01.612 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:01.942 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T04:49:01.942 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-10T04:49:02.054 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:02.228 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T04:49:02.228 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:02.229 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:02.229 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T04:49:02.229 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:02.229 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:02.347 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:02.347 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:02.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-volume 2024-09-10T04:49:02.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2024-09-10T04:49:03.116 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:03.177 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:03.253 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:03.254 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-10T04:49:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:03.254 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:03.254 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 285 k 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 1.3 M 2024-09-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:03.269 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:03.314 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:03.315 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:03.315 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:03.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2024-09-10T04:49:03.490 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-10T04:49:03.490 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:03.491 INFO:teuthology.orchestra.run.smithi145.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-10T04:49:03.491 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:03.499 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:03.499 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:03.529 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:03.529 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:03.751 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:03.817 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:49:03.833 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:49:03.833 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:49:03.833 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T04:49:03.834 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:03.932 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:49:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 32 k 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 142 k 2024-09-10T04:49:04.066 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:49:04.219 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 209 kB/s | 32 kB 00:00 2024-09-10T04:49:04.219 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:04.220 INFO:teuthology.orchestra.run.smithi098.stdout:Total 207 kB/s | 32 kB 00:00 2024-09-10T04:49:04.220 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:49:04.223 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:49:04.223 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:49:04.244 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:49:04.245 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:49:04.338 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:49:04.449 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:04.885 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:04.919 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T04:49:04.919 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:04.919 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:04.919 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T04:49:04.919 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:04.920 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:05.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:05.120 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:05.120 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:05.120 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:05.121 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:05.121 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:05.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librados-devel 2024-09-10T04:49:05.291 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2024-09-10T04:49:05.824 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:05.857 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:05.947 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:05.961 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:05.962 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:05.963 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:05.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:05.963 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 126 k 2024-09-10T04:49:05.963 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 456 k 2024-09-10T04:49:05.963 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:05.990 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:05.991 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:05.991 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:06.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2024-09-10T04:49:06.170 INFO:teuthology.orchestra.run.smithi145.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 613 kB/s | 126 kB 00:00 2024-09-10T04:49:06.171 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:06.171 INFO:teuthology.orchestra.run.smithi145.stdout:Total 608 kB/s | 126 kB 00:00 2024-09-10T04:49:06.171 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:06.176 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:06.176 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:06.240 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:06.240 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:06.398 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:06.500 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:06.616 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:06.707 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:06.749 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:06.750 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:06.751 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:06.812 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2024-09-10T04:49:06.927 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:07.186 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:07.186 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:07.377 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:07.467 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:07.468 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install libcephfs2 2024-09-10T04:49:07.511 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:07.511 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:07.512 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:07.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2024-09-10T04:49:08.039 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:08.129 INFO:teuthology.orchestra.run.smithi145.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:08.143 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:08.174 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:08.176 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:08.176 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:08.233 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:08.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install libcephfs-devel 2024-09-10T04:49:08.335 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2024-09-10T04:49:08.864 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:08.904 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:08.994 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:09.008 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:09.009 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:09.010 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:09.010 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:09.010 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 32 k 2024-09-10T04:49:09.010 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 142 k 2024-09-10T04:49:09.010 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:09.037 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:09.038 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:09.038 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:09.105 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2024-09-10T04:49:09.165 INFO:teuthology.orchestra.run.smithi145.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 205 kB/s | 32 kB 00:00 2024-09-10T04:49:09.166 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:09.166 INFO:teuthology.orchestra.run.smithi145.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-10T04:49:09.167 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:09.170 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:09.170 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:09.192 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:09.192 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:09.282 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:09.396 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:09.671 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:09.761 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:09.804 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:09.805 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-10T04:49:09.805 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:09.838 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:09.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2024-09-10T04:49:10.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:10.075 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:10.075 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:10.075 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:10.075 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:10.075 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:10.270 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librados2 2024-09-10T04:49:10.440 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:10.573 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:49:10.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:10.575 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 85 k 2024-09-10T04:49:10.575 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 231 k 2024-09-10T04:49:10.575 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:49:10.781 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 413 kB/s | 85 kB 00:00 2024-09-10T04:49:10.782 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:10.782 INFO:teuthology.orchestra.run.smithi098.stdout:Total 411 kB/s | 85 kB 00:00 2024-09-10T04:49:10.782 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:49:10.789 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:49:10.789 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:49:10.836 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:10.852 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:49:10.852 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:49:10.926 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:10.969 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:10.970 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:10.970 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:11.007 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:49:11.039 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librbd1 2024-09-10T04:49:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:11.479 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:11.601 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:11.691 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:11.733 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:11.734 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:11.735 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:11.738 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:11.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rados 2024-09-10T04:49:12.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2024-09-10T04:49:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:12.453 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:12.496 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:12.497 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:12.497 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:12.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rgw 2024-09-10T04:49:12.594 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:12.730 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:12.731 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:12.731 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-10T04:49:12.731 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:12.731 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.2 M 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 14 M 2024-09-10T04:49:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:49:13.052 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2024-09-10T04:49:13.052 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:13.053 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.9 MB/s | 3.2 MB 00:00 2024-09-10T04:49:13.053 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:49:13.062 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:49:13.062 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:49:13.129 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:13.148 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:49:13.148 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:49:13.218 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:13.261 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:13.262 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:13.262 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:13.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-cephfs 2024-09-10T04:49:13.604 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:49:13.661 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:13.687 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T04:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T04:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T04:49:13.688 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:13.898 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:13.988 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:14.031 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:14.032 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:14.032 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:14.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rbd 2024-09-10T04:49:14.657 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:14.746 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T04:49:14.790 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:14.790 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-10T04:49:14.790 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:14.821 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:14.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-fuse 2024-09-10T04:49:15.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2024-09-10T04:49:15.418 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:45 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:15.551 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 85 k 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 231 k 2024-09-10T04:49:15.552 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:15.634 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 04:47:28 AM UTC. 2024-09-10T04:49:15.760 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 410 kB/s | 85 kB 00:00 2024-09-10T04:49:15.761 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:15.761 INFO:teuthology.orchestra.run.smithi145.stdout:Total 408 kB/s | 85 kB 00:00 2024-09-10T04:49:15.761 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:15.766 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:15.767 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 170 k 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 490 k 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-10T04:49:15.768 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:15.769 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:15.831 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:15.831 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:15.975 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:15.981 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 801 kB/s | 170 kB 00:00 2024-09-10T04:49:15.981 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:15.981 INFO:teuthology.orchestra.run.smithi098.stdout:Total 796 kB/s | 170 kB 00:00 2024-09-10T04:49:15.981 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-10T04:49:15.989 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-10T04:49:15.989 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-10T04:49:16.052 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-10T04:49:16.053 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-10T04:49:16.075 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-10T04:49:16.328 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:16.458 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:16.726 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:17.003 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:17.003 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:17.003 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-10T04:49:17.004 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:17.004 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:17.004 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-10T04:49:17.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-mirror 2024-09-10T04:49:17.229 DEBUG:teuthology.parallel:result is None 2024-09-10T04:49:17.598 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:17.733 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:17.733 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:17.733 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:17.734 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:17.735 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 3.2 M 2024-09-10T04:49:17.735 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 14 M 2024-09-10T04:49:17.735 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:18.047 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2024-09-10T04:49:18.047 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:18.048 INFO:teuthology.orchestra.run.smithi145.stdout:Total 10 MB/s | 3.2 MB 00:00 2024-09-10T04:49:18.048 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:18.057 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:18.057 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:18.138 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:18.138 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:18.576 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:18.656 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:18.681 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:18.681 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T04:49:18.682 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T04:49:18.682 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T04:49:18.682 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T04:49:18.682 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:19.811 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:20.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-nbd 2024-09-10T04:49:20.662 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 04:47:30 AM UTC. 2024-09-10T04:49:20.798 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-10T04:49:20.798 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 170 k 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 490 k 2024-09-10T04:49:20.799 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-10T04:49:21.009 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 816 kB/s | 170 kB 00:00 2024-09-10T04:49:21.009 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-10T04:49:21.009 INFO:teuthology.orchestra.run.smithi145.stdout:Total 810 kB/s | 170 kB 00:00 2024-09-10T04:49:21.009 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-10T04:49:21.017 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-10T04:49:21.017 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-10T04:49:21.081 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-10T04:49:21.081 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-10T04:49:21.234 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-10T04:49:21.339 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:21.787 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:22.048 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-10T04:49:22.303 DEBUG:teuthology.parallel:result is None 2024-09-10T04:49:22.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T04:49:22.452 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T04:49:22.478 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4762.gbad475c1.el9 2024-09-10T04:49:22.478 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-10T04:49:22.479 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-10T04:49:22.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T04:49:22.619 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T04:49:22.640 INFO:teuthology.orchestra.run.smithi145.stdout:19.3.0-4762.gbad475c1.el9 2024-09-10T04:49:22.641 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-10T04:49:22.641 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-10T04:49:22.643 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T04:49:22.643 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:22.643 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T04:49:22.673 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:22.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T04:49:22.707 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T04:49:22.707 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:22.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T04:49:22.741 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T04:49:22.808 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:22.809 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T04:49:22.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T04:49:22.900 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T04:49:22.901 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:22.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T04:49:22.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T04:49:22.995 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:22.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T04:49:23.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T04:49:23.084 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T04:49:23.085 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:23.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T04:49:23.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T04:49:23.178 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:23.178 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T04:49:23.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T04:49:23.267 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T04:49:23.345 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T04:49:23.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-10T04:49:23.348 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-09-10T04:49:23.373 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T04:49:23.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T04:49:23.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T04:49:23.440 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T04:49:23.441 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T04:49:23.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T04:49:23.516 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T04:49:23.517 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T04:49:23.517 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7898669', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9786, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkepYLxJZ5hn9KFPpko3KxYm+/+G4HZD2phL7VhWyzBfi8HedWsdw1+IRpyaDDv4jcbfwHBZ6Sg+yUemujIhn4=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmQXSQcHdSdFQEYntx3CSgQiehzT0kFxZiNg2dmMGxFMJPPgUxSqXSdMjSu1bFBdHIAToXBE+ZWqZk2eIbJHpA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:21:45', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T04:49:23.517 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T04:49:23.549 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T04:49:23.564 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T04:49:23.605 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T04:49:23.630 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:23.630 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T04:49:23.684 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T04:49:23.684 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:23.739 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 04:49:13.965449544 +0000 2024-09-10T04:49:23.740 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 04:46:48.549384275 +0000 2024-09-10T04:49:23.740 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 04:46:48.549384275 +0000 2024-09-10T04:49:23.740 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-10 04:46:48.549384275 +0000 2024-09-10T04:49:23.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T04:49:23.803 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T04:49:23.803 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T04:49:23.803 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00020279 s, 2.5 MB/s 2024-09-10T04:49:23.804 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T04:49:23.861 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 04:49:13.965449544 +0000 2024-09-10T04:49:23.916 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 04:46:48.877379512 +0000 2024-09-10T04:49:23.917 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 04:46:48.877379512 +0000 2024-09-10T04:49:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-10 04:46:48.877379512 +0000 2024-09-10T04:49:23.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T04:49:23.979 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T04:49:23.979 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T04:49:23.979 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000210893 s, 2.4 MB/s 2024-09-10T04:49:23.980 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T04:49:24.038 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-10T04:49:24.093 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 04:49:13.965449544 +0000 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 04:46:49.184375053 +0000 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 04:46:49.184375053 +0000 2024-09-10T04:49:24.094 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-10 04:46:49.184375053 +0000 2024-09-10T04:49:24.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T04:49:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T04:49:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T04:49:24.157 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000193227 s, 2.6 MB/s 2024-09-10T04:49:24.159 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T04:49:24.215 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-10T04:49:24.270 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T04:49:24.270 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:24.270 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T04:49:24.270 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:24.271 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:24.271 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 04:49:13.966449530 +0000 2024-09-10T04:49:24.271 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 04:46:49.515370245 +0000 2024-09-10T04:49:24.271 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 04:46:49.515370245 +0000 2024-09-10T04:49:24.271 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-10 04:46:49.515370245 +0000 2024-09-10T04:49:24.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T04:49:24.334 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T04:49:24.334 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T04:49:24.334 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000169145 s, 3.0 MB/s 2024-09-10T04:49:24.335 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T04:49:24.392 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T04:49:24.392 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:24.392 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T04:49:24.409 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T04:49:24.410 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-10T04:49:24.465 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-10 04:49:18.935473200 +0000 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-10 04:46:48.535553034 +0000 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-10 04:46:48.535553034 +0000 2024-09-10T04:49:24.466 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-10 04:46:48.535553034 +0000 2024-09-10T04:49:24.467 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T04:49:24.531 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-10T04:49:24.531 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-10T04:49:24.531 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000193346 s, 2.6 MB/s 2024-09-10T04:49:24.532 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T04:49:24.590 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-10 04:49:18.935473200 +0000 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-10 04:46:48.866545656 +0000 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-10 04:46:48.866545656 +0000 2024-09-10T04:49:24.646 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-10 04:46:48.866545656 +0000 2024-09-10T04:49:24.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T04:49:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-10T04:49:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-10T04:49:24.710 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000192228 s, 2.7 MB/s 2024-09-10T04:49:24.711 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T04:49:24.767 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-10 04:49:18.935473200 +0000 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-10 04:46:49.185538547 +0000 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-10 04:46:49.185538547 +0000 2024-09-10T04:49:24.824 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-10 04:46:49.185538547 +0000 2024-09-10T04:49:24.825 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T04:49:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-10T04:49:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-10T04:49:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000310212 s, 1.7 MB/s 2024-09-10T04:49:24.889 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T04:49:24.946 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-10T04:49:25.001 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-10 04:49:18.936473178 +0000 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-10 04:46:49.521531058 +0000 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-10 04:46:49.521531058 +0000 2024-09-10T04:49:25.002 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-10 04:46:49.521531058 +0000 2024-09-10T04:49:25.002 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T04:49:25.065 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-10T04:49:25.065 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-10T04:49:25.065 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000203929 s, 2.5 MB/s 2024-09-10T04:49:25.067 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T04:49:25.123 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T04:49:25.123 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T04:49:25.123 INFO:tasks.ceph:Generating config... 2024-09-10T04:49:25.124 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T04:49:25.124 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-10T04:49:25.124 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-10T04:49:25.125 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-10T04:49:25.125 INFO:tasks.ceph:[client] setuser = ceph 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T04:49:25.125 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T04:49:25.126 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T04:49:25.126 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T04:49:25.126 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T04:49:25.126 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T04:49:25.126 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T04:49:25.126 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T04:49:25.126 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T04:49:25.126 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T04:49:25.126 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T04:49:25.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T04:49:25.181 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T04:49:25.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T04:49:25.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T04:49:25.254 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.98')] 2024-09-10T04:49:25.254 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.98'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-10T04:49:25.255 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:25.255 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T04:49:25.310 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.98 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:25.390 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:49:25.390 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: generated fsid 06b8cc4b-d741-4e82-9b7a-3e23bf79f786 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = quincy 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 0 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:fsid 06b8cc4b-d741-4e82-9b7a-3e23bf79f786 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:last_changed 2024-09-10T04:49:25.390810+0000 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-10T04:49:25.390810+0000 2024-09-10T04:49:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:min_mon_release 17 (quincy) 2024-09-10T04:49:25.392 INFO:teuthology.orchestra.run.smithi098.stdout:election_strategy: 1 2024-09-10T04:49:25.392 INFO:teuthology.orchestra.run.smithi098.stdout:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-10T04:49:25.392 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-10T04:49:25.393 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T04:49:25.448 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 06b8cc4b-d741-4e82-9b7a-3e23bf79f786... 2024-09-10T04:49:25.449 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T04:49:25.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T04:49:25.530 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-10T04:49:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-10T04:49:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-10T04:49:25.532 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.533 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = 172.21.15.98 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 06b8cc4b-d741-4e82-9b7a-3e23bf79f786 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.534 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-10T04:49:25.535 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: debug objclass = 20 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2024-09-10T04:49:25.536 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-10T04:49:25.537 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-10T04:49:25.538 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T04:49:25.539 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T04:49:25.540 INFO:teuthology.orchestra.run.smithi098.stdout: rgw gc obj min wait = 15 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi098.stdout: debug rgw = 20 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi098.stdout: setgroup = ceph 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi098.stdout: setuser = ceph 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T04:49:25.541 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-09-10T04:49:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-09-10T04:49:25.543 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-09-10T04:49:25.544 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = 172.21.15.98 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 06b8cc4b-d741-4e82-9b7a-3e23bf79f786 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-09-10T04:49:25.545 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug trim objects = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-09-10T04:49:25.546 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: debug objclass = 20 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bdev async discard = True 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bdev enable discard = True 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore allocator = bitmap 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-09-10T04:49:25.547 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 1/20 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 1/20 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 4/10 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-10T04:49:25.548 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-09-10T04:49:25.549 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-09-10T04:49:25.550 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: rgw gc obj min wait = 15 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: debug rgw = 20 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: setgroup = ceph 2024-09-10T04:49:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: setuser = ceph 2024-09-10T04:49:25.552 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-09-10T04:49:25.553 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T04:49:25.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T04:49:25.649 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T04:49:25.649 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:25.649 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T04:49:25.664 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:25.664 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T04:49:25.719 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T04:49:25.720 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:25.720 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T04:49:25.720 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T04:49:25.794 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:25.794 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:25.849 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:49:25.849 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:25.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T04:49:25.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T04:49:25.884 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:25.884 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:25.939 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T04:49:25.940 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T04:49:25.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T04:49:26.056 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T04:49:26.058 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T04:49:26.059 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T04:49:26.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T04:49:26.099 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T04:49:26.112 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T04:49:26.112 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T04:49:26.112 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T04:49:26.137 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T04:49:26.137 INFO:tasks.ceph:role: osd.0 2024-09-10T04:49:26.137 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T04:49:26.137 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T04:49:26.209 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T04:49:26.210 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T04:49:26.717 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-10T04:49:26.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-10T04:49:26.719 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T04:49:26.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T04:49:26.863 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:26.964+0000 7fd46be0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T04:49:26.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:26.969+0000 7fd46be0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T04:49:26.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:26.970+0000 7fd46be0d640 -1 bdev(0x55ff2f865800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T04:49:26.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:26.970+0000 7fd46be0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T04:49:29.892 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T04:49:29.923 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T04:49:29.953 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T04:49:29.953 INFO:tasks.ceph:role: osd.1 2024-09-10T04:49:29.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:49:29.953 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T04:49:30.029 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T04:49:30.030 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T04:49:30.540 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-10T04:49:30.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-10T04:49:30.542 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-10T04:49:30.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T04:49:30.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T04:49:30.742 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T04:49:30.742 INFO:tasks.ceph:role: osd.2 2024-09-10T04:49:30.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:49:30.743 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T04:49:30.816 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T04:49:31.276 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-10T04:49:31.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-10T04:49:31.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-10T04:49:31.364 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T04:49:31.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T04:49:31.458 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T04:49:31.458 INFO:tasks.ceph:role: osd.3 2024-09-10T04:49:31.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:49:31.458 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T04:49:31.530 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T04:49:31.530 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T04:49:31.530 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T04:49:31.530 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T04:49:31.530 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T04:49:31.531 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-10T04:49:31.531 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T04:49:31.531 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T04:49:31.531 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T04:49:31.531 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T04:49:32.014 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-10T04:49:32.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-10T04:49:32.017 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-10T04:49:32.154 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T04:49:32.184 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:32.276+0000 7eff7fdb2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T04:49:32.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:32.282+0000 7eff7fdb2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T04:49:32.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:32.282+0000 7eff7fdb2640 -1 bdev(0x55a1fc0e3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T04:49:32.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:32.282+0000 7eff7fdb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T04:49:35.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T04:49:35.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:35.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:35.304+0000 7f993bd58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T04:49:35.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:35.304+0000 7f993bd58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T04:49:35.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:35.304+0000 7f993bd58640 -1 bdev(0x555f954cb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T04:49:35.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:35.305+0000 7f993bd58640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T04:49:38.222 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T04:49:38.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:38.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:38.332+0000 7f13192e0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T04:49:38.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:38.332+0000 7f13192e0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T04:49:38.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:38.332+0000 7f13192e0640 -1 bdev(0x561a6dc99800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T04:49:38.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:38.332+0000 7f13192e0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T04:49:41.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T04:49:41.765 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T04:49:41.765 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:41.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T04:49:41.795 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:41.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T04:49:41.830 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:41.831 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T04:49:41.895 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:41.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T04:49:41.960 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:41.960 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T04:49:42.025 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:42.025 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T04:49:42.081 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T04:49:42.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T04:49:42.108 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWz99mcD6CORAANglh93m1egcGBg817XGrXw== 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWz99mGihWAxAAbIwVudmFMthDVzdRBBwSBw== 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDcz99m9lCJEBAA2YI/SkcESKp4V0d7rnitAQ== 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDfz99m4z01EhAAx8bS0Dg0V50pGqzZQVE6zA== 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDiz99mIfbcExAAKGcnmr1SNm6oiiE6I9ZNBQ== 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-10T04:49:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWz99my6fsBRAArvwtaxcRmXtvMtrdpQ2V9Q== 2024-09-10T04:49:42.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T04:49:42.210 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T04:49:42.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T04:49:42.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T04:49:42.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T04:49:42.416 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T04:49:42.470 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T04:49:42.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T04:49:42.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T04:49:42.592 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T04:49:42.616 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T04:49:42.671 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T04:49:42.671 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T04:49:42.672 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T04:49:42.714 INFO:tasks.ceph.mon.a:Started 2024-09-10T04:49:42.714 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T04:49:42.714 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T04:49:42.714 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T04:49:42.717 INFO:tasks.ceph.mgr.x:Started 2024-09-10T04:49:42.717 DEBUG:tasks.ceph:set 0 configs 2024-09-10T04:49:42.717 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T04:49:42.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788d257640 1 Processor -- start 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788d257640 1 -- start start 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788d257640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788d257640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788809bd30 con 0x7f788812f420 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788d257640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f788809ae70 con 0x7f788809a680 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:42.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56174/0 (socket says 172.21.15.98:56174) 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f7886d9d640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f788812f420 0x7f788812f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48232/0 (socket says 172.21.15.98:48232) 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 -- 172.21.15.98:0/949655531 learned_addr learned my addr 172.21.15.98:0/949655531 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 -- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 msgr2=0x7f7888134700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 -- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 msgr2=0x7f7888134700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.813+0000 7f788659c640 1 --2- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T04:49:42.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.814+0000 7f788659c640 1 --2- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545241021 0 0) 0x7f788809bd30 con 0x7f788812f420 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7870003520 con 0x7f788812f420 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3835662783 0 0) 0x7f7870003520 con 0x7f788812f420 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 msgr2=0x7f7888134700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 --2- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788812ff10 con 0x7f788812f420 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1408266579 0 0) 0x7f7878001620 con 0x7f788812f420 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 >> v1:172.21.15.98:6789/0 conn(0x7f788812f420 legacy=0x7f788812f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 --2- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7870003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f788809ae70 con 0x7f7870003a50 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7886d9d640 1 --2- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7870003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:42.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.817+0000 7f7886d9d640 1 -- 172.21.15.98:0/949655531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7870003520 con 0x7f7870003a50 2024-09-10T04:49:42.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.819+0000 7f7886d9d640 1 --2- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7870003e50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7878007f40 tx=0x7f7870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362a33fac0cd326a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:42.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.819+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878007be0 con 0x7f7870003a50 2024-09-10T04:49:42.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.819+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78780071c0 con 0x7f7870003a50 2024-09-10T04:49:42.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.819+0000 7f7885d9b640 1 -- 172.21.15.98:0/949655531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78780074e0 con 0x7f7870003a50 2024-09-10T04:49:42.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 -- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 msgr2=0x7f7870003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 --2- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7870003e50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7878007f40 tx=0x7f7870005830 comp rx=0 tx=0).stop 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 -- 172.21.15.98:0/949655531 shutdown_connections 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 --2- 172.21.15.98:0/949655531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7870003e50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 --2- 172.21.15.98:0/949655531 >> v2:172.21.15.98:3300/0 conn(0x7f788809a680 0x7f7888134700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 -- 172.21.15.98:0/949655531 >> 172.21.15.98:0/949655531 conn(0x7f78880a0000 msgr2=0x7f78880a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 -- 172.21.15.98:0/949655531 shutdown_connections 2024-09-10T04:49:42.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.820+0000 7f788d257640 1 -- 172.21.15.98:0/949655531 wait complete. 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.821+0000 7f788d257640 1 Processor -- start 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.821+0000 7f788d257640 1 -- start start 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.821+0000 7f788d257640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.821+0000 7f788d257640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7888134fd0 con 0x7f7870003a50 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f7886d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f7886d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56186/0 (socket says 172.21.15.98:56186) 2024-09-10T04:49:42.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f7886d9d640 1 -- 172.21.15.98:0/351955010 learned_addr learned my addr 172.21.15.98:0/351955010 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f7886d9d640 1 -- 172.21.15.98:0/351955010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7888073380 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f7886d9d640 1 --2- 172.21.15.98:0/351955010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f787800c1d0 tx=0x7f7878001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878040030 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878007370 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878037040 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7888073810 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7888096260 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7878043070 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.822+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7878041070 con 0x7f7870003a50 2024-09-10T04:49:42.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.823+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78880767d0 con 0x7f7870003a50 2024-09-10T04:49:42.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.825+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f78780047e0 con 0x7f7870003a50 2024-09-10T04:49:42.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.887+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7888073bb0 con 0x7f7870003a50 2024-09-10T04:49:42.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.888+0000 7f786f7fe640 1 -- 172.21.15.98:0/351955010 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f78780049c0 con 0x7f7870003a50 2024-09-10T04:49:42.889 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 msgr2=0x7f7888070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 --2- 172.21.15.98:0/351955010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f787800c1d0 tx=0x7f7878001960 comp rx=0 tx=0).stop 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 shutdown_connections 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 --2- 172.21.15.98:0/351955010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7870003a50 0x7f7888070610 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 >> 172.21.15.98:0/351955010 conn(0x7f78880a0000 msgr2=0x7f7888096530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 shutdown_connections 2024-09-10T04:49:42.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:42.889+0000 7f788d257640 1 -- 172.21.15.98:0/351955010 wait complete. 2024-09-10T04:49:42.900 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T04:49:42.900 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T04:49:42.900 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T04:49:42.900 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T04:49:42.925 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:42.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T04:49:42.950 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:42.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T04:49:43.014 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-10T04:49:43.014 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T04:49:43.079 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 46e6df2a-9d9f-4a74-8518-8066cd04e855 0 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb73f009640 1 Processor -- start 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb73f009640 1 -- start start 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb73f009640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb73811b900 0x7fb73811dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb73f009640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73811e230 con 0x7fb738113070 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb73f009640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fb73811f430 con 0x7fb73811b900 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb737fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb73811b900 0x7fb73811dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb737fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb73811b900 0x7fb73811dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:44046/0 (socket says 172.21.15.145:44046) 2024-09-10T04:49:43.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.216+0000 7fb737fff640 1 -- 172.21.15.145:0/2967819093 learned_addr learned my addr 172.21.15.145:0/2967819093 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:49:43.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.217+0000 7fb737fff640 1 -- 172.21.15.145:0/2967819093 >> v1:172.21.15.98:6789/0 conn(0x7fb738113070 legacy=0x7fb738113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.217+0000 7fb737fff640 1 -- 172.21.15.145:0/2967819093 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73811f5e0 con 0x7fb73811b900 2024-09-10T04:49:43.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.217+0000 7fb7377fe640 1 -- 172.21.15.145:0/2967819093 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057011629 0 0) 0x7fb73811e230 con 0x7fb738113070 2024-09-10T04:49:43.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.217+0000 7fb737fff640 1 --2- 172.21.15.145:0/2967819093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb73811b900 0x7fb73811dcf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097f0 tx=0x7fb72402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6012426b1d459eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb7377fe640 1 -- 172.21.15.145:0/2967819093 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb724037070 con 0x7fb73811b900 2024-09-10T04:49:43.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb7377fe640 1 -- 172.21.15.145:0/2967819093 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb724032440 con 0x7fb73811b900 2024-09-10T04:49:43.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb7377fe640 1 -- 172.21.15.145:0/2967819093 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb72402ae60 con 0x7fb73811b900 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 -- 172.21.15.145:0/2967819093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb73811b900 msgr2=0x7fb73811dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 --2- 172.21.15.145:0/2967819093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb73811b900 0x7fb73811dcf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097f0 tx=0x7fb72402a1e0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 -- 172.21.15.145:0/2967819093 shutdown_connections 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 --2- 172.21.15.145:0/2967819093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb73811b900 0x7fb73811dcf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 -- 172.21.15.145:0/2967819093 >> 172.21.15.145:0/2967819093 conn(0x7fb73806f330 msgr2=0x7fb73806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 -- 172.21.15.145:0/2967819093 shutdown_connections 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.218+0000 7fb73f009640 1 -- 172.21.15.145:0/2967819093 wait complete. 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.219+0000 7fb73f009640 1 Processor -- start 2024-09-10T04:49:43.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.219+0000 7fb73f009640 1 -- start start 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.219+0000 7fb73f009640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.219+0000 7fb73f009640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb73811e8e0 con 0x7fb738113070 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73cda5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73cda5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:44060/0 (socket says 172.21.15.145:44060) 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73cda5640 1 -- 172.21.15.145:0/868360296 learned_addr learned my addr 172.21.15.145:0/868360296 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73cda5640 1 -- 172.21.15.145:0/868360296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7381a7bd0 con 0x7fb738113070 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73cda5640 1 --2- 172.21.15.145:0/868360296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c390 tx=0x7fb72c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb72c017070 con 0x7fb738113070 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c005430 con 0x7fb738113070 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7381a7ec0 con 0x7fb738113070 2024-09-10T04:49:43.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb72c003760 con 0x7fb738113070 2024-09-10T04:49:43.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7381ad010 con 0x7fb738113070 2024-09-10T04:49:43.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb72c01a070 con 0x7fb738113070 2024-09-10T04:49:43.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.220+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb72c012400 con 0x7fb738113070 2024-09-10T04:49:43.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.221+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7381a8200 con 0x7fb738113070 2024-09-10T04:49:43.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.223+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb72c021020 con 0x7fb738113070 2024-09-10T04:49:43.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.294+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46e6df2a-9d9f-4a74-8518-8066cd04e855", "id": 0} v 0) -- 0x7fb73811ef60 con 0x7fb738113070 2024-09-10T04:49:43.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.295+0000 7fb7357fa640 1 -- 172.21.15.145:0/868360296 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46e6df2a-9d9f-4a74-8518-8066cd04e855", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb72c01c510 con 0x7fb738113070 2024-09-10T04:49:43.297 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-09-10T04:49:43.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 msgr2=0x7fb7381a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 --2- 172.21.15.145:0/868360296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c390 tx=0x7fb72c00c850 comp rx=0 tx=0).stop 2024-09-10T04:49:43.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 shutdown_connections 2024-09-10T04:49:43.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 --2- 172.21.15.145:0/868360296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb738113070 0x7fb7381a7600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 >> 172.21.15.145:0/868360296 conn(0x7fb73806f330 msgr2=0x7fb73810fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 shutdown_connections 2024-09-10T04:49:43.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.296+0000 7fb73f009640 1 -- 172.21.15.145:0/868360296 wait complete. 2024-09-10T04:49:43.309 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10 1 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f713512b640 1 Processor -- start 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f713512b640 1 -- start start 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f713512b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7130119730 0x7f713011bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f713512b640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f713011c0f0 con 0x7f7130111060 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f713512b640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f713011d2d0 con 0x7f7130119730 2024-09-10T04:49:43.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.404+0000 7f7127fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7130119730 0x7f713011bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f712ed9d640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7130111060 0x7f7130111440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60982/0 (socket says 172.21.15.145:60982) 2024-09-10T04:49:43.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f712ed9d640 1 -- 172.21.15.145:0/4087784889 learned_addr learned my addr 172.21.15.145:0/4087784889 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:49:43.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f7127fff640 1 -- 172.21.15.145:0/4087784889 >> v1:172.21.15.98:6789/0 conn(0x7f7130111060 legacy=0x7f7130111440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f7127fff640 1 -- 172.21.15.145:0/4087784889 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713011d450 con 0x7f7130119730 2024-09-10T04:49:43.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f712e59c640 1 -- 172.21.15.145:0/4087784889 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330057972 0 0) 0x7f713011c0f0 con 0x7f7130111060 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.405+0000 7f7127fff640 1 --2- 172.21.15.145:0/4087784889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130119730 0x7f713011bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7118009720 tx=0x7f711802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d824331303ffaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f712e59c640 1 -- 172.21.15.145:0/4087784889 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118037070 con 0x7f7130119730 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f712e59c640 1 -- 172.21.15.145:0/4087784889 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711802ad90 con 0x7f7130119730 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f712e59c640 1 -- 172.21.15.145:0/4087784889 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118032590 con 0x7f7130119730 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 -- 172.21.15.145:0/4087784889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130119730 msgr2=0x7f713011bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 --2- 172.21.15.145:0/4087784889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130119730 0x7f713011bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7118009720 tx=0x7f711802a110 comp rx=0 tx=0).stop 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 -- 172.21.15.145:0/4087784889 shutdown_connections 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 --2- 172.21.15.145:0/4087784889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130119730 0x7f713011bb20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 -- 172.21.15.145:0/4087784889 >> 172.21.15.145:0/4087784889 conn(0x7f7130071dd0 msgr2=0x7f71300741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 -- 172.21.15.145:0/4087784889 shutdown_connections 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.406+0000 7f713512b640 1 -- 172.21.15.145:0/4087784889 wait complete. 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f713512b640 1 Processor -- start 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f713512b640 1 -- start start 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f713512b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f713512b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f713011c7a0 con 0x7f7130111060 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f712ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f712ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:44080/0 (socket says 172.21.15.145:44080) 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.407+0000 7f712ed9d640 1 -- 172.21.15.145:0/4130609662 learned_addr learned my addr 172.21.15.145:0/4130609662 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f712ed9d640 1 -- 172.21.15.145:0/4130609662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71301a5980 con 0x7f7130111060 2024-09-10T04:49:43.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f712ed9d640 1 --2- 172.21.15.145:0/4130609662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f712000c3d0 tx=0x7f712000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71200074d0 con 0x7f7130111060 2024-09-10T04:49:43.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71200047e0 con 0x7f7130111060 2024-09-10T04:49:43.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71301a5c70 con 0x7f7130111060 2024-09-10T04:49:43.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120007670 con 0x7f7130111060 2024-09-10T04:49:43.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71301aae40 con 0x7f7130111060 2024-09-10T04:49:43.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7120011070 con 0x7f7130111060 2024-09-10T04:49:43.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.408+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7120013770 con 0x7f7130111060 2024-09-10T04:49:43.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.409+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71301a5fb0 con 0x7f7130111060 2024-09-10T04:49:43.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.411+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7120004c00 con 0x7f7130111060 2024-09-10T04:49:43.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.481+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10", "id": 1} v 0) -- 0x7f713011cdb0 con 0x7f7130111060 2024-09-10T04:49:43.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.482+0000 7f71277fe640 1 -- 172.21.15.145:0/4130609662 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f712001d3f0 con 0x7f7130111060 2024-09-10T04:49:43.485 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 msgr2=0x7f71301a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 --2- 172.21.15.145:0/4130609662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f712000c3d0 tx=0x7f712000c890 comp rx=0 tx=0).stop 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 shutdown_connections 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 --2- 172.21.15.145:0/4130609662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7130111060 0x7f71301a53b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 >> 172.21.15.145:0/4130609662 conn(0x7f7130071dd0 msgr2=0x7f713011adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 shutdown_connections 2024-09-10T04:49:43.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.483+0000 7f713512b640 1 -- 172.21.15.145:0/4130609662 wait complete. 2024-09-10T04:49:43.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new b65706a9-7494-42d7-870b-17a5d98aa4a5 2 2024-09-10T04:49:43.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67fabd1640 1 Processor -- start 2024-09-10T04:49:43.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67fabd1640 1 -- start start 2024-09-10T04:49:43.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67fabd1640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f67f4113070 0x7f67f4113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67fabd1640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f4113b70 con 0x7f67f4116670 2024-09-10T04:49:43.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67fabd1640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f67f41171f0 con 0x7f67f4113070 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67f896d640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f67f4113070 0x7f67f4113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67f3fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f67f4116670 0x7f67f4116ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60994/0 (socket says 172.21.15.145:60994) 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.592+0000 7f67f3fff640 1 -- 172.21.15.145:0/658425284 learned_addr learned my addr 172.21.15.145:0/658425284 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.593+0000 7f67f896d640 1 -- 172.21.15.145:0/658425284 >> v1:172.21.15.98:6789/0 conn(0x7f67f4116670 legacy=0x7f67f4116ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.593+0000 7f67f37fe640 1 -- 172.21.15.145:0/658425284 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680455370 0 0) 0x7f67f4113b70 con 0x7f67f4116670 2024-09-10T04:49:43.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.593+0000 7f67f896d640 1 -- 172.21.15.145:0/658425284 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f41173a0 con 0x7f67f4113070 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.593+0000 7f67f896d640 1 --2- 172.21.15.145:0/658425284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f4113450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009720 tx=0x7f67e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbfdf767ed2a815 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67f37fe640 1 -- 172.21.15.145:0/658425284 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e8037070 con 0x7f67f4113070 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67f37fe640 1 -- 172.21.15.145:0/658425284 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e802ad90 con 0x7f67f4113070 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67f37fe640 1 -- 172.21.15.145:0/658425284 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e8032590 con 0x7f67f4113070 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 -- 172.21.15.145:0/658425284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 msgr2=0x7f67f4113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 --2- 172.21.15.145:0/658425284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f4113450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009720 tx=0x7f67e802a110 comp rx=0 tx=0).stop 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 -- 172.21.15.145:0/658425284 shutdown_connections 2024-09-10T04:49:43.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 --2- 172.21.15.145:0/658425284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f4113450 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 -- 172.21.15.145:0/658425284 >> 172.21.15.145:0/658425284 conn(0x7f67f406f330 msgr2=0x7f67f406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 -- 172.21.15.145:0/658425284 shutdown_connections 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.594+0000 7f67fabd1640 1 -- 172.21.15.145:0/658425284 wait complete. 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67fabd1640 1 Processor -- start 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67fabd1640 1 -- start start 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67fabd1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67fabd1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67f411edd0 con 0x7f67f4113070 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67f896d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67f896d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:44086/0 (socket says 172.21.15.145:44086) 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.595+0000 7f67f896d640 1 -- 172.21.15.145:0/2271454358 learned_addr learned my addr 172.21.15.145:0/2271454358 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f896d640 1 -- 172.21.15.145:0/2271454358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f41a7b50 con 0x7f67f4113070 2024-09-10T04:49:43.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f896d640 1 --2- 172.21.15.145:0/2271454358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009720 tx=0x7f67e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e8041070 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e803c460 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f41a7de0 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e8037040 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41acdb0 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f67e8044070 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.596+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f67e8046b40 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.597+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f41134d0 con 0x7f67f4113070 2024-09-10T04:49:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.599+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f67e8046930 con 0x7f67f4113070 2024-09-10T04:49:43.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.669+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b65706a9-7494-42d7-870b-17a5d98aa4a5", "id": 2} v 0) -- 0x7f67f4116670 con 0x7f67f4113070 2024-09-10T04:49:43.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.670+0000 7f67f17fa640 1 -- 172.21.15.145:0/2271454358 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b65706a9-7494-42d7-870b-17a5d98aa4a5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f67e8046de0 con 0x7f67f4113070 2024-09-10T04:49:43.673 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 msgr2=0x7f67f41a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 --2- 172.21.15.145:0/2271454358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009720 tx=0x7f67e80046c0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 shutdown_connections 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 --2- 172.21.15.145:0/2271454358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f4113070 0x7f67f41a7580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 >> 172.21.15.145:0/2271454358 conn(0x7f67f406f330 msgr2=0x7f67f4111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 shutdown_connections 2024-09-10T04:49:43.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.671+0000 7f67fabd1640 1 -- 172.21.15.145:0/2271454358 wait complete. 2024-09-10T04:49:43.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new ecc01501-9f53-4007-a5eb-8c6275af1106 3 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.779+0000 7fd536fd5640 1 Processor -- start 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.779+0000 7fd536fd5640 1 -- start start 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd536fd5640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd53011b900 0x7fd53011dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd536fd5640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd53011e230 con 0x7fd530113070 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd536fd5640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fd53011f430 con 0x7fd53011b900 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd52ffff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd53011b900 0x7fd53011dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd534d71640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd530113070 0x7fd530113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:32774/0 (socket says 172.21.15.145:32774) 2024-09-10T04:49:43.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd534d71640 1 -- 172.21.15.145:0/702101872 learned_addr learned my addr 172.21.15.145:0/702101872 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:49:43.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd52f7fe640 1 -- 172.21.15.145:0/702101872 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494841989 0 0) 0x7fd53011e230 con 0x7fd530113070 2024-09-10T04:49:43.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd52f7fe640 1 -- 172.21.15.145:0/702101872 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd520003520 con 0x7fd530113070 2024-09-10T04:49:43.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd52ffff640 1 -- 172.21.15.145:0/702101872 >> v1:172.21.15.98:6789/0 conn(0x7fd530113070 legacy=0x7fd530113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.780+0000 7fd52ffff640 1 -- 172.21.15.145:0/702101872 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53011f5e0 con 0x7fd53011b900 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.781+0000 7fd52ffff640 1 --2- 172.21.15.145:0/702101872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd53011b900 0x7fd53011dcf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009720 tx=0x7fd51c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77633470c684be5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.781+0000 7fd52f7fe640 1 -- 172.21.15.145:0/702101872 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c037070 con 0x7fd53011b900 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.781+0000 7fd52f7fe640 1 -- 172.21.15.145:0/702101872 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c02ad90 con 0x7fd53011b900 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.781+0000 7fd52f7fe640 1 -- 172.21.15.145:0/702101872 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c032590 con 0x7fd53011b900 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- 172.21.15.145:0/702101872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd53011b900 msgr2=0x7fd53011dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 --2- 172.21.15.145:0/702101872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd53011b900 0x7fd53011dcf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009720 tx=0x7fd51c02a110 comp rx=0 tx=0).stop 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- 172.21.15.145:0/702101872 shutdown_connections 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 --2- 172.21.15.145:0/702101872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd53011b900 0x7fd53011dcf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- 172.21.15.145:0/702101872 >> 172.21.15.145:0/702101872 conn(0x7fd53006f330 msgr2=0x7fd53006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- 172.21.15.145:0/702101872 shutdown_connections 2024-09-10T04:49:43.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- 172.21.15.145:0/702101872 wait complete. 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 Processor -- start 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.782+0000 7fd536fd5640 1 -- start start 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd536fd5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd536fd5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd53011e8e0 con 0x7fd530113070 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd534d71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd534d71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:44102/0 (socket says 172.21.15.145:44102) 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd534d71640 1 -- 172.21.15.145:0/967850815 learned_addr learned my addr 172.21.15.145:0/967850815 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd534d71640 1 -- 172.21.15.145:0/967850815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5301a7b30 con 0x7fd530113070 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.783+0000 7fd534d71640 1 --2- 172.21.15.145:0/967850815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c480 tx=0x7fd52400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524017070 con 0x7fd530113070 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd524005cd0 con 0x7fd530113070 2024-09-10T04:49:43.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5301a7e20 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524007200 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5301acff0 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd52401a070 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.784+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd524012400 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.785+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5301a8160 con 0x7fd530113070 2024-09-10T04:49:43.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.787+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd52401c440 con 0x7fd530113070 2024-09-10T04:49:43.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.856+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ecc01501-9f53-4007-a5eb-8c6275af1106", "id": 3} v 0) -- 0x7fd53011ef40 con 0x7fd530113070 2024-09-10T04:49:43.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.857+0000 7fd52d7fa640 1 -- 172.21.15.145:0/967850815 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecc01501-9f53-4007-a5eb-8c6275af1106", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd52401cb50 con 0x7fd530113070 2024-09-10T04:49:43.860 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-09-10T04:49:43.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 msgr2=0x7fd5301a7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 --2- 172.21.15.145:0/967850815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c480 tx=0x7fd52400c940 comp rx=0 tx=0).stop 2024-09-10T04:49:43.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 shutdown_connections 2024-09-10T04:49:43.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 --2- 172.21.15.145:0/967850815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd530113070 0x7fd5301a7560 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 >> 172.21.15.145:0/967850815 conn(0x7fd53006f330 msgr2=0x7fd53010fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 shutdown_connections 2024-09-10T04:49:43.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:49:43.859+0000 7fd536fd5640 1 -- 172.21.15.145:0/967850815 wait complete. 2024-09-10T04:49:43.875 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T04:49:43.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T04:49:43.878 INFO:tasks.ceph.osd.0:Started 2024-09-10T04:49:43.878 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T04:49:43.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T04:49:43.880 INFO:tasks.ceph.osd.1:Started 2024-09-10T04:49:43.881 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T04:49:43.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T04:49:43.882 INFO:tasks.ceph.osd.2:Started 2024-09-10T04:49:43.883 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T04:49:43.883 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T04:49:43.885 INFO:tasks.ceph.osd.3:Started 2024-09-10T04:49:43.885 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T04:49:43.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.983+0000 7fbe05c49640 1 Processor -- start 2024-09-10T04:49:43.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.983+0000 7fbe05c49640 1 -- start start 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbe05c49640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbe00114c80 0x7fbe001347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbe05c49640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe001155b0 con 0x7fbe00114190 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbe05c49640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fbe00116380 con 0x7fbe00114c80 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdff7fe640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fbe00114190 0x7fbe00114570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48250/0 (socket says 172.21.15.98:48250) 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdff7fe640 1 -- 172.21.15.98:0/4291014330 learned_addr learned my addr 172.21.15.98:0/4291014330 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:43.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdfeffd640 1 --2- 172.21.15.98:0/4291014330 >> v2:172.21.15.98:3300/0 conn(0x7fbe00114c80 0x7fbe001347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdfe7fc640 1 -- 172.21.15.98:0/4291014330 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752576314 0 0) 0x7fbe001155b0 con 0x7fbe00114190 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdfe7fc640 1 -- 172.21.15.98:0/4291014330 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde8003520 con 0x7fbe00114190 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdfeffd640 1 -- 172.21.15.98:0/4291014330 >> v1:172.21.15.98:6789/0 conn(0x7fbe00114190 legacy=0x7fbe00114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.984+0000 7fbdfeffd640 1 -- 172.21.15.98:0/4291014330 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe000735e0 con 0x7fbe00114c80 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.985+0000 7fbdfeffd640 1 --2- 172.21.15.98:0/4291014330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114c80 0x7fbe001347d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009750 tx=0x7fbdf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b0a6d0a86e9d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.985+0000 7fbdfe7fc640 1 -- 172.21.15.98:0/4291014330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4037070 con 0x7fbe00114c80 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.985+0000 7fbdfe7fc640 1 -- 172.21.15.98:0/4291014330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf402ae20 con 0x7fbe00114c80 2024-09-10T04:49:43.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.985+0000 7fbdfe7fc640 1 -- 172.21.15.98:0/4291014330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4032590 con 0x7fbe00114c80 2024-09-10T04:49:43.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 -- 172.21.15.98:0/4291014330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114c80 msgr2=0x7fbe001347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 --2- 172.21.15.98:0/4291014330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114c80 0x7fbe001347d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009750 tx=0x7fbdf402a1e0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 -- 172.21.15.98:0/4291014330 shutdown_connections 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 --2- 172.21.15.98:0/4291014330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114c80 0x7fbe001347d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 -- 172.21.15.98:0/4291014330 >> 172.21.15.98:0/4291014330 conn(0x7fbe0006f300 msgr2=0x7fbe00071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 -- 172.21.15.98:0/4291014330 shutdown_connections 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.986+0000 7fbe05c49640 1 -- 172.21.15.98:0/4291014330 wait complete. 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbe05c49640 1 Processor -- start 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbe05c49640 1 -- start start 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbe05c49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbe05c49640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbe00115d10 con 0x7fbe00114190 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:43.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56220/0 (socket says 172.21.15.98:56220) 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbdff7fe640 1 -- 172.21.15.98:0/2209921315 learned_addr learned my addr 172.21.15.98:0/2209921315 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbdff7fe640 1 -- 172.21.15.98:0/2209921315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe00134120 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.987+0000 7fbdff7fe640 1 --2- 172.21.15.98:0/2209921315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000cb40 tx=0x7fbdf00021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf000aab0 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf000ac50 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001187e0 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf0012400 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe00125620 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbdf00125a0 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.988+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fbdf001bb30 con 0x7fbe00114190 2024-09-10T04:49:43.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.989+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00114570 con 0x7fbe00114190 2024-09-10T04:49:43.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:43.990+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbdf001b4b0 con 0x7fbe00114190 2024-09-10T04:49:44.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.048+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe00050d60 con 0x7fbe00114190 2024-09-10T04:49:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbde7fff640 1 -- 172.21.15.98:0/2209921315 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fbdf001b690 con 0x7fbe00114190 2024-09-10T04:49:44.050 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:49:44.050 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":6,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:49:43.858937+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 msgr2=0x7fbe00124f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbe05c49640 1 --2- 172.21.15.98:0/2209921315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000cb40 tx=0x7fbdf00021c0 comp rx=0 tx=0).stop 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 shutdown_connections 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbe05c49640 1 --2- 172.21.15.98:0/2209921315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe00114190 0x7fbe00124f00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.049+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 >> 172.21.15.98:0/2209921315 conn(0x7fbe0006f300 msgr2=0x7fbe00129ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.050+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 shutdown_connections 2024-09-10T04:49:44.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:44.050+0000 7fbe05c49640 1 -- 172.21.15.98:0/2209921315 wait complete. 2024-09-10T04:49:44.061 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T04:49:44.061 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T04:49:44.464 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T04:49:44.555 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.553+0000 7fd4d2f45640 1 Processor -- start 2024-09-10T04:49:44.555 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.553+0000 7fd4d2f45640 1 -- start start 2024-09-10T04:49:44.555 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4d2f45640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd4cc1325a0 0x7fd4cc134990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:44.555 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4d2f45640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4cc116650 con 0x7fd4cc12c140 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4d2f45640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fd4cc116f90 con 0x7fd4cc1325a0 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4cbfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd4cc1325a0 0x7fd4cc134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4d0ce1640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd4cc12c140 0x7fd4cc12c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:48254/0 (socket says 172.21.15.98:48254) 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4d0ce1640 1 -- 172.21.15.98:0/3909298198 learned_addr learned my addr 172.21.15.98:0/3909298198 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4cbfff640 1 -- 172.21.15.98:0/3909298198 >> v1:172.21.15.98:6789/0 conn(0x7fd4cc12c140 legacy=0x7fd4cc12c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4cbfff640 1 -- 172.21.15.98:0/3909298198 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc12cc30 con 0x7fd4cc1325a0 2024-09-10T04:49:44.556 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.554+0000 7fd4cb7fe640 1 -- 172.21.15.98:0/3909298198 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149483493 0 0) 0x7fd4cc116650 con 0x7fd4cc12c140 2024-09-10T04:49:44.557 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.555+0000 7fd4cbfff640 1 --2- 172.21.15.98:0/3909298198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc1325a0 0x7fd4cc134990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009d90 tx=0x7fd4b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e84d7a94cd6337 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:44.557 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.555+0000 7fd4cb7fe640 1 -- 172.21.15.98:0/3909298198 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b4007670 con 0x7fd4cc1325a0 2024-09-10T04:49:44.557 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.555+0000 7fd4cb7fe640 1 -- 172.21.15.98:0/3909298198 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b4007810 con 0x7fd4cc1325a0 2024-09-10T04:49:44.557 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.555+0000 7fd4cb7fe640 1 -- 172.21.15.98:0/3909298198 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b4007b10 con 0x7fd4cc1325a0 2024-09-10T04:49:44.557 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 -- 172.21.15.98:0/3909298198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc1325a0 msgr2=0x7fd4cc134990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 --2- 172.21.15.98:0/3909298198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc1325a0 0x7fd4cc134990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009d90 tx=0x7fd4b402a660 comp rx=0 tx=0).stop 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 -- 172.21.15.98:0/3909298198 shutdown_connections 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 --2- 172.21.15.98:0/3909298198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc1325a0 0x7fd4cc134990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 -- 172.21.15.98:0/3909298198 >> 172.21.15.98:0/3909298198 conn(0x7fd4cc0705c0 msgr2=0x7fd4cc0729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 -- 172.21.15.98:0/3909298198 shutdown_connections 2024-09-10T04:49:44.558 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 -- 172.21.15.98:0/3909298198 wait complete. 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.556+0000 7fd4d2f45640 1 Processor -- start 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d2f45640 1 -- start start 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d2f45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d2f45640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc116ae0 con 0x7fd4cc12c140 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d0ce1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d0ce1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56232/0 (socket says 172.21.15.98:56232) 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d0ce1640 1 -- 172.21.15.98:0/835347375 learned_addr learned my addr 172.21.15.98:0/835347375 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.557+0000 7fd4d0ce1640 1 -- 172.21.15.98:0/835347375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc117df0 con 0x7fd4cc12c140 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4d0ce1640 1 --2- 172.21.15.98:0/835347375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400c320 tx=0x7fd4c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4c4007410 con 0x7fd4cc12c140 2024-09-10T04:49:44.560 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c40075d0 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4c4004950 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc129210 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc117860 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4c4011070 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.558+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd4c40138d0 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.559+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4cc12c520 con 0x7fd4cc12c140 2024-09-10T04:49:44.561 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.561+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd4c4004b40 con 0x7fd4cc12c140 2024-09-10T04:49:44.619 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.618+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4cc117120 con 0x7fd4cc12c140 2024-09-10T04:49:44.620 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.619+0000 7fd4c97fa640 1 -- 172.21.15.98:0/835347375 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fd4c4004d20 con 0x7fd4cc12c140 2024-09-10T04:49:44.620 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-10T04:49:44.620 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":6,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:49:43.858937+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:49:44.621 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 msgr2=0x7fd4cc1276e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:44.621 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 --2- 172.21.15.98:0/835347375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400c320 tx=0x7fd4c400c7e0 comp rx=0 tx=0).stop 2024-09-10T04:49:44.621 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 shutdown_connections 2024-09-10T04:49:44.622 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 --2- 172.21.15.98:0/835347375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4cc12c140 0x7fd4cc1276e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:44.622 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 >> 172.21.15.98:0/835347375 conn(0x7fd4cc0705c0 msgr2=0x7fd4cc129d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:44.622 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 shutdown_connections 2024-09-10T04:49:44.622 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:44.620+0000 7fd4d2f45640 1 -- 172.21.15.98:0/835347375 wait complete. 2024-09-10T04:49:44.629 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T04:49:45.081 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-10T04:49:45.079+0000 7f03c7c42640 -1 Falling back to public interface 2024-09-10T04:49:45.294 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-10T04:49:45.293+0000 7f81826ef640 -1 Falling back to public interface 2024-09-10T04:49:45.319 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-10T04:49:45.317+0000 7f54defc3640 -1 Falling back to public interface 2024-09-10T04:49:45.596 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-10T04:49:45.593+0000 7f6246c0c640 -1 Falling back to public interface 2024-09-10T04:49:48.195 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-10T04:49:48.194+0000 7f595d529640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T04:49:48.934 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-10T04:49:48.933+0000 7f03c7c42640 -1 osd.3 0 log_to_monitors true 2024-09-10T04:49:49.144 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-10T04:49:49.142+0000 7f6246c0c640 -1 osd.2 0 log_to_monitors true 2024-09-10T04:49:49.291 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-10T04:49:49.289+0000 7f81826ef640 -1 osd.0 0 log_to_monitors true 2024-09-10T04:49:49.671 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-10T04:49:49.669+0000 7f54defc3640 -1 osd.1 0 log_to_monitors true 2024-09-10T04:49:51.033 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T04:49:51.136 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.133+0000 7f4bce4db640 1 Processor -- start 2024-09-10T04:49:51.136 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bce4db640 1 -- start start 2024-09-10T04:49:51.137 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bce4db640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4bc812c140 0x7f4bc812c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:51.137 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bce4db640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc8116650 con 0x7f4bc81151a0 2024-09-10T04:49:51.137 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bce4db640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc8116f90 con 0x7f4bc812c140 2024-09-10T04:49:51.137 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bc7fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4bc812c140 0x7f4bc812c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bbffff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4bc81151a0 0x7f4bc81155d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:51266/0 (socket says 172.21.15.98:51266) 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bbffff640 1 -- 172.21.15.98:0/725573037 learned_addr learned my addr 172.21.15.98:0/725573037 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bc7fff640 1 -- 172.21.15.98:0/725573037 >> v1:172.21.15.98:6789/0 conn(0x7f4bc81151a0 legacy=0x7f4bc81155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bc77fe640 1 -- 172.21.15.98:0/725573037 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255224487 0 0) 0x7f4bc8116650 con 0x7f4bc81151a0 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.134+0000 7f4bc7fff640 1 -- 172.21.15.98:0/725573037 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc812be20 con 0x7f4bc812c140 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.135+0000 7f4bc7fff640 1 --2- 172.21.15.98:0/725573037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc812c140 0x7f4bc812c520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009720 tx=0x7f4bb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1b578e91b79800 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.135+0000 7f4bc77fe640 1 -- 172.21.15.98:0/725573037 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8037070 con 0x7f4bc812c140 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.135+0000 7f4bc77fe640 1 -- 172.21.15.98:0/725573037 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb802ad90 con 0x7f4bc812c140 2024-09-10T04:49:51.138 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.135+0000 7f4bc77fe640 1 -- 172.21.15.98:0/725573037 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8032590 con 0x7f4bc812c140 2024-09-10T04:49:51.141 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 -- 172.21.15.98:0/725573037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc812c140 msgr2=0x7f4bc812c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:51.141 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 --2- 172.21.15.98:0/725573037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc812c140 0x7f4bc812c520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009720 tx=0x7f4bb802a110 comp rx=0 tx=0).stop 2024-09-10T04:49:51.141 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 -- 172.21.15.98:0/725573037 shutdown_connections 2024-09-10T04:49:51.141 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 --2- 172.21.15.98:0/725573037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc812c140 0x7f4bc812c520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:51.141 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 -- 172.21.15.98:0/725573037 >> 172.21.15.98:0/725573037 conn(0x7f4bc80705c0 msgr2=0x7f4bc80729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 -- 172.21.15.98:0/725573037 shutdown_connections 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.136+0000 7f4bce4db640 1 -- 172.21.15.98:0/725573037 wait complete. 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bce4db640 1 Processor -- start 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bce4db640 1 -- start start 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bce4db640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bce4db640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8116c60 con 0x7f4bc81151a0 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bc7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bc7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49268/0 (socket says 172.21.15.98:49268) 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.137+0000 7f4bc7fff640 1 -- 172.21.15.98:0/2157160906 learned_addr learned my addr 172.21.15.98:0/2157160906 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bc7fff640 1 -- 172.21.15.98:0/2157160906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc811c580 con 0x7f4bc81151a0 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bc7fff640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009720 tx=0x7f4bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8041070 con 0x7f4bc81151a0 2024-09-10T04:49:51.142 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb803c460 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc811a260 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8037040 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.138+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc811a7d0 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.139+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7f4bb8044070 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.139+0000 7f4bc57fa640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 0x7f4ba80402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.139+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc811c810 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.139+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1481+0+0 (secure 0 0 0) 0x7f4bb8072340 con 0x7f4bc81151a0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.139+0000 7f4bbffff640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 0x7f4ba80402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:51.143 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.140+0000 7f4bbffff640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 0x7f4ba80402c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb00078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:51.146 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.144+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4bb8042de0 con 0x7f4bc81151a0 2024-09-10T04:49:51.339 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.337+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bc811b450 con 0x7f4bc81151a0 2024-09-10T04:49:51.339 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.337+0000 7f4bc57fa640 1 -- 172.21.15.98:0/2157160906 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4153 (secure 0 0 0) 0x7f4bb803d3f0 con 0x7f4bc81151a0 2024-09-10T04:49:51.340 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-10T04:49:51.340 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":9,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:49:51.198261+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:49:51.342 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 msgr2=0x7f4ba80402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:51.342 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 0x7f4ba80402c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb00078d0 comp rx=0 tx=0).stop 2024-09-10T04:49:51.342 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 msgr2=0x7f4bc8119d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:51.342 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009720 tx=0x7f4bb80046c0 comp rx=0 tx=0).stop 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 shutdown_connections 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ba803de00 0x7f4ba80402c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 --2- 172.21.15.98:0/2157160906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81151a0 0x7f4bc8119d20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.339+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 >> 172.21.15.98:0/2157160906 conn(0x7f4bc80705c0 msgr2=0x7f4bc812aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.340+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 shutdown_connections 2024-09-10T04:49:51.343 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:51.340+0000 7f4bce4db640 1 -- 172.21.15.98:0/2157160906 wait complete. 2024-09-10T04:49:51.352 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T04:49:51.489 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-10T04:49:51.487+0000 7f03c3bd1640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T04:49:51.520 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-10T04:49:51.519+0000 7f03bb9f0640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T04:49:51.562 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-10T04:49:51.561+0000 7f6242cdd640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T04:49:51.576 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-10T04:49:51.575+0000 7f623a2e8640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T04:49:52.073 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-10T04:49:52.070+0000 7f817ee92640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T04:49:52.091 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-10T04:49:52.089+0000 7f817649d640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T04:49:52.111 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-10T04:49:52.110+0000 7f54db766640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T04:49:52.125 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-10T04:49:52.124+0000 7f54d2d71640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T04:49:57.755 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T04:49:57.855 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.853+0000 7f4f54268640 1 Processor -- start 2024-09-10T04:49:57.855 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.853+0000 7f4f54268640 1 -- start start 2024-09-10T04:49:57.856 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f54268640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4f4c112210 0x7f4f4c1314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:57.856 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f54268640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c112ab0 con 0x7f4f4c111720 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f54268640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c10fff0 con 0x7f4f4c112210 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f52004640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4f4c111720 0x7f4f4c111b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37554/0 (socket says 172.21.15.98:37554) 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f52004640 1 -- 172.21.15.98:0/2345482149 learned_addr learned my addr 172.21.15.98:0/2345482149 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f51803640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4f4c112210 0x7f4f4c1314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f51803640 1 -- 172.21.15.98:0/2345482149 >> v1:172.21.15.98:6789/0 conn(0x7f4f4c111720 legacy=0x7f4f4c111b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:57.857 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.854+0000 7f4f51803640 1 -- 172.21.15.98:0/2345482149 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c06ddc0 con 0x7f4f4c112210 2024-09-10T04:49:57.860 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.855+0000 7f4f51803640 1 --2- 172.21.15.98:0/2345482149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c112210 0x7f4f4c1314b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009720 tx=0x7f4f3c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e157a2b87b9d2c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:57.860 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.855+0000 7f4f51002640 1 -- 172.21.15.98:0/2345482149 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f3c037070 con 0x7f4f4c112210 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.855+0000 7f4f51002640 1 -- 172.21.15.98:0/2345482149 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c02ad90 con 0x7f4f4c112210 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.855+0000 7f4f51002640 1 -- 172.21.15.98:0/2345482149 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f3c032590 con 0x7f4f4c112210 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 -- 172.21.15.98:0/2345482149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c112210 msgr2=0x7f4f4c1314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 --2- 172.21.15.98:0/2345482149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c112210 0x7f4f4c1314b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009720 tx=0x7f4f3c02a110 comp rx=0 tx=0).stop 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 -- 172.21.15.98:0/2345482149 shutdown_connections 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 --2- 172.21.15.98:0/2345482149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c112210 0x7f4f4c1314b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 -- 172.21.15.98:0/2345482149 >> 172.21.15.98:0/2345482149 conn(0x7f4f4c06fcf0 msgr2=0x7f4f4c0720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:57.861 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 -- 172.21.15.98:0/2345482149 shutdown_connections 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.856+0000 7f4f54268640 1 -- 172.21.15.98:0/2345482149 wait complete. 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f54268640 1 Processor -- start 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f54268640 1 -- start start 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f54268640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f54268640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c113950 con 0x7f4f4c111720 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f52004640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f52004640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37836/0 (socket says 172.21.15.98:37836) 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.857+0000 7f4f52004640 1 -- 172.21.15.98:0/2561770182 learned_addr learned my addr 172.21.15.98:0/2561770182 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:57.862 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f52004640 1 -- 172.21.15.98:0/2561770182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1108f0 con 0x7f4f4c111720 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f52004640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c480 tx=0x7f4f4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48017070 con 0x7f4f4c111720 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f48005c10 con 0x7f4f4c111720 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c130ce0 con 0x7f4f4c111720 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48007070 con 0x7f4f4c111720 2024-09-10T04:49:57.863 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.858+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c12fe20 con 0x7f4f4c111720 2024-09-10T04:49:57.864 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.859+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4f4801a070 con 0x7f4f4c111720 2024-09-10T04:49:57.864 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.859+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c111b00 con 0x7f4f4c111720 2024-09-10T04:49:57.864 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.859+0000 7f4f42ffd640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 0x7f4f30040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:57.864 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.859+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f4f48051320 con 0x7f4f4c111720 2024-09-10T04:49:57.865 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.859+0000 7f4f51803640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 0x7f4f30040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:57.865 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.860+0000 7f4f51803640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 0x7f4f30040350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c034000 tx=0x7f4f3c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:57.866 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:57.864+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4f48019cd0 con 0x7f4f4c111720 2024-09-10T04:49:58.040 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.038+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f4c1308f0 con 0x7f4f4c111720 2024-09-10T04:49:58.041 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.039+0000 7f4f42ffd640 1 -- 172.21.15.98:0/2561770182 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7991 (secure 0 0 0) 0x7f4f4801b3b0 con 0x7f4f4c111720 2024-09-10T04:49:58.041 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-10T04:49:58.041 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":13,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:49:55.507365+0000","last_up_change":"2024-09-10T04:49:52.498880+0000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T04:49:53.208406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6801","nonce":733739603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6803","nonce":733739603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6807","nonce":733739603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6805","nonce":733739603}]},"public_addr":"172.21.15.98:6801/733739603","cluster_addr":"172.21.15.98:6803/733739603","heartbeat_back_addr":"172.21.15.98:6807/733739603","heartbeat_front_addr":"172.21.15.98:6805/733739603","state":["exists","up"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6809","nonce":819540050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6811","nonce":819540050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6815","nonce":819540050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6813","nonce":819540050}]},"public_addr":"172.21.15.145:6809/819540050","cluster_addr":"172.21.15.145:6811/819540050","heartbeat_back_addr":"172.21.15.145:6815/819540050","heartbeat_front_addr":"172.21.15.145:6813/819540050","state":["exists","up"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6817","nonce":1789112018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6819","nonce":1789112018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6823","nonce":1789112018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6821","nonce":1789112018}]},"public_addr":"172.21.15.145:6817/1789112018","cluster_addr":"172.21.15.145:6819/1789112018","heartbeat_back_addr":"172.21.15.145:6823/1789112018","heartbeat_front_addr":"172.21.15.145:6821/1789112018","state":["exists","up"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6801","nonce":4228232102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6803","nonce":4228232102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6807","nonce":4228232102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6805","nonce":4228232102}]},"public_addr":"172.21.15.145:6801/4228232102","cluster_addr":"172.21.15.145:6803/4228232102","heartbeat_back_addr":"172.21.15.145:6807/4228232102","heartbeat_front_addr":"172.21.15.145:6805/4228232102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.283734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.670591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.114321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:49.936242+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:49:58.043 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 msgr2=0x7f4f30040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 0x7f4f30040350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c034000 tx=0x7f4f3c02e000 comp rx=0 tx=0).stop 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 msgr2=0x7f4f4c1218b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c480 tx=0x7f4f4800c940 comp rx=0 tx=0).stop 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 shutdown_connections 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4f3003de90 0x7f4f30040350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 --2- 172.21.15.98:0/2561770182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4c111720 0x7f4f4c1218b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 >> 172.21.15.98:0/2561770182 conn(0x7f4f4c06fcf0 msgr2=0x7f4f4c1273c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 shutdown_connections 2024-09-10T04:49:58.044 INFO:teuthology.misc.health.smithi098.stderr:2024-09-10T04:49:58.041+0000 7f4f54268640 1 -- 172.21.15.98:0/2561770182 wait complete. 2024-09-10T04:49:58.053 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-10T04:49:58.053 INFO:tasks.ceph:Creating RBD pool 2024-09-10T04:49:58.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T04:49:58.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.148+0000 7ff940fbb640 1 Processor -- start 2024-09-10T04:49:58.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.148+0000 7ff940fbb640 1 -- start start 2024-09-10T04:49:58.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff940fbb640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff93c12bf10 0x7ff93c12c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff940fbb640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c09a160 con 0x7ff93c12c830 2024-09-10T04:49:58.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff940fbb640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7ff93c06def0 con 0x7ff93c12bf10 2024-09-10T04:49:58.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff93a59c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff93c12bf10 0x7ff93c12c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff939d9b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff93c12c830 0x7ff93c094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37556/0 (socket says 172.21.15.98:37556) 2024-09-10T04:49:58.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff939d9b640 1 -- 172.21.15.98:0/834291489 learned_addr learned my addr 172.21.15.98:0/834291489 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:58.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff93a59c640 1 -- 172.21.15.98:0/834291489 >> v1:172.21.15.98:6789/0 conn(0x7ff93c12c830 legacy=0x7ff93c094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.149+0000 7ff93a59c640 1 -- 172.21.15.98:0/834291489 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c099b10 con 0x7ff93c12bf10 2024-09-10T04:49:58.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff93a59c640 1 --2- 172.21.15.98:0/834291489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c12c2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff93402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b2a483a5d49875 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:58.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff93959a640 1 -- 172.21.15.98:0/834291489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff934007670 con 0x7ff93c12bf10 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff93959a640 1 -- 172.21.15.98:0/834291489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934007810 con 0x7ff93c12bf10 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff93959a640 1 -- 172.21.15.98:0/834291489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff934007b10 con 0x7ff93c12bf10 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 -- 172.21.15.98:0/834291489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 msgr2=0x7ff93c12c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 --2- 172.21.15.98:0/834291489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c12c2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff93402a660 comp rx=0 tx=0).stop 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 -- 172.21.15.98:0/834291489 shutdown_connections 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 --2- 172.21.15.98:0/834291489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c12c2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 -- 172.21.15.98:0/834291489 >> 172.21.15.98:0/834291489 conn(0x7ff93c09a930 msgr2=0x7ff93c09ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 -- 172.21.15.98:0/834291489 shutdown_connections 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.150+0000 7ff940fbb640 1 -- 172.21.15.98:0/834291489 wait complete. 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.151+0000 7ff940fbb640 1 Processor -- start 2024-09-10T04:49:58.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff940fbb640 1 -- start start 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff940fbb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff940fbb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c097b20 con 0x7ff93c12bf10 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff93a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff93a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37862/0 (socket says 172.21.15.98:37862) 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff93a59c640 1 -- 172.21.15.98:0/1802186264 learned_addr learned my addr 172.21.15.98:0/1802186264 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff93a59c640 1 -- 172.21.15.98:0/1802186264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c08edc0 con 0x7ff93c12bf10 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff93a59c640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:58.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff934040070 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934031b10 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c08feb0 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.152+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff934031df0 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.153+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c08dcd0 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.153+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff934039040 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.154+0000 7ff932ffd640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 0x7ff91c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.154+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c08e8b0 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.154+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7ff93402ae00 con 0x7ff93c12bf10 2024-09-10T04:49:58.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.154+0000 7ff939d9b640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 0x7ff91c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.154+0000 7ff939d9b640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 0x7ff91c040350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff924007fd0 tx=0x7ff924007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.158+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff93403cc70 con 0x7ff93c12bf10 2024-09-10T04:49:58.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.331+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7ff93c0990e0 con 0x7ff93c12bf10 2024-09-10T04:49:58.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.515+0000 7ff932ffd640 1 -- 172.21.15.98:0/1802186264 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7ff93403b3b0 con 0x7ff93c12bf10 2024-09-10T04:49:58.518 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'rbd' created 2024-09-10T04:49:58.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 msgr2=0x7ff91c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 0x7ff91c040350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff924007fd0 tx=0x7ff924007aa0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 msgr2=0x7ff93c08d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff934009d90 tx=0x7ff934004a40 comp rx=0 tx=0).stop 2024-09-10T04:49:58.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 shutdown_connections 2024-09-10T04:49:58.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff91c03de90 0x7ff91c040350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 --2- 172.21.15.98:0/1802186264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff93c12bf10 0x7ff93c08d790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 >> 172.21.15.98:0/1802186264 conn(0x7ff93c09a930 msgr2=0x7ff93c09c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:58.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 shutdown_connections 2024-09-10T04:49:58.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.518+0000 7ff940fbb640 1 -- 172.21.15.98:0/1802186264 wait complete. 2024-09-10T04:49:58.531 DEBUG:teuthology.orchestra.run.smithi098:> rbd --cluster ceph pool init rbd 2024-09-10T04:49:58.594 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:49:58.594 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:49:58.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.593+0000 7f2a19176f00 1 Processor -- start 2024-09-10T04:49:58.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.593+0000 7f2a19176f00 1 -- start start 2024-09-10T04:49:58.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.593+0000 7f2a19176f00 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f85ea10a90 0x55f85ea10e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.593+0000 7f2a19176f00 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55f85e883f30 con 0x55f85ea11e30 2024-09-10T04:49:58.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.593+0000 7f2a19176f00 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f85e8eaa10 con 0x55f85ea10a90 2024-09-10T04:49:58.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a17c62640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f85ea10a90 0x55f85ea10e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a17461640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f85ea11e30 0x55f85eaa6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37558/0 (socket says 172.21.15.98:37558) 2024-09-10T04:49:58.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a17461640 1 -- 172.21.15.98:0/1251975459 learned_addr learned my addr 172.21.15.98:0/1251975459 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:49:58.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a16c60640 1 -- 172.21.15.98:0/1251975459 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226017644 0 0) 0x55f85e883f30 con 0x55f85ea11e30 2024-09-10T04:49:58.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a16c60640 1 -- 172.21.15.98:0/1251975459 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a00001e10 con 0x55f85ea11e30 2024-09-10T04:49:58.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a17c62640 1 -- 172.21.15.98:0/1251975459 >> v1:172.21.15.98:6789/0 conn(0x55f85ea11e30 legacy=0x55f85eaa6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.594+0000 7f2a17c62640 1 -- 172.21.15.98:0/1251975459 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85e8690c0 con 0x55f85ea10a90 2024-09-10T04:49:58.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a17c62640 1 --2- 172.21.15.98:0/1251975459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea10e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800a470 tx=0x7f2a08045d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e1d3f9a4c3ad7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:58.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a16c60640 1 -- 172.21.15.98:0/1251975459 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0805a070 con 0x55f85ea10a90 2024-09-10T04:49:58.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a16c60640 1 -- 172.21.15.98:0/1251975459 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08055570 con 0x55f85ea10a90 2024-09-10T04:49:58.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a16c60640 1 -- 172.21.15.98:0/1251975459 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08055890 con 0x55f85ea10a90 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 -- 172.21.15.98:0/1251975459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 msgr2=0x55f85ea10e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1251975459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea10e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800a470 tx=0x7f2a08045d50 comp rx=0 tx=0).stop 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 -- 172.21.15.98:0/1251975459 shutdown_connections 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1251975459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea10e70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 -- 172.21.15.98:0/1251975459 >> 172.21.15.98:0/1251975459 conn(0x55f85ea19d50 msgr2=0x55f85ea16110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 -- 172.21.15.98:0/1251975459 shutdown_connections 2024-09-10T04:49:58.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.596+0000 7f2a19176f00 1 -- 172.21.15.98:0/1251975459 wait complete. 2024-09-10T04:49:58.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a19176f00 1 Processor -- start 2024-09-10T04:49:58.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a19176f00 1 -- start start 2024-09-10T04:49:58.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a19176f00 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a19176f00 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f85e8ee9c0 con 0x55f85ea10a90 2024-09-10T04:49:58.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a17c62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a17c62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37888/0 (socket says 172.21.15.98:37888) 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.597+0000 7f2a17c62640 1 -- 172.21.15.98:0/1168956278 learned_addr learned my addr 172.21.15.98:0/1168956278 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a17c62640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85ea9a170 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a17c62640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800a470 tx=0x7f2a08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08064020 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08055ad0 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f85ea9a5c0 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0805a040 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.598+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85ea9b170 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.599+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2a08067020 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.599+0000 7f2a07fff640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 0x7f29fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.599+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f2a08095250 con 0x55f85ea10a90 2024-09-10T04:49:58.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.599+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55f85eaa5210 con 0x55f85ea10a90 2024-09-10T04:49:58.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.599+0000 7f2a17461640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 0x7f29fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:58.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:58.600+0000 7f2a17461640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 0x7f29fc03ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c001db0 tx=0x7f2a0c001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:59.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.521+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f2a0806e030 con 0x55f85ea10a90 2024-09-10T04:49:59.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.521+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a08055570 con 0x55f85ea10a90 2024-09-10T04:49:59.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2a0804e650 con 0x55f85ea10a90 2024-09-10T04:49:59.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a1645f640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f29f4002ae0 con 0x55f85ea10a90 2024-09-10T04:49:59.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f2a0805ed40 con 0x55f85ea10a90 2024-09-10T04:49:59.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 0x55f85eaba6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:49:59.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x55f85eabac20 con 0x55f85ea11e30 2024-09-10T04:49:59.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.523+0000 7f2a18ec4640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 0x55f85eaba6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:49:59.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.524+0000 7f2a18ec4640 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 0x55f85eaba6e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:49:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.538+0000 7f2a18ec4640 1 -- 172.21.15.98:0/1168956278 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f2a10002040 con 0x55f85ea11e30 2024-09-10T04:49:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.540+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55f85eb0d220 con 0x55f85ea11e30 2024-09-10T04:49:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.541+0000 7f2a18ec4640 1 -- 172.21.15.98:0/1168956278 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a10002040 con 0x55f85ea11e30 2024-09-10T04:49:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.541+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55f85eb0c330 con 0x55f85ea11e30 2024-09-10T04:49:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.541+0000 7f2a18ec4640 1 -- 172.21.15.98:0/1168956278 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a10002040 con 0x55f85ea11e30 2024-09-10T04:49:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:49:59.541+0000 7f2a15c5e640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f29f8001f00 con 0x55f85ea10a90 2024-09-10T04:50:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.523+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f2a08019080 con 0x55f85ea10a90 2024-09-10T04:50:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.523+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f29fc042280 con 0x55f85ea10a90 2024-09-10T04:50:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.524+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f2a08068cb0 con 0x55f85ea10a90 2024-09-10T04:50:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.524+0000 7f2a1645f640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f29f4005780 con 0x55f85ea11e30 2024-09-10T04:50:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.529+0000 7f2a18ec4640 1 -- 172.21.15.98:0/1168956278 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2a10002040 con 0x55f85ea11e30 2024-09-10T04:50:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:00.529+0000 7f2a15c5e640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f29f8003350 con 0x55f85ea10a90 2024-09-10T04:50:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.528+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f2a0801b300 con 0x55f85ea10a90 2024-09-10T04:50:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.528+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f29fc042500 con 0x55f85ea10a90 2024-09-10T04:50:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.528+0000 7f2a07fff640 1 -- 172.21.15.98:0/1168956278 <== mon.0 v2:172.21.15.98:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f2a0804d8f0 con 0x55f85ea10a90 2024-09-10T04:50:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.529+0000 7f2a1645f640 1 -- 172.21.15.98:0/1168956278 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f29f4005b40 con 0x55f85ea11e30 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.530+0000 7f2a18ec4640 1 -- 172.21.15.98:0/1168956278 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a10002040 con 0x55f85ea11e30 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.530+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 msgr2=0x55f85eaba6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.530+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 0x55f85eaba6e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 msgr2=0x7f29fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 0x7f29fc03ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c001db0 tx=0x7f2a0c001310 comp rx=0 tx=0).stop 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 msgr2=0x55f85ea97af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800a470 tx=0x7f2a08002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 shutdown_connections 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f85ea11e30 0x55f85eaba6e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f29fc03c780 0x7f29fc03ec40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 --2- 172.21.15.98:0/1168956278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85ea10a90 0x55f85ea97af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 >> 172.21.15.98:0/1168956278 conn(0x55f85ea19d50 msgr2=0x55f85ea14190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 shutdown_connections 2024-09-10T04:50:01.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.531+0000 7f2a19176f00 1 -- 172.21.15.98:0/1168956278 wait complete. 2024-09-10T04:50:01.537 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T04:50:01.538 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T04:50:01.538 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T04:50:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.645+0000 7fa70fdcd640 1 Processor -- start 2024-09-10T04:50:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.645+0000 7fa70fdcd640 1 -- start start 2024-09-10T04:50:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70fdcd640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa70806fe70 0x7fa708070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70fdcd640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa708071680 con 0x7fa708070790 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70fdcd640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fa7080a30e0 con 0x7fa70806fe70 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70db69640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa70806fe70 0x7fa708070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70d368640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa708070790 0x7fa70812ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37560/0 (socket says 172.21.15.98:37560) 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70d368640 1 -- 172.21.15.98:0/2278207840 learned_addr learned my addr 172.21.15.98:0/2278207840 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70db69640 1 -- 172.21.15.98:0/2278207840 >> v1:172.21.15.98:6789/0 conn(0x7fa708070790 legacy=0x7fa70812ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.646+0000 7fa70db69640 1 -- 172.21.15.98:0/2278207840 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa708071dd0 con 0x7fa70806fe70 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.647+0000 7fa70db69640 1 --2- 172.21.15.98:0/2278207840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa708070250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa704009720 tx=0x7fa70402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22af71374da685c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.647+0000 7fa70cb67640 1 -- 172.21.15.98:0/2278207840 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa704037070 con 0x7fa70806fe70 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.647+0000 7fa70cb67640 1 -- 172.21.15.98:0/2278207840 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa70402ad90 con 0x7fa70806fe70 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.647+0000 7fa70cb67640 1 -- 172.21.15.98:0/2278207840 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa704032590 con 0x7fa70806fe70 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 -- 172.21.15.98:0/2278207840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 msgr2=0x7fa708070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/2278207840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa708070250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa704009720 tx=0x7fa70402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 -- 172.21.15.98:0/2278207840 shutdown_connections 2024-09-10T04:50:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/2278207840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa708070250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 -- 172.21.15.98:0/2278207840 >> 172.21.15.98:0/2278207840 conn(0x7fa7080a0a50 msgr2=0x7fa70806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 -- 172.21.15.98:0/2278207840 shutdown_connections 2024-09-10T04:50:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.648+0000 7fa70fdcd640 1 -- 172.21.15.98:0/2278207840 wait complete. 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70fdcd640 1 Processor -- start 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70fdcd640 1 -- start start 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70fdcd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70fdcd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa708075cc0 con 0x7fa70806fe70 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70db69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70db69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37906/0 (socket says 172.21.15.98:37906) 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70db69640 1 -- 172.21.15.98:0/3562229059 learned_addr learned my addr 172.21.15.98:0/3562229059 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:01.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.649+0000 7fa70db69640 1 -- 172.21.15.98:0/3562229059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa708121300 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa70db69640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa704009840 tx=0x7fa7040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa704041070 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa70403c460 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa708122560 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa704037040 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.650+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa708122890 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.651+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa704044070 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.651+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa708070250 con 0x7fa70806fe70 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.651+0000 7fa6fe7fc640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 0x7fa6ec040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.651+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa704072c90 con 0x7fa70806fe70 2024-09-10T04:50:01.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.651+0000 7fa70d368640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 0x7fa6ec040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.652+0000 7fa70d368640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 0x7fa6ec040380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8007fd0 tx=0x7fa6f8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.656+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa70404ed60 con 0x7fa70806fe70 2024-09-10T04:50:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.830+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa708120bb0 con 0x7fa70806fe70 2024-09-10T04:50:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.830+0000 7fa6fe7fc640 1 -- 172.21.15.98:0/3562229059 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fa70403d3f0 con 0x7fa70806fe70 2024-09-10T04:50:01.833 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 msgr2=0x7fa6ec040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 0x7fa6ec040380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8007fd0 tx=0x7fa6f8007aa0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 msgr2=0x7fa70811f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa704009840 tx=0x7fa7040046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 shutdown_connections 2024-09-10T04:50:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6ec03dec0 0x7fa6ec040380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 --2- 172.21.15.98:0/3562229059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa70806fe70 0x7fa70811f210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 >> 172.21.15.98:0/3562229059 conn(0x7fa7080a0a50 msgr2=0x7fa70812c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:01.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 shutdown_connections 2024-09-10T04:50:01.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.832+0000 7fa70fdcd640 1 -- 172.21.15.98:0/3562229059 wait complete. 2024-09-10T04:50:01.845 INFO:teuthology.orchestra.run.smithi098.stdout:[{"version":5,"timestamp":"2024-09-10T04:49:52.111193+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"7785.365992"}]}] 2024-09-10T04:50:01.845 INFO:tasks.ceph_manager:config epoch is 5 2024-09-10T04:50:01.846 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T04:50:01.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T04:50:01.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T04:50:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.942+0000 7f9ccd8bf640 1 Processor -- start 2024-09-10T04:50:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.942+0000 7f9ccd8bf640 1 -- start start 2024-09-10T04:50:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9ccd8bf640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9cc8114380 0x7f9cc81324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9ccd8bf640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc806e140 con 0x7f9cc8113890 2024-09-10T04:50:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9ccd8bf640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc806df00 con 0x7f9cc8114380 2024-09-10T04:50:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc6ffd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9cc8113890 0x7f9cc8113c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37570/0 (socket says 172.21.15.98:37570) 2024-09-10T04:50:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc6ffd640 1 -- 172.21.15.98:0/3936482715 learned_addr learned my addr 172.21.15.98:0/3936482715 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc67fc640 1 --2- 172.21.15.98:0/3936482715 >> v2:172.21.15.98:3300/0 conn(0x7f9cc8114380 0x7f9cc81324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc5ffb640 1 -- 172.21.15.98:0/3936482715 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071259032 0 0) 0x7f9cb8001490 con 0x7f9cc8113890 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc5ffb640 1 -- 172.21.15.98:0/3936482715 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb4003520 con 0x7f9cc8113890 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc67fc640 1 -- 172.21.15.98:0/3936482715 >> v1:172.21.15.98:6789/0 conn(0x7f9cc8113890 legacy=0x7f9cc8113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.943+0000 7f9cc67fc640 1 -- 172.21.15.98:0/3936482715 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc8114c80 con 0x7f9cc8114380 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.944+0000 7f9cc67fc640 1 --2- 172.21.15.98:0/3936482715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8114380 0x7f9cc81324e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009720 tx=0x7f9cb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374c2ad9f5f2ad09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.944+0000 7f9cc5ffb640 1 -- 172.21.15.98:0/3936482715 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb0037070 con 0x7f9cc8114380 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.944+0000 7f9cc5ffb640 1 -- 172.21.15.98:0/3936482715 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb002ae20 con 0x7f9cc8114380 2024-09-10T04:50:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.944+0000 7f9cc5ffb640 1 -- 172.21.15.98:0/3936482715 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb0032590 con 0x7f9cc8114380 2024-09-10T04:50:01.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/3936482715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8114380 msgr2=0x7f9cc81324e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/3936482715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8114380 0x7f9cc81324e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009720 tx=0x7f9cb002a1a0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/3936482715 shutdown_connections 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/3936482715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8114380 0x7f9cc81324e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/3936482715 >> 172.21.15.98:0/3936482715 conn(0x7f9cc80716f0 msgr2=0x7f9cc810fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/3936482715 shutdown_connections 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.945+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/3936482715 wait complete. 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9ccd8bf640 1 Processor -- start 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9ccd8bf640 1 -- start start 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9ccd8bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9ccd8bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8132a20 con 0x7f9cc8113890 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9cc6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9cc6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37918/0 (socket says 172.21.15.98:37918) 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9cc6ffd640 1 -- 172.21.15.98:0/4066296594 learned_addr learned my addr 172.21.15.98:0/4066296594 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.946+0000 7f9cc6ffd640 1 -- 172.21.15.98:0/4066296594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc812fe70 con 0x7f9cc8113890 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9cc6ffd640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800cbc0 tx=0x7f9cb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb800ab70 con 0x7f9cc8113890 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb800ad10 con 0x7f9cc8113890 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc8122b80 con 0x7f9cc8113890 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb8012530 con 0x7f9cc8113890 2024-09-10T04:50:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.947+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc8130d30 con 0x7f9cc8113890 2024-09-10T04:50:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.948+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9cb80126d0 con 0x7f9cc8113890 2024-09-10T04:50:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.948+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc8113c70 con 0x7f9cc8113890 2024-09-10T04:50:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.948+0000 7f9cbffff640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 0x7f9ca8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.948+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9cb80527e0 con 0x7f9cc8113890 2024-09-10T04:50:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.948+0000 7f9cc67fc640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 0x7f9ca8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:01.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.949+0000 7f9cc67fc640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 0x7f9ca8040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0034000 tx=0x7f9cb002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:01.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:01.952+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f9cc806e140 con 0x7f9cc8113890 2024-09-10T04:50:02.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.171+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9cc8130100 con 0x7f9cc8113890 2024-09-10T04:50:02.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.172+0000 7f9cbffff640 1 -- 172.21.15.98:0/4066296594 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97042 (secure 0 0 0) 0x7f9cb8011de0 con 0x7f9cc8113890 2024-09-10T04:50:02.176 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 msgr2=0x7f9ca8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 0x7f9ca8040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0034000 tx=0x7f9cb002e000 comp rx=0 tx=0).stop 2024-09-10T04:50:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 msgr2=0x7f9cc8122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800cbc0 tx=0x7f9cb800a430 comp rx=0 tx=0).stop 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 shutdown_connections 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9ca803de90 0x7f9ca8040350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 --2- 172.21.15.98:0/4066296594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cc8113890 0x7f9cc8122640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 >> 172.21.15.98:0/4066296594 conn(0x7f9cc80716f0 msgr2=0x7f9cc8129980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 shutdown_connections 2024-09-10T04:50:02.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.175+0000 7f9ccd8bf640 1 -- 172.21.15.98:0/4066296594 wait complete. 2024-09-10T04:50:02.187 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":106719016},{"type":"v1","addr":"172.21.15.145:6825","nonce":106719016}]},"active_addr":"172.21.15.145:6825/106719016","active_change":"2024-09-10T04:49:47.187801+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":1016086693}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2538975562}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":4033056146}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":509825259}]}]} 2024-09-10T04:50:02.189 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T04:50:02.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T04:50:02.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T04:50:02.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f65985a4640 1 Processor -- start 2024-09-10T04:50:02.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f65985a4640 1 -- start start 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f65985a4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6590129d80 0x7f659012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f65985a4640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659006dc00 con 0x7f659012a6a0 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f65985a4640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f65901299c0 con 0x7f6590129d80 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f6596340640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6590129d80 0x7f659012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.285+0000 7f6595b3f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f659012a6a0 0x7f6590110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37580/0 (socket says 172.21.15.98:37580) 2024-09-10T04:50:02.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.286+0000 7f6595b3f640 1 -- 172.21.15.98:0/3281386911 learned_addr learned my addr 172.21.15.98:0/3281386911 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:02.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.286+0000 7f6596340640 1 -- 172.21.15.98:0/3281386911 >> v1:172.21.15.98:6789/0 conn(0x7f659012a6a0 legacy=0x7f6590110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.286+0000 7f6596340640 1 -- 172.21.15.98:0/3281386911 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590114d20 con 0x7f6590129d80 2024-09-10T04:50:02.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.286+0000 7f659533e640 1 -- 172.21.15.98:0/3281386911 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043154664 0 0) 0x7f659006dc00 con 0x7f659012a6a0 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.286+0000 7f6596340640 1 --2- 172.21.15.98:0/3281386911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659012a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f658c009720 tx=0x7f658c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1707703d79330f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f659533e640 1 -- 172.21.15.98:0/3281386911 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c037070 con 0x7f6590129d80 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f659533e640 1 -- 172.21.15.98:0/3281386911 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c02ad90 con 0x7f6590129d80 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f659533e640 1 -- 172.21.15.98:0/3281386911 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c032590 con 0x7f6590129d80 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 -- 172.21.15.98:0/3281386911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 msgr2=0x7f659012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 --2- 172.21.15.98:0/3281386911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659012a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f658c009720 tx=0x7f658c02a110 comp rx=0 tx=0).stop 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 -- 172.21.15.98:0/3281386911 shutdown_connections 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 --2- 172.21.15.98:0/3281386911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659012a160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 -- 172.21.15.98:0/3281386911 >> 172.21.15.98:0/3281386911 conn(0x7f6590070850 msgr2=0x7f6590072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 -- 172.21.15.98:0/3281386911 shutdown_connections 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.287+0000 7f65985a4640 1 -- 172.21.15.98:0/3281386911 wait complete. 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.288+0000 7f65985a4640 1 Processor -- start 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.288+0000 7f65985a4640 1 -- start start 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.288+0000 7f65985a4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.288+0000 7f65985a4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6590114940 con 0x7f6590129d80 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.288+0000 7f6596340640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6596340640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37936/0 (socket says 172.21.15.98:37936) 2024-09-10T04:50:02.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6596340640 1 -- 172.21.15.98:0/3958848679 learned_addr learned my addr 172.21.15.98:0/3958848679 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6596340640 1 -- 172.21.15.98:0/3958848679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659011ca80 con 0x7f6590129d80 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6596340640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f658c009720 tx=0x7f658c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c041070 con 0x7f6590129d80 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c03c460 con 0x7f6590129d80 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659011d730 con 0x7f6590129d80 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c037040 con 0x7f6590129d80 2024-09-10T04:50:02.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.289+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659011dd60 con 0x7f6590129d80 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.290+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f658c044070 con 0x7f6590129d80 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.290+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659011c4f0 con 0x7f6590129d80 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.290+0000 7f6586ffd640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 0x7f6574040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.290+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f658c072ad0 con 0x7f6590129d80 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.290+0000 7f6595b3f640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 0x7f6574040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.291+0000 7f6595b3f640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 0x7f6574040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6580000c00 tx=0x7f65800078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.294+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f658c03cc60 con 0x7f6590129d80 2024-09-10T04:50:02.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.470+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6590071150 con 0x7f6590129d80 2024-09-10T04:50:02.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.471+0000 7f6586ffd640 1 -- 172.21.15.98:0/3958848679 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9890 (secure 0 0 0) 0x7f6590071150 con 0x7f6590129d80 2024-09-10T04:50:02.473 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:02.473 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:50:01.526122+0000","last_up_change":"2024-09-10T04:49:52.498880+0000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T04:49:53.208406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T04:49:58.335613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6801","nonce":733739603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6803","nonce":733739603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6807","nonce":733739603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6805","nonce":733739603}]},"public_addr":"172.21.15.98:6801/733739603","cluster_addr":"172.21.15.98:6803/733739603","heartbeat_back_addr":"172.21.15.98:6807/733739603","heartbeat_front_addr":"172.21.15.98:6805/733739603","state":["exists","up"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6809","nonce":819540050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6811","nonce":819540050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6815","nonce":819540050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6813","nonce":819540050}]},"public_addr":"172.21.15.145:6809/819540050","cluster_addr":"172.21.15.145:6811/819540050","heartbeat_back_addr":"172.21.15.145:6815/819540050","heartbeat_front_addr":"172.21.15.145:6813/819540050","state":["exists","up"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6817","nonce":1789112018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6819","nonce":1789112018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6823","nonce":1789112018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6821","nonce":1789112018}]},"public_addr":"172.21.15.145:6817/1789112018","cluster_addr":"172.21.15.145:6819/1789112018","heartbeat_back_addr":"172.21.15.145:6823/1789112018","heartbeat_front_addr":"172.21.15.145:6821/1789112018","state":["exists","up"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6801","nonce":4228232102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6803","nonce":4228232102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6807","nonce":4228232102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6805","nonce":4228232102}]},"public_addr":"172.21.15.145:6801/4228232102","cluster_addr":"172.21.15.145:6803/4228232102","heartbeat_back_addr":"172.21.15.145:6807/4228232102","heartbeat_front_addr":"172.21.15.145:6805/4228232102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.283734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.670591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.114321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:49.936242+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.473+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 msgr2=0x7f6574040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.473+0000 7f65985a4640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 0x7f6574040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6580000c00 tx=0x7f65800078d0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 msgr2=0x7f659011b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f658c009720 tx=0x7f658c0046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 shutdown_connections 2024-09-10T04:50:02.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f657403de90 0x7f6574040350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 --2- 172.21.15.98:0/3958848679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6590129d80 0x7f659011b390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 >> 172.21.15.98:0/3958848679 conn(0x7f6590070850 msgr2=0x7f6590126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 shutdown_connections 2024-09-10T04:50:02.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.474+0000 7f65985a4640 1 -- 172.21.15.98:0/3958848679 wait complete. 2024-09-10T04:50:02.486 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T04:50:02.486 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T04:50:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335eaa9640 1 Processor -- start 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335eaa9640 1 -- start start 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335eaa9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3358129d80 0x7f335812a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335eaa9640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335806dc00 con 0x7f335812a6a0 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335eaa9640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f33581299c0 con 0x7f3358129d80 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f335c845640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3358129d80 0x7f335812a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f3357fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f335812a6a0 0x7f3358110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37584/0 (socket says 172.21.15.98:37584) 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.582+0000 7f3357fff640 1 -- 172.21.15.98:0/3025168491 learned_addr learned my addr 172.21.15.98:0/3025168491 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f335c845640 1 -- 172.21.15.98:0/3025168491 >> v1:172.21.15.98:6789/0 conn(0x7f335812a6a0 legacy=0x7f3358110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f335c845640 1 -- 172.21.15.98:0/3025168491 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3358114d20 con 0x7f3358129d80 2024-09-10T04:50:02.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f335c845640 1 --2- 172.21.15.98:0/3025168491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335812a160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f334c009720 tx=0x7f334c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d1de20fb57d3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f33577fe640 1 -- 172.21.15.98:0/3025168491 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c037070 con 0x7f3358129d80 2024-09-10T04:50:02.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f33577fe640 1 -- 172.21.15.98:0/3025168491 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c02ad90 con 0x7f3358129d80 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.583+0000 7f33577fe640 1 -- 172.21.15.98:0/3025168491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c032590 con 0x7f3358129d80 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 -- 172.21.15.98:0/3025168491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 msgr2=0x7f335812a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 --2- 172.21.15.98:0/3025168491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335812a160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f334c009720 tx=0x7f334c02a110 comp rx=0 tx=0).stop 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 -- 172.21.15.98:0/3025168491 shutdown_connections 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 --2- 172.21.15.98:0/3025168491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335812a160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 -- 172.21.15.98:0/3025168491 >> 172.21.15.98:0/3025168491 conn(0x7f3358070850 msgr2=0x7f3358072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 -- 172.21.15.98:0/3025168491 shutdown_connections 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.584+0000 7f335eaa9640 1 -- 172.21.15.98:0/3025168491 wait complete. 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335eaa9640 1 Processor -- start 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335eaa9640 1 -- start start 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335eaa9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335eaa9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3358114940 con 0x7f3358129d80 2024-09-10T04:50:02.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335c845640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335c845640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37960/0 (socket says 172.21.15.98:37960) 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.585+0000 7f335c845640 1 -- 172.21.15.98:0/4805307 learned_addr learned my addr 172.21.15.98:0/4805307 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f335c845640 1 -- 172.21.15.98:0/4805307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335811c890 con 0x7f3358129d80 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f335c845640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f334c009840 tx=0x7f334c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c041020 con 0x7f3358129d80 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c03d550 con 0x7f3358129d80 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335811dca0 con 0x7f3358129d80 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c037040 con 0x7f3358129d80 2024-09-10T04:50:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.586+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335811b5b0 con 0x7f3358129d80 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.587+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f334c044020 con 0x7f3358129d80 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.587+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33581119e0 con 0x7f3358129d80 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.587+0000 7f33557fa640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 0x7f333c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.587+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f334c072960 con 0x7f3358129d80 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.588+0000 7f3357fff640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 0x7f333c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.588+0000 7f3357fff640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 0x7f333c040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3344007fd0 tx=0x7f3344007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.592+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f334c04b030 con 0x7f3358129d80 2024-09-10T04:50:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.765+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3358068da0 con 0x7f3358129d80 2024-09-10T04:50:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.766+0000 7f33557fa640 1 -- 172.21.15.98:0/4805307 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9890 (secure 0 0 0) 0x7f334c03cc60 con 0x7f3358129d80 2024-09-10T04:50:02.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:02.768 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:50:01.526122+0000","last_up_change":"2024-09-10T04:49:52.498880+0000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T04:49:53.208406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T04:49:58.335613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6801","nonce":733739603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6803","nonce":733739603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6807","nonce":733739603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6805","nonce":733739603}]},"public_addr":"172.21.15.98:6801/733739603","cluster_addr":"172.21.15.98:6803/733739603","heartbeat_back_addr":"172.21.15.98:6807/733739603","heartbeat_front_addr":"172.21.15.98:6805/733739603","state":["exists","up"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6809","nonce":819540050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6811","nonce":819540050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6815","nonce":819540050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6813","nonce":819540050}]},"public_addr":"172.21.15.145:6809/819540050","cluster_addr":"172.21.15.145:6811/819540050","heartbeat_back_addr":"172.21.15.145:6815/819540050","heartbeat_front_addr":"172.21.15.145:6813/819540050","state":["exists","up"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6817","nonce":1789112018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6819","nonce":1789112018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6823","nonce":1789112018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6821","nonce":1789112018}]},"public_addr":"172.21.15.145:6817/1789112018","cluster_addr":"172.21.15.145:6819/1789112018","heartbeat_back_addr":"172.21.15.145:6823/1789112018","heartbeat_front_addr":"172.21.15.145:6821/1789112018","state":["exists","up"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6801","nonce":4228232102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6803","nonce":4228232102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6807","nonce":4228232102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6805","nonce":4228232102}]},"public_addr":"172.21.15.145:6801/4228232102","cluster_addr":"172.21.15.145:6803/4228232102","heartbeat_back_addr":"172.21.15.145:6807/4228232102","heartbeat_front_addr":"172.21.15.145:6805/4228232102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.283734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.670591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.114321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:49.936242+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 msgr2=0x7f333c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 0x7f333c040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3344007fd0 tx=0x7f3344007aa0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 msgr2=0x7f335811b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f334c009840 tx=0x7f334c0046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 shutdown_connections 2024-09-10T04:50:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f333c03de90 0x7f333c040350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 --2- 172.21.15.98:0/4805307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3358129d80 0x7f335811b070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 >> 172.21.15.98:0/4805307 conn(0x7f3358070850 msgr2=0x7f3358126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 shutdown_connections 2024-09-10T04:50:02.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.768+0000 7f335eaa9640 1 -- 172.21.15.98:0/4805307 wait complete. 2024-09-10T04:50:02.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T04:50:02.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T04:50:02.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T04:50:02.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T04:50:02.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f64d955d640 1 Processor -- start 2024-09-10T04:50:02.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f06416f6640 1 Processor -- start 2024-09-10T04:50:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f8212440640 1 Processor -- start 2024-09-10T04:50:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f7ddf211640 1 Processor -- start 2024-09-10T04:50:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f64d955d640 1 -- start start 2024-09-10T04:50:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f8212440640 1 -- start start 2024-09-10T04:50:02.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f7ddf211640 1 -- start start 2024-09-10T04:50:02.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f06416f6640 1 -- start start 2024-09-10T04:50:02.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f64d955d640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f64d409cc40 0x7f64d4134760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f64d955d640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d406e800 con 0x7f64d409c150 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f64d955d640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f64d406dea0 con 0x7f64d409cc40 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f06416f6640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f063c12c2e0 0x7f063c12c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f06416f6640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063c09d900 con 0x7f063c09dfe0 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f06416f6640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f063c09e870 con 0x7f063c12c2e0 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f7ddf211640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7dd8116380 0x7f7dd81347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f7ddf211640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd8116c70 con 0x7f7dd8114190 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f7ddf211640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd8115620 con 0x7f7dd8116380 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f8212440640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f820c125960 0x7f820c125d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f8212440640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c073a30 con 0x7f820c114190 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.883+0000 7f8212440640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f820c117100 con 0x7f820c125960 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f820bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f820c125960 0x7f820c125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f820bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f820c125960 0x7f820c125d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37970/0 (socket says 172.21.15.98:37970) 2024-09-10T04:50:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f820bfff640 1 -- 172.21.15.98:0/3993342525 learned_addr learned my addr 172.21.15.98:0/3993342525 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f063affd640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f063c12c2e0 0x7f063c12c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f063affd640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f063c12c2e0 0x7f063c12c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37972/0 (socket says 172.21.15.98:37972) 2024-09-10T04:50:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f063affd640 1 -- 172.21.15.98:0/2551794077 learned_addr learned my addr 172.21.15.98:0/2551794077 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f64d2ffd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f64d409c150 0x7f64d409c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37598/0 (socket says 172.21.15.98:37598) 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f64d27fc640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f64d409cc40 0x7f64d4134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f64d2ffd640 1 -- 172.21.15.98:0/4114031610 learned_addr learned my addr 172.21.15.98:0/4114031610 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f7dd7fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7dd8116380 0x7f7dd81347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f7ddcfad640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7dd8114190 0x7f7dd8114570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37622/0 (socket says 172.21.15.98:37622) 2024-09-10T04:50:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f7ddcfad640 1 -- 172.21.15.98:0/2560438194 learned_addr learned my addr 172.21.15.98:0/2560438194 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:02.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f820bfff640 1 -- 172.21.15.98:0/3993342525 >> v1:172.21.15.98:6789/0 conn(0x7f820c114190 legacy=0x7f820c1145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T04:50:02.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f820bfff640 1 -- 172.21.15.98:0/3993342525 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c116d60 con 0x7f820c125960 2024-09-10T04:50:02.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f063affd640 1 -- 172.21.15.98:0/2551794077 >> v1:172.21.15.98:6789/0 conn(0x7f063c09dfe0 legacy=0x7f063c12cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f063affd640 1 -- 172.21.15.98:0/2551794077 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c132610 con 0x7f063c12c2e0 2024-09-10T04:50:02.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f64d27fc640 1 -- 172.21.15.98:0/4114031610 >> v1:172.21.15.98:6789/0 conn(0x7f64d409c150 legacy=0x7f64d409c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f64d27fc640 1 -- 172.21.15.98:0/4114031610 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d406e190 con 0x7f64d409cc40 2024-09-10T04:50:02.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f7dd7fff640 1 -- 172.21.15.98:0/2560438194 >> v1:172.21.15.98:6789/0 conn(0x7f7dd8114190 legacy=0x7f7dd8114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.884+0000 7f7dd7fff640 1 -- 172.21.15.98:0/2560438194 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd8073880 con 0x7f7dd8116380 2024-09-10T04:50:02.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f820bfff640 1 --2- 172.21.15.98:0/3993342525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c125960 0x7f820c125d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009820 tx=0x7f81fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cf338c03483c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f820affd640 1 -- 172.21.15.98:0/3993342525 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc037070 con 0x7f820c125960 2024-09-10T04:50:02.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f820affd640 1 -- 172.21.15.98:0/3993342525 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc02adc0 con 0x7f820c125960 2024-09-10T04:50:02.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f64d27fc640 1 --2- 172.21.15.98:0/4114031610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409cc40 0x7f64d4134760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009720 tx=0x7f64c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697d0e987c9ff608 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f820affd640 1 -- 172.21.15.98:0/3993342525 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc032590 con 0x7f820c125960 2024-09-10T04:50:02.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f063affd640 1 --2- 172.21.15.98:0/2551794077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c12c2e0 0x7f063c12c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ba90 tx=0x7f062c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6284ad505f40cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f64d1ffb640 1 -- 172.21.15.98:0/4114031610 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8037070 con 0x7f64d409cc40 2024-09-10T04:50:02.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f64d1ffb640 1 -- 172.21.15.98:0/4114031610 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c802ad90 con 0x7f64d409cc40 2024-09-10T04:50:02.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f64d1ffb640 1 -- 172.21.15.98:0/4114031610 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c8032590 con 0x7f64d409cc40 2024-09-10T04:50:02.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f0639ffb640 1 -- 172.21.15.98:0/2551794077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c033570 con 0x7f063c12c2e0 2024-09-10T04:50:02.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f0639ffb640 1 -- 172.21.15.98:0/2551794077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c038070 con 0x7f063c12c2e0 2024-09-10T04:50:02.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.885+0000 7f0639ffb640 1 -- 172.21.15.98:0/2551794077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c033860 con 0x7f063c12c2e0 2024-09-10T04:50:02.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7dd7fff640 1 --2- 172.21.15.98:0/2560438194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8116380 0x7f7dd81347d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009720 tx=0x7f7dc402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900698cf821cb9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7dd77fe640 1 -- 172.21.15.98:0/2560438194 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc4037070 con 0x7f7dd8116380 2024-09-10T04:50:02.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7dd77fe640 1 -- 172.21.15.98:0/2560438194 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc402ad90 con 0x7f7dd8116380 2024-09-10T04:50:02.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7dd77fe640 1 -- 172.21.15.98:0/2560438194 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc4032590 con 0x7f7dd8116380 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 -- 172.21.15.98:0/3993342525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c125960 msgr2=0x7f820c125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 --2- 172.21.15.98:0/3993342525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c125960 0x7f820c125d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009820 tx=0x7f81fc02a180 comp rx=0 tx=0).stop 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 -- 172.21.15.98:0/3993342525 shutdown_connections 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 --2- 172.21.15.98:0/3993342525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c125960 0x7f820c125d40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 -- 172.21.15.98:0/3993342525 >> 172.21.15.98:0/3993342525 conn(0x7f820c06f8d0 msgr2=0x7f820c071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 -- 172.21.15.98:0/3993342525 shutdown_connections 2024-09-10T04:50:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f8212440640 1 -- 172.21.15.98:0/3993342525 wait complete. 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 -- 172.21.15.98:0/4114031610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409cc40 msgr2=0x7f64d4134760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 --2- 172.21.15.98:0/4114031610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409cc40 0x7f64d4134760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009720 tx=0x7f64c802a110 comp rx=0 tx=0).stop 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 -- 172.21.15.98:0/4114031610 shutdown_connections 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 --2- 172.21.15.98:0/4114031610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409cc40 0x7f64d4134760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 -- 172.21.15.98:0/4114031610 >> 172.21.15.98:0/4114031610 conn(0x7f64d4071580 msgr2=0x7f64d409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 -- 172.21.15.98:0/4114031610 shutdown_connections 2024-09-10T04:50:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f64d955d640 1 -- 172.21.15.98:0/4114031610 wait complete. 2024-09-10T04:50:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7ddf211640 1 -- 172.21.15.98:0/2560438194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8116380 msgr2=0x7f7dd81347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f06416f6640 1 -- 172.21.15.98:0/2551794077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c12c2e0 msgr2=0x7f063c12c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f06416f6640 1 --2- 172.21.15.98:0/2551794077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c12c2e0 0x7f063c12c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ba90 tx=0x7f062c02c8b0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.886+0000 7f7ddf211640 1 --2- 172.21.15.98:0/2560438194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8116380 0x7f7dd81347d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009720 tx=0x7f7dc402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f06416f6640 1 -- 172.21.15.98:0/2551794077 shutdown_connections 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f06416f6640 1 --2- 172.21.15.98:0/2551794077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c12c2e0 0x7f063c12c6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f06416f6640 1 -- 172.21.15.98:0/2551794077 >> 172.21.15.98:0/2551794077 conn(0x7f063c0715a0 msgr2=0x7f063c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 -- 172.21.15.98:0/2560438194 shutdown_connections 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f06416f6640 1 -- 172.21.15.98:0/2551794077 shutdown_connections 2024-09-10T04:50:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 --2- 172.21.15.98:0/2560438194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8116380 0x7f7dd81347d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 -- 172.21.15.98:0/2560438194 >> 172.21.15.98:0/2560438194 conn(0x7f7dd806f7e0 msgr2=0x7f7dd8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f06416f6640 1 -- 172.21.15.98:0/2551794077 wait complete. 2024-09-10T04:50:02.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 -- 172.21.15.98:0/2560438194 shutdown_connections 2024-09-10T04:50:02.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 -- 172.21.15.98:0/2560438194 wait complete. 2024-09-10T04:50:02.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f8212440640 1 Processor -- start 2024-09-10T04:50:02.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f8212440640 1 -- start start 2024-09-10T04:50:02.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.887+0000 7f7ddf211640 1 Processor -- start 2024-09-10T04:50:02.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f8212440640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f8212440640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f820c1165f0 con 0x7f820c114190 2024-09-10T04:50:02.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f64d955d640 1 Processor -- start 2024-09-10T04:50:02.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f7ddf211640 1 -- start start 2024-09-10T04:50:02.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f06416f6640 1 Processor -- start 2024-09-10T04:50:02.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f64d955d640 1 -- start start 2024-09-10T04:50:02.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f820bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f06416f6640 1 -- start start 2024-09-10T04:50:02.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f820bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37992/0 (socket says 172.21.15.98:37992) 2024-09-10T04:50:02.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f820bfff640 1 -- 172.21.15.98:0/1988771693 learned_addr learned my addr 172.21.15.98:0/1988771693 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f820bfff640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c119020 con 0x7f820c114190 2024-09-10T04:50:02.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f06416f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f06416f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f063c131990 con 0x7f063c09dfe0 2024-09-10T04:50:02.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f64d955d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f64d955d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f64d409d240 con 0x7f64d409c150 2024-09-10T04:50:02.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f7ddf211640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f063affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f063affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38002/0 (socket says 172.21.15.98:38002) 2024-09-10T04:50:02.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f063affd640 1 -- 172.21.15.98:0/2562657734 learned_addr learned my addr 172.21.15.98:0/2562657734 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.888+0000 7f7ddf211640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8114e00 con 0x7f7dd8114190 2024-09-10T04:50:02.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7ddcfad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38006/0 (socket says 172.21.15.98:38006) 2024-09-10T04:50:02.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d2ffd640 1 -- 172.21.15.98:0/1944254456 learned_addr learned my addr 172.21.15.98:0/1944254456 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7ddcfad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38012/0 (socket says 172.21.15.98:38012) 2024-09-10T04:50:02.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f820bfff640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0090b0 tx=0x7f81fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7ddcfad640 1 -- 172.21.15.98:0/437569475 learned_addr learned my addr 172.21.15.98:0/437569475 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:02.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f063affd640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c115ec0 con 0x7f063c09dfe0 2024-09-10T04:50:02.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7ddcfad640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd8117420 con 0x7f7dd8114190 2024-09-10T04:50:02.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d2ffd640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d412b6b0 con 0x7f64d409c150 2024-09-10T04:50:02.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f063affd640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ba90 tx=0x7f062c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc041070 con 0x7f820c114190 2024-09-10T04:50:02.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc03c590 con 0x7f820c114190 2024-09-10T04:50:02.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d2ffd640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c480 tx=0x7f64c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7ddcfad640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c480 tx=0x7f7dcc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc037040 con 0x7f820c114190 2024-09-10T04:50:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f8212440640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c119a70 con 0x7f820c114190 2024-09-10T04:50:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c03c600 con 0x7f063c09dfe0 2024-09-10T04:50:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c03c7c0 con 0x7f063c09dfe0 2024-09-10T04:50:02.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f8212440640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c1c4bf0 con 0x7f820c114190 2024-09-10T04:50:02.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c03cae0 con 0x7f063c09dfe0 2024-09-10T04:50:02.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c116450 con 0x7f063c09dfe0 2024-09-10T04:50:02.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c12fcf0 con 0x7f063c09dfe0 2024-09-10T04:50:02.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc017070 con 0x7f7dd8114190 2024-09-10T04:50:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c4017070 con 0x7f64d409c150 2024-09-10T04:50:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c4005c10 con 0x7f64d409c150 2024-09-10T04:50:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64c4007070 con 0x7f64d409c150 2024-09-10T04:50:02.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd8133ea0 con 0x7f7dd8114190 2024-09-10T04:50:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.889+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d411c3c0 con 0x7f64d409c150 2024-09-10T04:50:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d411b270 con 0x7f64d409c150 2024-09-10T04:50:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd8134590 con 0x7f7dd8114190 2024-09-10T04:50:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc005c10 con 0x7f7dd8114190 2024-09-10T04:50:02.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc007070 con 0x7f7dd8114190 2024-09-10T04:50:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.890+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f063c131f20 con 0x7f063c09dfe0 2024-09-10T04:50:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.891+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f820c1196d0 con 0x7f820c114190 2024-09-10T04:50:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.891+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f062c03cc80 con 0x7f063c09dfe0 2024-09-10T04:50:02.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.891+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7db8000f80 con 0x7f7dd8114190 2024-09-10T04:50:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.891+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f81fc044070 con 0x7f820c114190 2024-09-10T04:50:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f06237fe640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 0x7f0628040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64b4000f80 con 0x7f64d409c150 2024-09-10T04:50:02.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f64c401a070 con 0x7f64d409c150 2024-09-10T04:50:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7dcc01a070 con 0x7f7dd8114190 2024-09-10T04:50:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f8208ff9640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 0x7f81f8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f81fc078050 con 0x7f820c114190 2024-09-10T04:50:02.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f062c075610 con 0x7f063c09dfe0 2024-09-10T04:50:02.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f06237fe640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 0x7f0628045a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0628046160 con 0x7f0628043610 2024-09-10T04:50:02.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f062c075a50 con 0x7f063c09dfe0 2024-09-10T04:50:02.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f8208ff9640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 0x7f81f8045a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 0x7f64c00403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f063a7fc640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 0x7f0628040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f64c4051580 con 0x7f64d409c150 2024-09-10T04:50:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f820b7fe640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 0x7f81f8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 0x7f7dbc0404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 0x7f64c0045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64c4014ec0 con 0x7f64c0043660 2024-09-10T04:50:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f063b7fe640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 0x7f0628045a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81f8046160 con 0x7f81f8043610 2024-09-10T04:50:02.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f81fc073e60 con 0x7f820c114190 2024-09-10T04:50:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f7dcc051340 con 0x7f7dd8114190 2024-09-10T04:50:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f64c4058050 con 0x7f64d409c150 2024-09-10T04:50:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64d27fc640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 0x7f64c00403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 0x7f7dbc045c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd7fff640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 0x7f7dbc0404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7dcc014ec0 con 0x7f7dbc0437a0 2024-09-10T04:50:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc058050 con 0x7f7dd8114190 2024-09-10T04:50:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f64d37fe640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 0x7f64c0045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f82109dd640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 0x7f81f8045a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.892+0000 7f7ddd7ae640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 0x7f7dbc045c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f820b7fe640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 0x7f81f8040350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8200003cd0 tx=0x7f8200007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f063a7fc640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 0x7f0628040350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0630001600 tx=0x7f06300079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f063b7fe640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 0x7f0628045a90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f64d37fe640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 0x7f64c0045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f7dd7fff640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 0x7f7dbc0404e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4034000 tx=0x7f7dc402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f64d27fc640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 0x7f64c00403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64c8034000 tx=0x7f64c802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f82109dd640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 0x7f81f8045a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f7ddd7ae640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 0x7f7dbc045c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.893+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64c4014ec0 con 0x7f64c0043660 2024-09-10T04:50:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.894+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0628046160 con 0x7f0628043610 2024-09-10T04:50:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.894+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81f8046160 con 0x7f81f8043610 2024-09-10T04:50:02.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.894+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7dcc014ec0 con 0x7f7dbc0437a0 2024-09-10T04:50:02.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.907+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64b4002c70 con 0x7f64c0043660 2024-09-10T04:50:02.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.907+0000 7f64bb7fe640 1 -- 172.21.15.98:0/1944254456 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64b4002c70 con 0x7f64c0043660 2024-09-10T04:50:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f820c1c50c0 con 0x7f81f8043610 2024-09-10T04:50:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 msgr2=0x7f64c0045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 0x7f64c0045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 msgr2=0x7f64c00403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 0x7f64c00403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64c8034000 tx=0x7f64c802e000 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 msgr2=0x7f64d411ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c480 tx=0x7f64c400c940 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 shutdown_connections 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7f64c0043660 0x7f64c0045ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f64c003dee0 0x7f64c00403a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 --2- 172.21.15.98:0/1944254456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64d409c150 0x7f64d411ad30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 >> 172.21.15.98:0/1944254456 conn(0x7f64d4071580 msgr2=0x7f64d412bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 shutdown_connections 2024-09-10T04:50:02.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f64d955d640 1 -- 172.21.15.98:0/1944254456 wait complete. 2024-09-10T04:50:02.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.908+0000 7f8208ff9640 1 -- 172.21.15.98:0/1988771693 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f820c1c50c0 con 0x7f81f8043610 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 msgr2=0x7f81f8045a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 0x7f81f8045a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 msgr2=0x7f81f8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 0x7f81f8040350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8200003cd0 tx=0x7f8200007a30 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 msgr2=0x7f820c1c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0090b0 tx=0x7f81fc0046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 shutdown_connections 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f81f8043610 0x7f81f8045a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f81f803de90 0x7f81f8040350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 --2- 172.21.15.98:0/1988771693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f820c114190 0x7f820c1c44d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 >> 172.21.15.98:0/1988771693 conn(0x7f820c06f8d0 msgr2=0x7f820c071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 shutdown_connections 2024-09-10T04:50:02.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.909+0000 7f81f27fc640 1 -- 172.21.15.98:0/1988771693 wait complete. 2024-09-10T04:50:02.931 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:02.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T04:50:02.932 INFO:teuthology.orchestra.run.smithi098.stdout:42949672965 2024-09-10T04:50:02.932 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T04:50:02.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.924+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f063c115790 con 0x7f0628043610 2024-09-10T04:50:02.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06237fe640 1 -- 172.21.15.98:0/2562657734 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f063c115790 con 0x7f0628043610 2024-09-10T04:50:02.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7db8002c70 con 0x7f7dbc0437a0 2024-09-10T04:50:02.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 msgr2=0x7f0628045a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 0x7f0628045a90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 msgr2=0x7f0628040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 0x7f0628040350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0630001600 tx=0x7f06300079f0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 msgr2=0x7f063c1263a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ba90 tx=0x7f062c0046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 shutdown_connections 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f0628043610 0x7f0628045a90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f062803de90 0x7f0628040350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 --2- 172.21.15.98:0/2562657734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063c09dfe0 0x7f063c1263a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 >> 172.21.15.98:0/2562657734 conn(0x7f063c0715a0 msgr2=0x7f063c09ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f7dd57fa640 1 -- 172.21.15.98:0/437569475 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7db8002c70 con 0x7f7dbc0437a0 2024-09-10T04:50:02.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 shutdown_connections 2024-09-10T04:50:02.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.925+0000 7f06416f6640 1 -- 172.21.15.98:0/2562657734 wait complete. 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 msgr2=0x7f7dbc045c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 0x7f7dbc045c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 msgr2=0x7f7dbc0404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 0x7f7dbc0404e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4034000 tx=0x7f7dc402e000 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 msgr2=0x7f7dd8131b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c480 tx=0x7f7dcc00c940 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 shutdown_connections 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7f7dbc0437a0 0x7f7dbc045c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7dbc03e020 0x7f7dbc0404e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 --2- 172.21.15.98:0/437569475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dd8114190 0x7f7dd8131b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 >> 172.21.15.98:0/437569475 conn(0x7f7dd806f7e0 msgr2=0x7f7dd812bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 shutdown_connections 2024-09-10T04:50:02.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:02.926+0000 7f7ddf211640 1 -- 172.21.15.98:0/437569475 wait complete. 2024-09-10T04:50:02.938 INFO:teuthology.orchestra.run.smithi098.stdout:42949672965 2024-09-10T04:50:02.939 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T04:50:02.939 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:02.940 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T04:50:03.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.039+0000 7f532283c640 1 Processor -- start 2024-09-10T04:50:03.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.039+0000 7f532283c640 1 -- start start 2024-09-10T04:50:03.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f532283c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f531c06fe70 0x7f531c070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f532283c640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c071680 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f532283c640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0a30e0 con 0x7f531c06fe70 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f531b7fe640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f531c070790 0x7f531c12ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37644/0 (socket says 172.21.15.98:37644) 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f531b7fe640 1 -- 172.21.15.98:0/112246266 learned_addr learned my addr 172.21.15.98:0/112246266 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.040+0000 7f531bfff640 1 --2- 172.21.15.98:0/112246266 >> v2:172.21.15.98:3300/0 conn(0x7f531c06fe70 0x7f531c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729619861 0 0) 0x7f531c071680 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5304003520 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2310938085 0 0) 0x7f5304003520 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 >> v2:172.21.15.98:3300/0 conn(0x7f531c06fe70 msgr2=0x7f531c070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 --2- 172.21.15.98:0/112246266 >> v2:172.21.15.98:3300/0 conn(0x7f531c06fe70 0x7f531c070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c071dd0 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1408266579 0 0) 0x7f5310001620 con 0x7f531c070790 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 >> v1:172.21.15.98:6789/0 conn(0x7f531c070790 legacy=0x7f531c12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 --2- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f5304003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0a30e0 con 0x7f5304003a50 2024-09-10T04:50:03.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531bfff640 1 --2- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f5304003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.041+0000 7f531bfff640 1 -- 172.21.15.98:0/112246266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5304003520 con 0x7f5304003a50 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.042+0000 7f531bfff640 1 --2- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f5304003e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f530c009a40 tx=0x7f5304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1498c15a1f4e5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.042+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f530c036070 con 0x7f5304003a50 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.042+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c031530 con 0x7f5304003a50 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.042+0000 7f531affd640 1 -- 172.21.15.98:0/112246266 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f530c009690 con 0x7f5304003a50 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 -- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 msgr2=0x7f5304003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 --2- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f5304003e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f530c009a40 tx=0x7f5304005830 comp rx=0 tx=0).stop 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 -- 172.21.15.98:0/112246266 shutdown_connections 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 --2- 172.21.15.98:0/112246266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f5304003e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 --2- 172.21.15.98:0/112246266 >> v2:172.21.15.98:3300/0 conn(0x7f531c06fe70 0x7f531c070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 -- 172.21.15.98:0/112246266 >> 172.21.15.98:0/112246266 conn(0x7f531c0a0a50 msgr2=0x7f531c06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 -- 172.21.15.98:0/112246266 shutdown_connections 2024-09-10T04:50:03.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.043+0000 7f532283c640 1 -- 172.21.15.98:0/112246266 wait complete. 2024-09-10T04:50:03.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.044+0000 7f532283c640 1 Processor -- start 2024-09-10T04:50:03.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f532283c640 1 -- start start 2024-09-10T04:50:03.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f532283c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f532283c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f531c075cc0 con 0x7f5304003a50 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f531bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f531bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38050/0 (socket says 172.21.15.98:38050) 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f531bfff640 1 -- 172.21.15.98:0/446875875 learned_addr learned my addr 172.21.15.98:0/446875875 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.045+0000 7f531bfff640 1 -- 172.21.15.98:0/446875875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c11e5c0 con 0x7f5304003a50 2024-09-10T04:50:03.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f531bfff640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f530c009a40 tx=0x7f530c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f530c041020 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c0044c0 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f530c036040 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c11f6f0 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.046+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c11f270 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.047+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c0767d0 con 0x7f5304003a50 2024-09-10T04:50:03.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.047+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f530c044020 con 0x7f5304003a50 2024-09-10T04:50:03.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.047+0000 7f5318ff9640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 0x7f5308040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.047+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f530c00f040 con 0x7f5304003a50 2024-09-10T04:50:03.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.048+0000 7f531b7fe640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 0x7f5308040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.048+0000 7f531b7fe640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 0x7f5308040350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5310001220 tx=0x7f53100011b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.056+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f530c04b020 con 0x7f5304003a50 2024-09-10T04:50:03.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.080+0000 7f212aa3c640 1 Processor -- start 2024-09-10T04:50:03.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.080+0000 7f212aa3c640 1 -- start start 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.080+0000 7f212aa3c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21241327f0 0x7f2124134be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.080+0000 7f212aa3c640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21240a3170 con 0x7f212412c290 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.080+0000 7f212aa3c640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f212412c070 con 0x7f21241327f0 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7f21237fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21241327f0 0x7f2124134be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7f21237fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21241327f0 0x7f2124134be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38060/0 (socket says 172.21.15.98:38060) 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7f21237fe640 1 -- 172.21.15.98:0/1335895957 learned_addr learned my addr 172.21.15.98:0/1335895957 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7f21237fe640 1 -- 172.21.15.98:0/1335895957 >> v1:172.21.15.98:6789/0 conn(0x7f212412c290 legacy=0x7f212412c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7f21237fe640 1 -- 172.21.15.98:0/1335895957 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124071bf0 con 0x7f21241327f0 2024-09-10T04:50:03.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7fc89048e640 1 Processor -- start 2024-09-10T04:50:03.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.081+0000 7fc89048e640 1 -- start start 2024-09-10T04:50:03.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7f21237fe640 1 --2- 172.21.15.98:0/1335895957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21241327f0 0x7f2124134be0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21180097f0 tx=0x7f211802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef4eb9e075efb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc89048e640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc88812d770 0x7fc88812db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc89048e640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88809f260 con 0x7fc88809da50 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc89048e640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fc888069630 con 0x7fc88812d770 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7f2122ffd640 1 -- 172.21.15.98:0/1335895957 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2118037070 con 0x7f21241327f0 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7f2122ffd640 1 -- 172.21.15.98:0/1335895957 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2118032440 con 0x7f21241327f0 2024-09-10T04:50:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7f2122ffd640 1 -- 172.21.15.98:0/1335895957 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2118032740 con 0x7f21241327f0 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc88da29640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc88809da50 0x7fc88809de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37674/0 (socket says 172.21.15.98:37674) 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc88da29640 1 -- 172.21.15.98:0/1363124139 learned_addr learned my addr 172.21.15.98:0/1363124139 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.082+0000 7fc88e22a640 1 --2- 172.21.15.98:0/1363124139 >> v2:172.21.15.98:3300/0 conn(0x7fc88812d770 0x7fc88812db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7fc88e22a640 1 -- 172.21.15.98:0/1363124139 >> v1:172.21.15.98:6789/0 conn(0x7fc88809da50 legacy=0x7fc88809de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7fc88e22a640 1 -- 172.21.15.98:0/1363124139 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88812d2d0 con 0x7fc88812d770 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7fc88d228640 1 -- 172.21.15.98:0/1363124139 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448658178 0 0) 0x7fc88809f260 con 0x7fc88809da50 2024-09-10T04:50:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f91bb47f640 1 Processor -- start 2024-09-10T04:50:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 -- 172.21.15.98:0/1335895957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21241327f0 msgr2=0x7f2124134be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1335895957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21241327f0 0x7f2124134be0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21180097f0 tx=0x7f211802a270 comp rx=0 tx=0).stop 2024-09-10T04:50:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 -- 172.21.15.98:0/1335895957 shutdown_connections 2024-09-10T04:50:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1335895957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21241327f0 0x7f2124134be0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 -- 172.21.15.98:0/1335895957 >> 172.21.15.98:0/1335895957 conn(0x7f21240a0ae0 msgr2=0x7f212406e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f91bb47f640 1 -- start start 2024-09-10T04:50:03.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 -- 172.21.15.98:0/1335895957 shutdown_connections 2024-09-10T04:50:03.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7f212aa3c640 1 -- 172.21.15.98:0/1335895957 wait complete. 2024-09-10T04:50:03.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7fc88e22a640 1 --2- 172.21.15.98:0/1363124139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88812d770 0x7fc88812db50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc884009720 tx=0x7fc88402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77385a334c742fec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.083+0000 7fc88d228640 1 -- 172.21.15.98:0/1363124139 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884037070 con 0x7fc88812d770 2024-09-10T04:50:03.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc88d228640 1 -- 172.21.15.98:0/1363124139 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88402ad90 con 0x7fc88812d770 2024-09-10T04:50:03.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc88d228640 1 -- 172.21.15.98:0/1363124139 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884032590 con 0x7fc88812d770 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91bb47f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f91b4125890 0x7f91b4125c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91b921b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f91b4125890 0x7f91b4125c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91bb47f640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b406fe70 con 0x7f91b406ed40 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91bb47f640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f91b4117030 con 0x7f91b4125890 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91b8a1a640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f91b406ed40 0x7f91b406f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37682/0 (socket says 172.21.15.98:37682) 2024-09-10T04:50:03.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91b8a1a640 1 -- 172.21.15.98:0/1966178875 learned_addr learned my addr 172.21.15.98:0/1966178875 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91abfff640 1 -- 172.21.15.98:0/1966178875 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424480242 0 0) 0x7f91b406fe70 con 0x7f91b406ed40 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91abfff640 1 -- 172.21.15.98:0/1966178875 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a0003520 con 0x7f91b406ed40 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91b921b640 1 -- 172.21.15.98:0/1966178875 >> v1:172.21.15.98:6789/0 conn(0x7f91b406ed40 legacy=0x7f91b406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7f91b921b640 1 -- 172.21.15.98:0/1966178875 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b4116c90 con 0x7f91b4125890 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 -- 172.21.15.98:0/1363124139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88812d770 msgr2=0x7fc88812db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 --2- 172.21.15.98:0/1363124139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88812d770 0x7fc88812db50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc884009720 tx=0x7fc88402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:03.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 -- 172.21.15.98:0/1363124139 shutdown_connections 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 --2- 172.21.15.98:0/1363124139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88812d770 0x7fc88812db50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 -- 172.21.15.98:0/1363124139 >> 172.21.15.98:0/1363124139 conn(0x7fc888072ad0 msgr2=0x7fc888072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.084+0000 7fc89048e640 1 -- 172.21.15.98:0/1363124139 shutdown_connections 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7fc89048e640 1 -- 172.21.15.98:0/1363124139 wait complete. 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f212aa3c640 1 Processor -- start 2024-09-10T04:50:03.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f212aa3c640 1 -- start start 2024-09-10T04:50:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f91b921b640 1 --2- 172.21.15.98:0/1966178875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4125890 0x7f91b4125c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009720 tx=0x7f91b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03914bb661f56c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f91abfff640 1 -- 172.21.15.98:0/1966178875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0037070 con 0x7f91b4125890 2024-09-10T04:50:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f91abfff640 1 -- 172.21.15.98:0/1966178875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b002ae20 con 0x7f91b4125890 2024-09-10T04:50:03.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7f91abfff640 1 -- 172.21.15.98:0/1966178875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0032590 con 0x7f91b4125890 2024-09-10T04:50:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7fc89048e640 1 Processor -- start 2024-09-10T04:50:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.085+0000 7fc89048e640 1 -- start start 2024-09-10T04:50:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f212aa3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 -- 172.21.15.98:0/1966178875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4125890 msgr2=0x7f91b4125c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc89048e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 --2- 172.21.15.98:0/1966178875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4125890 0x7f91b4125c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009720 tx=0x7f91b002a1a0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f212aa3c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f21240722a0 con 0x7f212412c290 2024-09-10T04:50:03.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc89048e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc88809f680 con 0x7fc88809da50 2024-09-10T04:50:03.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f2123fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f2123fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38088/0 (socket says 172.21.15.98:38088) 2024-09-10T04:50:03.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 -- 172.21.15.98:0/1966178875 shutdown_connections 2024-09-10T04:50:03.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 --2- 172.21.15.98:0/1966178875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b4125890 0x7f91b4125c70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f2123fff640 1 -- 172.21.15.98:0/1018756196 learned_addr learned my addr 172.21.15.98:0/1018756196 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:03.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc88e22a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 -- 172.21.15.98:0/1966178875 >> 172.21.15.98:0/1966178875 conn(0x7f91b4071580 msgr2=0x7f91b409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc88e22a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38090/0 (socket says 172.21.15.98:38090) 2024-09-10T04:50:03.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc88e22a640 1 -- 172.21.15.98:0/2043727990 learned_addr learned my addr 172.21.15.98:0/2043727990 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 -- 172.21.15.98:0/1966178875 shutdown_connections 2024-09-10T04:50:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7f91bb47f640 1 -- 172.21.15.98:0/1966178875 wait complete. 2024-09-10T04:50:03.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc88e22a640 1 -- 172.21.15.98:0/2043727990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc888127c80 con 0x7fc88809da50 2024-09-10T04:50:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.086+0000 7fc88e22a640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc884009840 tx=0x7fc8840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f2123fff640 1 -- 172.21.15.98:0/1018756196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212411bd80 con 0x7f212412c290 2024-09-10T04:50:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884041070 con 0x7fc88809da50 2024-09-10T04:50:03.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88403c460 con 0x7fc88809da50 2024-09-10T04:50:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884037040 con 0x7fc88809da50 2024-09-10T04:50:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8881170d0 con 0x7fc88809da50 2024-09-10T04:50:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881c89d0 con 0x7fc88809da50 2024-09-10T04:50:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f2123fff640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f211400c480 tx=0x7f211400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f91bb47f640 1 Processor -- start 2024-09-10T04:50:03.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2114017070 con 0x7f212412c290 2024-09-10T04:50:03.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114005200 con 0x7f212412c290 2024-09-10T04:50:03.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.087+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21140035f0 con 0x7f212412c290 2024-09-10T04:50:03.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212411a780 con 0x7f212412c290 2024-09-10T04:50:03.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91bb47f640 1 -- start start 2024-09-10T04:50:03.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2124128b00 con 0x7f212412c290 2024-09-10T04:50:03.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc884044070 con 0x7fc88809da50 2024-09-10T04:50:03.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8881273c0 con 0x7fc88809da50 2024-09-10T04:50:03.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91bb47f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91bb47f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91b41261b0 con 0x7f91b406ed40 2024-09-10T04:50:03.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91b921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7fc87effd640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 0x7fc86c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fc884072b20 con 0x7fc88809da50 2024-09-10T04:50:03.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91b921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38098/0 (socket says 172.21.15.98:38098) 2024-09-10T04:50:03.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7f91b921b640 1 -- 172.21.15.98:0/2500195846 learned_addr learned my addr 172.21.15.98:0/2500195846 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:03.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.088+0000 7fc88da29640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 0x7fc86c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.089+0000 7f91b921b640 1 -- 172.21.15.98:0/2500195846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41299b0 con 0x7f91b406ed40 2024-09-10T04:50:03.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.089+0000 7f91b921b640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009720 tx=0x7f91b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.089+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f211401a070 con 0x7f212412c290 2024-09-10T04:50:03.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.089+0000 7fc88da29640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 0x7fc86c040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc878001590 tx=0x7fc878007890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.090+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21240a3500 con 0x7f212412c290 2024-09-10T04:50:03.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.090+0000 7f2120ff9640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 0x7f21100403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.090+0000 7f21237fe640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 0x7f21100403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.090+0000 7f21237fe640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 0x7f21100403a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2118034000 tx=0x7f211802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0042070 con 0x7f91b406ed40 2024-09-10T04:50:03.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b003e460 con 0x7f91b406ed40 2024-09-10T04:50:03.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b0037040 con 0x7f91b406ed40 2024-09-10T04:50:03.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f2114050250 con 0x7f212412c290 2024-09-10T04:50:03.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f91bb47f640 1 -- 172.21.15.98:0/2500195846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b411cc80 con 0x7f91b406ed40 2024-09-10T04:50:03.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fc88812d2d0 con 0x7fc88809da50 2024-09-10T04:50:03.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.093+0000 7f91bb47f640 1 -- 172.21.15.98:0/2500195846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41c4870 con 0x7f91b406ed40 2024-09-10T04:50:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.094+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9190005080 con 0x7f91b406ed40 2024-09-10T04:50:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.102+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f2114011590 con 0x7f212412c290 2024-09-10T04:50:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.105+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f91b0045070 con 0x7f91b406ed40 2024-09-10T04:50:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.105+0000 7f91a9ffb640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 0x7f91980403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.105+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f91b0073080 con 0x7f91b406ed40 2024-09-10T04:50:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.105+0000 7f91b8a1a640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 0x7f91980403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.106+0000 7f91b8a1a640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 0x7f91980403d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91a4001610 tx=0x7f91a40078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:03.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.111+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f91b002ae20 con 0x7f91b406ed40 2024-09-10T04:50:03.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.244+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f531c070790 con 0x7f5304003a50 2024-09-10T04:50:03.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.244+0000 7f5318ff9640 1 -- 172.21.15.98:0/446875875 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f530c032e10 con 0x7f5304003a50 2024-09-10T04:50:03.247 INFO:teuthology.orchestra.run.smithi098.stdout:42949672963 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.247+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 msgr2=0x7f5308040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.247+0000 7f532283c640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 0x7f5308040350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5310001220 tx=0x7f53100011b0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.247+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 msgr2=0x7f531c11ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.247+0000 7f532283c640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f530c009a40 tx=0x7f530c004730 comp rx=0 tx=0).stop 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.247+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 shutdown_connections 2024-09-10T04:50:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.248+0000 7f532283c640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f530803de90 0x7f5308040350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.248+0000 7f532283c640 1 --2- 172.21.15.98:0/446875875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5304003a50 0x7f531c11ce90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.248+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 >> 172.21.15.98:0/446875875 conn(0x7f531c0a0a50 msgr2=0x7f531c0a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.248+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 shutdown_connections 2024-09-10T04:50:03.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.248+0000 7f532283c640 1 -- 172.21.15.98:0/446875875 wait complete. 2024-09-10T04:50:03.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.0 2024-09-10T04:50:03.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.286+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2124075930 con 0x7f212412c290 2024-09-10T04:50:03.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.287+0000 7f2120ff9640 1 -- 172.21.15.98:0/1018756196 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f211401bdd0 con 0x7f212412c290 2024-09-10T04:50:03.289 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:03.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.289+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc888068da0 con 0x7fc88809da50 2024-09-10T04:50:03.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7fc87effd640 1 -- 172.21.15.98:0/2043727990 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc88403c760 con 0x7fc88809da50 2024-09-10T04:50:03.292 INFO:teuthology.orchestra.run.smithi098.stdout:42949672963 2024-09-10T04:50:03.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 msgr2=0x7f21100403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 0x7f21100403a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2118034000 tx=0x7f211802e000 comp rx=0 tx=0).stop 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 msgr2=0x7f21241285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f211400c480 tx=0x7f211400c940 comp rx=0 tx=0).stop 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 shutdown_connections 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211003dee0 0x7f21100403a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 --2- 172.21.15.98:0/1018756196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f212412c290 0x7f21241285c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 >> 172.21.15.98:0/1018756196 conn(0x7f21240a0ae0 msgr2=0x7f2124130b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 shutdown_connections 2024-09-10T04:50:03.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.290+0000 7f212aa3c640 1 -- 172.21.15.98:0/1018756196 wait complete. 2024-09-10T04:50:03.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 msgr2=0x7fc86c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 0x7fc86c040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc878001590 tx=0x7fc878007890 comp rx=0 tx=0).stop 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 msgr2=0x7fc8881c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc884009840 tx=0x7fc8840046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 shutdown_connections 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc86c03de90 0x7fc86c040350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 --2- 172.21.15.98:0/2043727990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc88809da50 0x7fc8881c8490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 >> 172.21.15.98:0/2043727990 conn(0x7fc888072ad0 msgr2=0x7fc88809c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 shutdown_connections 2024-09-10T04:50:03.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.292+0000 7fc89048e640 1 -- 172.21.15.98:0/2043727990 wait complete. 2024-09-10T04:50:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.296+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9190005640 con 0x7f91b406ed40 2024-09-10T04:50:03.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.297+0000 7f91a9ffb640 1 -- 172.21.15.98:0/2500195846 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91b0050d00 con 0x7f91b406ed40 2024-09-10T04:50:03.299 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 msgr2=0x7f91980403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 0x7f91980403d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91a4001610 tx=0x7f91a40078f0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 msgr2=0x7f91b41c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009720 tx=0x7f91b00046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 shutdown_connections 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f919803df10 0x7f91980403d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 --2- 172.21.15.98:0/2500195846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91b406ed40 0x7f91b41c4150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 >> 172.21.15.98:0/2500195846 conn(0x7f91b4071580 msgr2=0x7f91b4128580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 shutdown_connections 2024-09-10T04:50:03.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:03.299+0000 7f91977fe640 1 -- 172.21.15.98:0/2500195846 wait complete. 2024-09-10T04:50:03.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-09-10T04:50:03.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.1 2024-09-10T04:50:03.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-10T04:50:04.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T04:50:04.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T04:50:04.310 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T04:50:04.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T04:50:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.376+0000 7f4b856e4640 1 Processor -- start 2024-09-10T04:50:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.376+0000 7f4b856e4640 1 -- start start 2024-09-10T04:50:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b856e4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4b80070960 0x7f4b80134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b856e4640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b80071680 con 0x7f4b8006fe70 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b856e4640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f4b800a30e0 con 0x7f4b80070960 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7e7fc640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4b80070960 0x7f4b80134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7effd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4b8006fe70 0x7f4b80070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37686/0 (socket says 172.21.15.98:37686) 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7effd640 1 -- 172.21.15.98:0/98963678 learned_addr learned my addr 172.21.15.98:0/98963678 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7e7fc640 1 -- 172.21.15.98:0/98963678 >> v1:172.21.15.98:6789/0 conn(0x7f4b8006fe70 legacy=0x7f4b80070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7dffb640 1 -- 172.21.15.98:0/98963678 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365804820 0 0) 0x7f4b80071680 con 0x7f4b8006fe70 2024-09-10T04:50:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.377+0000 7f4b7e7fc640 1 -- 172.21.15.98:0/98963678 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80071dd0 con 0x7f4b80070960 2024-09-10T04:50:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.379+0000 7f4b7e7fc640 1 --2- 172.21.15.98:0/98963678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b80070960 0x7f4b80134780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009720 tx=0x7f4b7402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7efa8562e98794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.379+0000 7f4b7dffb640 1 -- 172.21.15.98:0/98963678 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b74037070 con 0x7f4b80070960 2024-09-10T04:50:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.379+0000 7f4b7dffb640 1 -- 172.21.15.98:0/98963678 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7402adb0 con 0x7f4b80070960 2024-09-10T04:50:04.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.379+0000 7f4b7dffb640 1 -- 172.21.15.98:0/98963678 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b74032590 con 0x7f4b80070960 2024-09-10T04:50:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 -- 172.21.15.98:0/98963678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b80070960 msgr2=0x7f4b80134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 --2- 172.21.15.98:0/98963678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b80070960 0x7f4b80134780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009720 tx=0x7f4b7402a130 comp rx=0 tx=0).stop 2024-09-10T04:50:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 -- 172.21.15.98:0/98963678 shutdown_connections 2024-09-10T04:50:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 --2- 172.21.15.98:0/98963678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b80070960 0x7f4b80134780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 -- 172.21.15.98:0/98963678 >> 172.21.15.98:0/98963678 conn(0x7f4b800a0a50 msgr2=0x7f4b8006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 -- 172.21.15.98:0/98963678 shutdown_connections 2024-09-10T04:50:04.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.380+0000 7f4b856e4640 1 -- 172.21.15.98:0/98963678 wait complete. 2024-09-10T04:50:04.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.382+0000 7f4b856e4640 1 Processor -- start 2024-09-10T04:50:04.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.382+0000 7f4b856e4640 1 -- start start 2024-09-10T04:50:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.383+0000 7f4b856e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.383+0000 7f4b856e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80075cc0 con 0x7f4b8006fe70 2024-09-10T04:50:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.383+0000 7f4b7effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.383+0000 7f4b7effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38108/0 (socket says 172.21.15.98:38108) 2024-09-10T04:50:04.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.383+0000 7f4b7effd640 1 -- 172.21.15.98:0/525580092 learned_addr learned my addr 172.21.15.98:0/525580092 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b7effd640 1 -- 172.21.15.98:0/525580092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80073970 con 0x7f4b8006fe70 2024-09-10T04:50:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b7effd640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000c3d0 tx=0x7f4b7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b700074d0 con 0x7f4b8006fe70 2024-09-10T04:50:04.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b700047e0 con 0x7f4b8006fe70 2024-09-10T04:50:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8011e840 con 0x7f4b8006fe70 2024-09-10T04:50:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b70007670 con 0x7f4b8006fe70 2024-09-10T04:50:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.384+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8011c2e0 con 0x7f4b8006fe70 2024-09-10T04:50:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.386+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4b70011070 con 0x7f4b8006fe70 2024-09-10T04:50:04.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.386+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80070250 con 0x7f4b8006fe70 2024-09-10T04:50:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.386+0000 7f4b677fe640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 0x7f4b6c040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.386+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4b70051f20 con 0x7f4b8006fe70 2024-09-10T04:50:04.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.386+0000 7f4b7e7fc640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 0x7f4b6c040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.387+0000 7f4b7e7fc640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 0x7f4b6c040300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b74034000 tx=0x7f4b7402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.394+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4b70012dd0 con 0x7f4b8006fe70 2024-09-10T04:50:04.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.418+0000 7f755c37c640 1 Processor -- start 2024-09-10T04:50:04.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.418+0000 7f755c37c640 1 -- start start 2024-09-10T04:50:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755c37c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7554125960 0x7f7554125d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755c37c640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7554073a30 con 0x7f7554114190 2024-09-10T04:50:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755c37c640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f7554117100 con 0x7f7554125960 2024-09-10T04:50:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755a118640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7554125960 0x7f7554125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7fb8e619b640 1 Processor -- start 2024-09-10T04:50:04.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755a118640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7554125960 0x7f7554125d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38114/0 (socket says 172.21.15.98:38114) 2024-09-10T04:50:04.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f7559917640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7554114190 0x7f75541145a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37692/0 (socket says 172.21.15.98:37692) 2024-09-10T04:50:04.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755a118640 1 -- 172.21.15.98:0/2974022231 learned_addr learned my addr 172.21.15.98:0/2974022231 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7fb8e619b640 1 -- start start 2024-09-10T04:50:04.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755a118640 1 -- 172.21.15.98:0/2974022231 >> v1:172.21.15.98:6789/0 conn(0x7f7554114190 legacy=0x7f75541145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.419+0000 7f755a118640 1 -- 172.21.15.98:0/2974022231 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554116d60 con 0x7f7554125960 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8e619b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb8e012a5f0 0x7fb8e01323c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8e619b640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e009e5b0 con 0x7fb8e0129b00 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8e619b640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e009ef00 con 0x7fb8e012a5f0 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8df7fe640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb8e0129b00 0x7fb8e0129ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37700/0 (socket says 172.21.15.98:37700) 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8df7fe640 1 -- 172.21.15.98:0/2802619542 learned_addr learned my addr 172.21.15.98:0/2802619542 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8deffd640 1 --2- 172.21.15.98:0/2802619542 >> v2:172.21.15.98:3300/0 conn(0x7fb8e012a5f0 0x7fb8e01323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7f0a6a4e6640 1 Processor -- start 2024-09-10T04:50:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7f0a6a4e6640 1 -- start start 2024-09-10T04:50:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8deffd640 1 -- 172.21.15.98:0/2802619542 >> v1:172.21.15.98:6789/0 conn(0x7fb8e0129b00 legacy=0x7fb8e0129ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7fb8deffd640 1 -- 172.21.15.98:0/2802619542 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e009f390 con 0x7fb8e012a5f0 2024-09-10T04:50:04.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.420+0000 7f755a118640 1 --2- 172.21.15.98:0/2974022231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554125960 0x7f7554125d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7550009820 tx=0x7f755002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f683b2b8a68a237a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f7559116640 1 -- 172.21.15.98:0/2974022231 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550037070 con 0x7f7554125960 2024-09-10T04:50:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a6a4e6640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 0x7f0a64134530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f7559116640 1 -- 172.21.15.98:0/2974022231 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755002ae50 con 0x7f7554125960 2024-09-10T04:50:04.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f7559116640 1 -- 172.21.15.98:0/2974022231 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550032590 con 0x7f7554125960 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a6a4e6640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a640737f0 con 0x7f0a6412aed0 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a6a4e6640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f0a64071de0 con 0x7f0a640714f0 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a63fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0a6412aed0 0x7f0a6412b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37704/0 (socket says 172.21.15.98:37704) 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a63fff640 1 -- 172.21.15.98:0/3653875599 learned_addr learned my addr 172.21.15.98:0/3653875599 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a637fe640 1 --2- 172.21.15.98:0/3653875599 >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 0x7f0a64134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512827060 0 0) 0x7f0a640737f0 con 0x7f0a6412aed0 2024-09-10T04:50:04.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a4c003520 con 0x7f0a6412aed0 2024-09-10T04:50:04.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7fb8deffd640 1 --2- 172.21.15.98:0/2802619542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e012a5f0 0x7fb8e01323c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009720 tx=0x7fb8d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b614ad9536d9f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1506058474 0 0) 0x7f0a4c003520 con 0x7f0a6412aed0 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 msgr2=0x7f0a64134530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 --2- 172.21.15.98:0/3653875599 >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 0x7f0a64134530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a640a3110 con 0x7f0a6412aed0 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1408266579 0 0) 0x7f0a5c001980 con 0x7f0a6412aed0 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 >> v1:172.21.15.98:6789/0 conn(0x7f0a6412aed0 legacy=0x7f0a6412b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 --2- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a4c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64071de0 con 0x7f0a4c003a50 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a637fe640 1 --2- 172.21.15.98:0/3653875599 >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 0x7f0a64134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T04:50:04.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7f0a63fff640 1 --2- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a4c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.421+0000 7fb8de7fc640 1 -- 172.21.15.98:0/2802619542 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4037070 con 0x7fb8e012a5f0 2024-09-10T04:50:04.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7fb8de7fc640 1 -- 172.21.15.98:0/2802619542 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d402ad90 con 0x7fb8e012a5f0 2024-09-10T04:50:04.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 -- 172.21.15.98:0/2974022231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554125960 msgr2=0x7f7554125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 --2- 172.21.15.98:0/2974022231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554125960 0x7f7554125d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7550009820 tx=0x7f755002a210 comp rx=0 tx=0).stop 2024-09-10T04:50:04.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7fb8de7fc640 1 -- 172.21.15.98:0/2802619542 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d4032590 con 0x7fb8e012a5f0 2024-09-10T04:50:04.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f0a63fff640 1 -- 172.21.15.98:0/3653875599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c003520 con 0x7f0a4c003a50 2024-09-10T04:50:04.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 -- 172.21.15.98:0/2974022231 shutdown_connections 2024-09-10T04:50:04.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 --2- 172.21.15.98:0/2974022231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554125960 0x7f7554125d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 -- 172.21.15.98:0/2974022231 >> 172.21.15.98:0/2974022231 conn(0x7f755406f8d0 msgr2=0x7f7554071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 -- 172.21.15.98:0/2974022231 shutdown_connections 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f755c37c640 1 -- 172.21.15.98:0/2974022231 wait complete. 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f0a63fff640 1 --2- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a4c003e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00a6d0 tx=0x7f0a4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e191a1f2b9fba11c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7fb8e619b640 1 -- 172.21.15.98:0/2802619542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e012a5f0 msgr2=0x7fb8e01323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2802619542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e012a5f0 0x7fb8e01323c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009720 tx=0x7fb8d402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:04.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.422+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a5c00a370 con 0x7f0a4c003a50 2024-09-10T04:50:04.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c02f030 con 0x7f0a4c003a50 2024-09-10T04:50:04.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a62ffd640 1 -- 172.21.15.98:0/3653875599 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a5c02baa0 con 0x7f0a4c003a50 2024-09-10T04:50:04.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7fb8e619b640 1 -- 172.21.15.98:0/2802619542 shutdown_connections 2024-09-10T04:50:04.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2802619542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e012a5f0 0x7fb8e01323c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7fb8e619b640 1 -- 172.21.15.98:0/2802619542 >> 172.21.15.98:0/2802619542 conn(0x7fb8e0071580 msgr2=0x7fb8e009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7fb8e619b640 1 -- 172.21.15.98:0/2802619542 shutdown_connections 2024-09-10T04:50:04.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7fb8e619b640 1 -- 172.21.15.98:0/2802619542 wait complete. 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 msgr2=0x7f0a4c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a4c003e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00a6d0 tx=0x7f0a4c005830 comp rx=0 tx=0).stop 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/3653875599 shutdown_connections 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/3653875599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a4c003e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/3653875599 >> v2:172.21.15.98:3300/0 conn(0x7f0a640714f0 0x7f0a64134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/3653875599 >> 172.21.15.98:0/3653875599 conn(0x7f0a640a0a80 msgr2=0x7f0a6406db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/3653875599 shutdown_connections 2024-09-10T04:50:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/3653875599 wait complete. 2024-09-10T04:50:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.423+0000 7f755c37c640 1 Processor -- start 2024-09-10T04:50:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755c37c640 1 -- start start 2024-09-10T04:50:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755c37c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755c37c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75541165f0 con 0x7f7554114190 2024-09-10T04:50:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755a118640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755a118640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38156/0 (socket says 172.21.15.98:38156) 2024-09-10T04:50:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755a118640 1 -- 172.21.15.98:0/607470546 learned_addr learned my addr 172.21.15.98:0/607470546 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f0a6a4e6640 1 Processor -- start 2024-09-10T04:50:04.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7fb8e619b640 1 Processor -- start 2024-09-10T04:50:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.424+0000 7f755a118640 1 -- 172.21.15.98:0/607470546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755411a200 con 0x7f7554114190 2024-09-10T04:50:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f755a118640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75500090b0 tx=0x7f75500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7fb8e619b640 1 -- start start 2024-09-10T04:50:04.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a6a4e6640 1 -- start start 2024-09-10T04:50:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550042070 con 0x7f7554114190 2024-09-10T04:50:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755003e590 con 0x7f7554114190 2024-09-10T04:50:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7550037040 con 0x7f7554114190 2024-09-10T04:50:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7554129a80 con 0x7f7554114190 2024-09-10T04:50:04.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755411a4c0 con 0x7f7554114190 2024-09-10T04:50:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a6a4e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a6a4e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64134a70 con 0x7f0a4c003a50 2024-09-10T04:50:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7fb8e619b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38168/0 (socket says 172.21.15.98:38168) 2024-09-10T04:50:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.425+0000 7f0a63fff640 1 -- 172.21.15.98:0/2621097734 learned_addr learned my addr 172.21.15.98:0/2621097734 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38180/0 (socket says 172.21.15.98:38180) 2024-09-10T04:50:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7fb8df7fe640 1 -- 172.21.15.98:0/2532588264 learned_addr learned my addr 172.21.15.98:0/2532588264 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0132900 con 0x7fb8e0129b00 2024-09-10T04:50:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f0a63fff640 1 -- 172.21.15.98:0/2621097734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6411bec0 con 0x7f0a4c003a50 2024-09-10T04:50:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7550045070 con 0x7f7554114190 2024-09-10T04:50:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f754affd640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 0x7f7538040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f7550072b90 con 0x7f7554114190 2024-09-10T04:50:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7554119c10 con 0x7f7554114190 2024-09-10T04:50:04.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7fb8df7fe640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e01184d0 con 0x7fb8e0129b00 2024-09-10T04:50:04.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.426+0000 7f0a63fff640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c001bf0 tx=0x7f0a64070ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.427+0000 7f7559917640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 0x7f7538040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.427+0000 7fb8df7fe640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c6b0 tx=0x7fb8d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.427+0000 7f7559917640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 0x7f7538040350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7544001630 tx=0x7f7544007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d0017070 con 0x7fb8e0129b00 2024-09-10T04:50:04.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d00058b0 con 0x7fb8e0129b00 2024-09-10T04:50:04.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d0005b90 con 0x7fb8e0129b00 2024-09-10T04:50:04.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a5c02ba30 con 0x7f0a4c003a50 2024-09-10T04:50:04.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0070e0 con 0x7f0a4c003a50 2024-09-10T04:50:04.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a5c0073c0 con 0x7f0a4c003a50 2024-09-10T04:50:04.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e01198e0 con 0x7fb8e0129b00 2024-09-10T04:50:04.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f755411a200 con 0x7f7554114190 2024-09-10T04:50:04.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6411c340 con 0x7f0a4c003a50 2024-09-10T04:50:04.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a64129c70 con 0x7f0a4c003a50 2024-09-10T04:50:04.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.431+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e0119140 con 0x7fb8e0129b00 2024-09-10T04:50:04.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.432+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a640767d0 con 0x7f0a4c003a50 2024-09-10T04:50:04.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.432+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb8d001a070 con 0x7fb8e0129b00 2024-09-10T04:50:04.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.432+0000 7fb8c7fff640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 0x7fb8cc0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.432+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0a5c007560 con 0x7f0a4c003a50 2024-09-10T04:50:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.432+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb8d00514b0 con 0x7fb8e0129b00 2024-09-10T04:50:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e01277d0 con 0x7fb8e0129b00 2024-09-10T04:50:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7f0a60ff9640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 0x7f0a500403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7f0a637fe640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 0x7f0a500403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0a5c03c030 con 0x7f0a4c003a50 2024-09-10T04:50:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7fb8deffd640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 0x7fb8cc0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7fb8deffd640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 0x7fb8cc0403f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4034000 tx=0x7fb8d402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.433+0000 7f0a637fe640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 0x7f0a500403a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009560 tx=0x7f0a58009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.442+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb8d0007590 con 0x7fb8e0129b00 2024-09-10T04:50:04.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.450+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0a5c007a30 con 0x7f0a4c003a50 2024-09-10T04:50:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.610+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4b800a2be0 con 0x7f4b8006fe70 2024-09-10T04:50:04.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.610+0000 7f4b677fe640 1 -- 172.21.15.98:0/525580092 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b70050df0 con 0x7f4b8006fe70 2024-09-10T04:50:04.612 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.613+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 msgr2=0x7f4b6c040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.613+0000 7f4b856e4640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 0x7f4b6c040300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b74034000 tx=0x7f4b7402e000 comp rx=0 tx=0).stop 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.613+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 msgr2=0x7f4b8011bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.613+0000 7f4b856e4640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000c3d0 tx=0x7f4b7000c890 comp rx=0 tx=0).stop 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.613+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 shutdown_connections 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.614+0000 7f4b856e4640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b6c03de40 0x7f4b6c040300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.614+0000 7f4b856e4640 1 --2- 172.21.15.98:0/525580092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8006fe70 0x7f4b8011bda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.614+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 >> 172.21.15.98:0/525580092 conn(0x7f4b800a0a50 msgr2=0x7f4b80130760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.614+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 shutdown_connections 2024-09-10T04:50:04.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.614+0000 7f4b856e4640 1 -- 172.21.15.98:0/525580092 wait complete. 2024-09-10T04:50:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.618+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7554119870 con 0x7f7554114190 2024-09-10T04:50:04.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.618+0000 7f754affd640 1 -- 172.21.15.98:0/607470546 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7550045d70 con 0x7f7554114190 2024-09-10T04:50:04.620 INFO:teuthology.orchestra.run.smithi098.stdout:42949672965 2024-09-10T04:50:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 msgr2=0x7f7538040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 0x7f7538040350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7544001630 tx=0x7f7544007a20 comp rx=0 tx=0).stop 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 msgr2=0x7f75541c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75500090b0 tx=0x7f75500046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 shutdown_connections 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f753803de90 0x7f7538040350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 --2- 172.21.15.98:0/607470546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7554114190 0x7f75541c44d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 >> 172.21.15.98:0/607470546 conn(0x7f755406f8d0 msgr2=0x7f7554127070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 shutdown_connections 2024-09-10T04:50:04.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.622+0000 7f755c37c640 1 -- 172.21.15.98:0/607470546 wait complete. 2024-09-10T04:50:04.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.625+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb8e0129ee0 con 0x7fb8e0129b00 2024-09-10T04:50:04.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.626+0000 7fb8c7fff640 1 -- 172.21.15.98:0/2532588264 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8d0011cc0 con 0x7fb8e0129b00 2024-09-10T04:50:04.628 INFO:teuthology.orchestra.run.smithi098.stdout:42949672965 2024-09-10T04:50:04.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 msgr2=0x7fb8cc0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 0x7fb8cc0403f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4034000 tx=0x7fb8d402e000 comp rx=0 tx=0).stop 2024-09-10T04:50:04.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 msgr2=0x7fb8e01c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c6b0 tx=0x7fb8d000cb70 comp rx=0 tx=0).stop 2024-09-10T04:50:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 shutdown_connections 2024-09-10T04:50:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb8cc03df30 0x7fb8cc0403f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 --2- 172.21.15.98:0/2532588264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e0129b00 0x7fb8e01c22c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 >> 172.21.15.98:0/2532588264 conn(0x7fb8e0071580 msgr2=0x7fb8e012ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.0 2024-09-10T04:50:04.632 DEBUG:teuthology.parallel:result is None 2024-09-10T04:50:04.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 shutdown_connections 2024-09-10T04:50:04.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.628+0000 7fb8e619b640 1 -- 172.21.15.98:0/2532588264 wait complete. 2024-09-10T04:50:04.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.3 2024-09-10T04:50:04.637 DEBUG:teuthology.parallel:result is None 2024-09-10T04:50:04.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-10T04:50:04.642 DEBUG:teuthology.parallel:result is None 2024-09-10T04:50:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.650+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0a6411ce20 con 0x7f0a4c003a50 2024-09-10T04:50:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.650+0000 7f0a60ff9640 1 -- 172.21.15.98:0/2621097734 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a5c04d020 con 0x7f0a4c003a50 2024-09-10T04:50:04.652 INFO:teuthology.orchestra.run.smithi098.stdout:42949672964 2024-09-10T04:50:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 msgr2=0x7f0a500403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 0x7f0a500403a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009560 tx=0x7f0a58009190 comp rx=0 tx=0).stop 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 msgr2=0x7f0a64129730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c001bf0 tx=0x7f0a64070ca0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 shutdown_connections 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a5003dee0 0x7f0a500403a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 --2- 172.21.15.98:0/2621097734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a4c003a50 0x7f0a64129730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 >> 172.21.15.98:0/2621097734 conn(0x7f0a640a0a80 msgr2=0x7f0a640a11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 shutdown_connections 2024-09-10T04:50:04.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.652+0000 7f0a6a4e6640 1 -- 172.21.15.98:0/2621097734 wait complete. 2024-09-10T04:50:04.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.1 2024-09-10T04:50:04.665 DEBUG:teuthology.parallel:result is None 2024-09-10T04:50:04.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T04:50:04.665 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:50:04.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.800+0000 7f7bc04d4640 1 Processor -- start 2024-09-10T04:50:04.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.800+0000 7f7bc04d4640 1 -- start start 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bc04d4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7bb8112170 0x7f7bb8134590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bc04d4640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb8112ab0 con 0x7f7bb8111680 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bc04d4640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb806df00 con 0x7f7bb8112170 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbda6f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7bb8112170 0x7f7bb8134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbe270640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f7bb8111680 0x7f7bb8111a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37714/0 (socket says 172.21.15.98:37714) 2024-09-10T04:50:04.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbe270640 1 -- 172.21.15.98:0/1269574339 learned_addr learned my addr 172.21.15.98:0/1269574339 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbda6f640 1 -- 172.21.15.98:0/1269574339 >> v1:172.21.15.98:6789/0 conn(0x7f7bb8111680 legacy=0x7f7bb8111a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbd26e640 1 -- 172.21.15.98:0/1269574339 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258661025 0 0) 0x7f7bb8112ab0 con 0x7f7bb8111680 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.801+0000 7f7bbda6f640 1 -- 172.21.15.98:0/1269574339 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb806e7b0 con 0x7f7bb8112170 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bbda6f640 1 --2- 172.21.15.98:0/1269574339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8112170 0x7f7bb8134590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009720 tx=0x7f7ba802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f4b6c9d248fc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bbd26e640 1 -- 172.21.15.98:0/1269574339 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8037070 con 0x7f7bb8112170 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bbd26e640 1 -- 172.21.15.98:0/1269574339 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba802ad90 con 0x7f7bb8112170 2024-09-10T04:50:04.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bbd26e640 1 -- 172.21.15.98:0/1269574339 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8032590 con 0x7f7bb8112170 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1269574339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8112170 msgr2=0x7f7bb8134590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.802+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1269574339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8112170 0x7f7bb8134590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009720 tx=0x7f7ba802a110 comp rx=0 tx=0).stop 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1269574339 shutdown_connections 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1269574339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8112170 0x7f7bb8134590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1269574339 >> 172.21.15.98:0/1269574339 conn(0x7f7bb80716f0 msgr2=0x7f7bb810fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1269574339 shutdown_connections 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1269574339 wait complete. 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 Processor -- start 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.803+0000 7f7bc04d4640 1 -- start start 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bc04d4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bc04d4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8069630 con 0x7f7bb8111680 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bbe270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bbe270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38194/0 (socket says 172.21.15.98:38194) 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bbe270640 1 -- 172.21.15.98:0/1487378804 learned_addr learned my addr 172.21.15.98:0/1487378804 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bbe270640 1 -- 172.21.15.98:0/1487378804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb811efd0 con 0x7f7bb8111680 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bbe270640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c3d0 tx=0x7f7bb400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb40074d0 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb40047e0 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb811d9d0 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb4007670 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.804+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb812bf30 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.805+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7bb4011070 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.805+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb811dfd0 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.805+0000 7f7baeffd640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 0x7f7b9c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.806+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f7bb4051e20 con 0x7f7bb8111680 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.806+0000 7f7bbda6f640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 0x7f7b9c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:04.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.806+0000 7f7bbda6f640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 0x7f7b9c040350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8034000 tx=0x7f7ba802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:04.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.810+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f7bb4012dd0 con 0x7f7bb8111680 2024-09-10T04:50:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.982+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bb81134c0 con 0x7f7b9c03de90 2024-09-10T04:50:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.983+0000 7f7baeffd640 1 -- 172.21.15.98:0/1487378804 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32241 (secure 0 0 0) 0x7f7ba8032740 con 0x7f7b9c03de90 2024-09-10T04:50:04.986 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 msgr2=0x7f7b9c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 0x7f7b9c040350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8034000 tx=0x7f7ba802e000 comp rx=0 tx=0).stop 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 msgr2=0x7f7bb812b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c3d0 tx=0x7f7bb400c890 comp rx=0 tx=0).stop 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 shutdown_connections 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7b9c03de90 0x7f7b9c040350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 --2- 172.21.15.98:0/1487378804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bb8111680 0x7f7bb812b810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 >> 172.21.15.98:0/1487378804 conn(0x7f7bb80716f0 msgr2=0x7f7bb8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:04.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 shutdown_connections 2024-09-10T04:50:04.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:04.986+0000 7f7bc04d4640 1 -- 172.21.15.98:0/1487378804 wait complete. 2024-09-10T04:50:04.998 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T04:50:03.194182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109876,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377484,"statfs":{"total":386547056640,"available":386434543616,"internally_reserved":0,"allocated":1785856,"data_stored":1370354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":110618392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.676261"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530808+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:01.530808+0000","last_peered":"2024-09-10T04:50:01.530808+0000","last_clean":"2024-09-10T04:50:01.530808+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:01.530808+0000","last_undegraded":"2024-09-10T04:50:01.530808+0000","last_fullsized":"2024-09-10T04:50:01.530808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535690+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:01.535690+0000","last_peered":"2024-09-10T04:50:01.535690+0000","last_clean":"2024-09-10T04:50:01.535690+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:01.535690+0000","last_undegraded":"2024-09-10T04:50:01.535690+0000","last_fullsized":"2024-09-10T04:50:01.535690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530452+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:01.530452+0000","last_peered":"2024-09-10T04:50:01.530452+0000","last_clean":"2024-09-10T04:50:01.530452+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:01.530452+0000","last_undegraded":"2024-09-10T04:50:01.530452+0000","last_fullsized":"2024-09-10T04:50:01.530452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535701+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:01.535701+0000","last_peered":"2024-09-10T04:50:01.535701+0000","last_clean":"2024-09-10T04:50:01.535701+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:01.535701+0000","last_undegraded":"2024-09-10T04:50:01.535701+0000","last_fullsized":"2024-09-10T04:50:01.535701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.532225+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:01.532225+0000","last_peered":"2024-09-10T04:50:01.532225+0000","last_clean":"2024-09-10T04:50:01.532225+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:01.532225+0000","last_undegraded":"2024-09-10T04:50:01.532225+0000","last_fullsized":"2024-09-10T04:50:01.532225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.948014+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:01.948014+0000","last_peered":"2024-09-10T04:50:01.948014+0000","last_clean":"2024-09-10T04:50:01.948014+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:01.948014+0000","last_undegraded":"2024-09-10T04:50:01.948014+0000","last_fullsized":"2024-09-10T04:50:01.948014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530424+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:01.530424+0000","last_peered":"2024-09-10T04:50:01.530424+0000","last_clean":"2024-09-10T04:50:01.530424+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:01.530424+0000","last_undegraded":"2024-09-10T04:50:01.530424+0000","last_fullsized":"2024-09-10T04:50:01.530424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.531111+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:01.531111+0000","last_peered":"2024-09-10T04:50:01.531111+0000","last_clean":"2024-09-10T04:50:01.531111+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:01.531111+0000","last_undegraded":"2024-09-10T04:50:01.531111+0000","last_fullsized":"2024-09-10T04:50:01.531111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535228+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:01.535228+0000","last_peered":"2024-09-10T04:50:01.535228+0000","last_clean":"2024-09-10T04:50:01.535228+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:01.535228+0000","last_undegraded":"2024-09-10T04:50:01.535228+0000","last_fullsized":"2024-09-10T04:50:01.535228+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":147456,"data_stored":47395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":637782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":47414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:50:05.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc4317640 1 Processor -- start 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc4317640 1 -- start start 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc4317640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6bbc129d80 0x7f6bbc12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc4317640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bbc06dc00 con 0x7f6bbc12a6a0 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc4317640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f6bbc1299c0 con 0x7f6bbc129d80 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.095+0000 7f6bc20b3640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6bbc129d80 0x7f6bbc12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.096+0000 7f6bc18b2640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6bbc12a6a0 0x7f6bbc110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37728/0 (socket says 172.21.15.98:37728) 2024-09-10T04:50:05.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.096+0000 7f6bc18b2640 1 -- 172.21.15.98:0/3259856222 learned_addr learned my addr 172.21.15.98:0/3259856222 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:05.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.096+0000 7f6bc20b3640 1 -- 172.21.15.98:0/3259856222 >> v1:172.21.15.98:6789/0 conn(0x7f6bbc12a6a0 legacy=0x7f6bbc110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.096+0000 7f6bc20b3640 1 -- 172.21.15.98:0/3259856222 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc114d20 con 0x7f6bbc129d80 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.096+0000 7f6bc20b3640 1 --2- 172.21.15.98:0/3259856222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc12a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009720 tx=0x7f6bb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d65d0ea3957da19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc10b1640 1 -- 172.21.15.98:0/3259856222 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bb8037070 con 0x7f6bbc129d80 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc10b1640 1 -- 172.21.15.98:0/3259856222 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb802ad90 con 0x7f6bbc129d80 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc10b1640 1 -- 172.21.15.98:0/3259856222 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bb8032590 con 0x7f6bbc129d80 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 -- 172.21.15.98:0/3259856222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 msgr2=0x7f6bbc12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 --2- 172.21.15.98:0/3259856222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc12a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009720 tx=0x7f6bb802a110 comp rx=0 tx=0).stop 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 -- 172.21.15.98:0/3259856222 shutdown_connections 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 --2- 172.21.15.98:0/3259856222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc12a160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 -- 172.21.15.98:0/3259856222 >> 172.21.15.98:0/3259856222 conn(0x7f6bbc070850 msgr2=0x7f6bbc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 -- 172.21.15.98:0/3259856222 shutdown_connections 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.097+0000 7f6bc4317640 1 -- 172.21.15.98:0/3259856222 wait complete. 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc4317640 1 Processor -- start 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc4317640 1 -- start start 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc4317640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc4317640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc114940 con 0x7f6bbc129d80 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc20b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc20b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38208/0 (socket says 172.21.15.98:38208) 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.098+0000 7f6bc20b3640 1 -- 172.21.15.98:0/1336025220 learned_addr learned my addr 172.21.15.98:0/1336025220 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:05.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bc20b3640 1 -- 172.21.15.98:0/1336025220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc11c890 con 0x7f6bbc129d80 2024-09-10T04:50:05.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bc20b3640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009840 tx=0x7f6bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bb8041020 con 0x7f6bbc129d80 2024-09-10T04:50:05.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb803d550 con 0x7f6bbc129d80 2024-09-10T04:50:05.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bb8037040 con 0x7f6bbc129d80 2024-09-10T04:50:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc11dca0 con 0x7f6bbc129d80 2024-09-10T04:50:05.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.099+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc11b5b0 con 0x7f6bbc129d80 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.100+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6bb8044020 con 0x7f6bbc129d80 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.100+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc1119e0 con 0x7f6bbc129d80 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.100+0000 7f6bb2ffd640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 0x7f6ba0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.100+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f6bb8072960 con 0x7f6bbc129d80 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.101+0000 7f6bc18b2640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 0x7f6ba0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.101+0000 7f6bc18b2640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 0x7f6ba0040350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.105+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f6bb804b030 con 0x7f6bbc129d80 2024-09-10T04:50:05.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.276+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bbc068da0 con 0x7f6ba003de90 2024-09-10T04:50:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.277+0000 7f6bb2ffd640 1 -- 172.21.15.98:0/1336025220 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32181 (secure 0 0 0) 0x7f6bbc068da0 con 0x7f6ba003de90 2024-09-10T04:50:05.279 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 msgr2=0x7f6ba0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 0x7f6ba0040350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac007aa0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 msgr2=0x7f6bbc11b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009840 tx=0x7f6bb80046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 shutdown_connections 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6ba003de90 0x7f6ba0040350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 --2- 172.21.15.98:0/1336025220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bbc129d80 0x7f6bbc11b070 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 >> 172.21.15.98:0/1336025220 conn(0x7f6bbc070850 msgr2=0x7f6bbc126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 shutdown_connections 2024-09-10T04:50:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.279+0000 7f6bc4317640 1 -- 172.21.15.98:0/1336025220 wait complete. 2024-09-10T04:50:05.291 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T04:50:05.194553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109876,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377484,"statfs":{"total":386547056640,"available":386434543616,"internally_reserved":0,"allocated":1785856,"data_stored":1370354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":110618392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001019"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530808+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:01.530808+0000","last_peered":"2024-09-10T04:50:01.530808+0000","last_clean":"2024-09-10T04:50:01.530808+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:01.530808+0000","last_undegraded":"2024-09-10T04:50:01.530808+0000","last_fullsized":"2024-09-10T04:50:01.530808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535690+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:01.535690+0000","last_peered":"2024-09-10T04:50:01.535690+0000","last_clean":"2024-09-10T04:50:01.535690+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:01.535690+0000","last_undegraded":"2024-09-10T04:50:01.535690+0000","last_fullsized":"2024-09-10T04:50:01.535690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530452+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:01.530452+0000","last_peered":"2024-09-10T04:50:01.530452+0000","last_clean":"2024-09-10T04:50:01.530452+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:01.530452+0000","last_undegraded":"2024-09-10T04:50:01.530452+0000","last_fullsized":"2024-09-10T04:50:01.530452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535701+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:01.535701+0000","last_peered":"2024-09-10T04:50:01.535701+0000","last_clean":"2024-09-10T04:50:01.535701+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:01.535701+0000","last_undegraded":"2024-09-10T04:50:01.535701+0000","last_fullsized":"2024-09-10T04:50:01.535701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.532225+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:01.532225+0000","last_peered":"2024-09-10T04:50:01.532225+0000","last_clean":"2024-09-10T04:50:01.532225+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:01.532225+0000","last_undegraded":"2024-09-10T04:50:01.532225+0000","last_fullsized":"2024-09-10T04:50:01.532225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.948014+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:01.948014+0000","last_peered":"2024-09-10T04:50:01.948014+0000","last_clean":"2024-09-10T04:50:01.948014+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:01.948014+0000","last_undegraded":"2024-09-10T04:50:01.948014+0000","last_fullsized":"2024-09-10T04:50:01.948014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.530424+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:01.530424+0000","last_peered":"2024-09-10T04:50:01.530424+0000","last_clean":"2024-09-10T04:50:01.530424+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:01.530424+0000","last_undegraded":"2024-09-10T04:50:01.530424+0000","last_fullsized":"2024-09-10T04:50:01.530424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.531111+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:01.531111+0000","last_peered":"2024-09-10T04:50:01.531111+0000","last_clean":"2024-09-10T04:50:01.531111+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:01.531111+0000","last_undegraded":"2024-09-10T04:50:01.531111+0000","last_fullsized":"2024-09-10T04:50:01.531111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T04:50:01.535228+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:01.535228+0000","last_peered":"2024-09-10T04:50:01.535228+0000","last_clean":"2024-09-10T04:50:01.535228+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:01.535228+0000","last_undegraded":"2024-09-10T04:50:01.535228+0000","last_fullsized":"2024-09-10T04:50:01.535228+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":147456,"data_stored":47395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":745472,"data_stored":637782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":47414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:50:05.292 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T04:50:05.292 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T04:50:05.292 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T04:50:05.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T04:50:05.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f103620f640 1 Processor -- start 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f103620f640 1 -- start start 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f103620f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1030113220 0x7f1030131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f103620f640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103006dc00 con 0x7f1030112730 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f103620f640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f1030113630 con 0x7f1030113220 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f102effd640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1030113220 0x7f1030131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f102f7fe640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1030112730 0x7f1030112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:37734/0 (socket says 172.21.15.98:37734) 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.387+0000 7f102f7fe640 1 -- 172.21.15.98:0/1561571291 learned_addr learned my addr 172.21.15.98:0/1561571291 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102effd640 1 -- 172.21.15.98:0/1561571291 >> v1:172.21.15.98:6789/0 conn(0x7f1030112730 legacy=0x7f1030112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102effd640 1 -- 172.21.15.98:0/1561571291 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1030113c00 con 0x7f1030113220 2024-09-10T04:50:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102effd640 1 --2- 172.21.15.98:0/1561571291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030113220 0x7f1030131380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1024009720 tx=0x7f102402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc59d328693a99b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102e7fc640 1 -- 172.21.15.98:0/1561571291 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1024037070 con 0x7f1030113220 2024-09-10T04:50:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102e7fc640 1 -- 172.21.15.98:0/1561571291 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102402ad90 con 0x7f1030113220 2024-09-10T04:50:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.388+0000 7f102e7fc640 1 -- 172.21.15.98:0/1561571291 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1024032590 con 0x7f1030113220 2024-09-10T04:50:05.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 -- 172.21.15.98:0/1561571291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030113220 msgr2=0x7f1030131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 --2- 172.21.15.98:0/1561571291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030113220 0x7f1030131380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1024009720 tx=0x7f102402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 -- 172.21.15.98:0/1561571291 shutdown_connections 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 --2- 172.21.15.98:0/1561571291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030113220 0x7f1030131380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 -- 172.21.15.98:0/1561571291 >> 172.21.15.98:0/1561571291 conn(0x7f1030070850 msgr2=0x7f1030072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 -- 172.21.15.98:0/1561571291 shutdown_connections 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.389+0000 7f103620f640 1 -- 172.21.15.98:0/1561571291 wait complete. 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.390+0000 7f103620f640 1 Processor -- start 2024-09-10T04:50:05.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.390+0000 7f103620f640 1 -- start start 2024-09-10T04:50:05.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.390+0000 7f103620f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.390+0000 7f103620f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1030131a40 con 0x7f1030112730 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.390+0000 7f102f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f102f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38226/0 (socket says 172.21.15.98:38226) 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f102f7fe640 1 -- 172.21.15.98:0/332667659 learned_addr learned my addr 172.21.15.98:0/332667659 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f102f7fe640 1 -- 172.21.15.98:0/332667659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1030114550 con 0x7f1030112730 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f102f7fe640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f102000c380 tx=0x7f102000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1020017070 con 0x7f1030112730 2024-09-10T04:50:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1020005c10 con 0x7f1030112730 2024-09-10T04:50:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1030115550 con 0x7f1030112730 2024-09-10T04:50:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10200070d0 con 0x7f1030112730 2024-09-10T04:50:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.391+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1030128200 con 0x7f1030112730 2024-09-10T04:50:05.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.392+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f102001a070 con 0x7f1030112730 2024-09-10T04:50:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.392+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1030112b10 con 0x7f1030112730 2024-09-10T04:50:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.392+0000 7f1017fff640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 0x7f101c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.392+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f10200514c0 con 0x7f1030112730 2024-09-10T04:50:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.392+0000 7f102effd640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 0x7f101c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.393+0000 7f102effd640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 0x7f101c040350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1024034000 tx=0x7f102402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.397+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f102001b3b0 con 0x7f1030112730 2024-09-10T04:50:05.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.606+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1030129220 con 0x7f1030112730 2024-09-10T04:50:05.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.606+0000 7f1017fff640 1 -- 172.21.15.98:0/332667659 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1020019cb0 con 0x7f1030112730 2024-09-10T04:50:05.609 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:50:05.609 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 msgr2=0x7f101c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 0x7f101c040350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1024034000 tx=0x7f102402e000 comp rx=0 tx=0).stop 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 msgr2=0x7f1030127cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f102000c380 tx=0x7f102000c840 comp rx=0 tx=0).stop 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 shutdown_connections 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f101c03de90 0x7f101c040350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 --2- 172.21.15.98:0/332667659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1030112730 0x7f1030127cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 >> 172.21.15.98:0/332667659 conn(0x7f1030070850 msgr2=0x7f1030111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 shutdown_connections 2024-09-10T04:50:05.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:50:05.608+0000 7f103620f640 1 -- 172.21.15.98:0/332667659 wait complete. 2024-09-10T04:50:05.621 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T04:50:05.621 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T04:50:05.638 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T04:50:05.638 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T04:50:05.638 INFO:tasks.rgw:Creating data pools 2024-09-10T04:50:05.638 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T04:50:05.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-10T04:50:05.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.751+0000 7f1414850640 1 Processor -- start 2024-09-10T04:50:05.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.751+0000 7f1414850640 1 -- start start 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.751+0000 7f1414850640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1410112c70 0x7f14100747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.751+0000 7f1414850640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1410074e20 con 0x7f14101127a0 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.751+0000 7f1414850640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f141011f510 con 0x7f1410112c70 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.752+0000 7f1405d9b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1410112c70 0x7f14100747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.752+0000 7f1405d9b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1410112c70 0x7f14100747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47294/0 (socket says 172.21.15.145:47294) 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.752+0000 7f1405d9b640 1 -- 172.21.15.145:0/3566225119 learned_addr learned my addr 172.21.15.145:0/3566225119 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.752+0000 7f1405d9b640 1 -- 172.21.15.145:0/3566225119 >> v1:172.21.15.98:6789/0 conn(0x7f14101127a0 legacy=0x7f14100740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.752+0000 7f1405d9b640 1 -- 172.21.15.145:0/3566225119 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141011f690 con 0x7f1410112c70 2024-09-10T04:50:05.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.753+0000 7f1405d9b640 1 --2- 172.21.15.145:0/3566225119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1410112c70 0x7f14100747c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097f0 tx=0x7f13f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22af0181145c192a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.753+0000 7f140dd9b640 1 -- 172.21.15.145:0/3566225119 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f8037070 con 0x7f1410112c70 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.753+0000 7f140dd9b640 1 -- 172.21.15.145:0/3566225119 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8032440 con 0x7f1410112c70 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.753+0000 7f140dd9b640 1 -- 172.21.15.145:0/3566225119 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f802ae60 con 0x7f1410112c70 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 -- 172.21.15.145:0/3566225119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1410112c70 msgr2=0x7f14100747c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 --2- 172.21.15.145:0/3566225119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1410112c70 0x7f14100747c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097f0 tx=0x7f13f802a1e0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 -- 172.21.15.145:0/3566225119 shutdown_connections 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 --2- 172.21.15.145:0/3566225119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1410112c70 0x7f14100747c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 -- 172.21.15.145:0/3566225119 >> 172.21.15.145:0/3566225119 conn(0x7f141006fbd0 msgr2=0x7f1410071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 -- 172.21.15.145:0/3566225119 shutdown_connections 2024-09-10T04:50:05.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.754+0000 7f1414850640 1 -- 172.21.15.145:0/3566225119 wait complete. 2024-09-10T04:50:05.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f1414850640 1 Processor -- start 2024-09-10T04:50:05.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f1414850640 1 -- start start 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f1414850640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f1414850640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f141011e9e0 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f140e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f140e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47308/0 (socket says 172.21.15.145:47308) 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.755+0000 7f140e59c640 1 -- 172.21.15.145:0/36879038 learned_addr learned my addr 172.21.15.145:0/36879038 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f140e59c640 1 -- 172.21.15.145:0/36879038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14101a7d40 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f140e59c640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f140000c480 tx=0x7f140000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1400017070 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400005200 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14000035f0 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14101a8030 con 0x7f14101127a0 2024-09-10T04:50:05.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.756+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14101ad200 con 0x7f14101127a0 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.757+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f140001a070 con 0x7f14101127a0 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.757+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14101a8370 con 0x7f14101127a0 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.757+0000 7f14077fe640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 0x7f13f0040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.757+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f14000516a0 con 0x7f14101127a0 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.757+0000 7f1405d9b640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 0x7f13f0040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:05.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.758+0000 7f1405d9b640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 0x7f13f0040380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:05.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.762+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f1400011590 con 0x7f14101127a0 2024-09-10T04:50:05.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:05.943+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f141011f040 con 0x7f14101127a0 2024-09-10T04:50:06.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.538+0000 7f14077fe640 1 -- 172.21.15.145:0/36879038 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7f140001bdd0 con 0x7f14101127a0 2024-09-10T04:50:06.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 msgr2=0x7f13f0040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 0x7f13f0040380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).stop 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 msgr2=0x7f14101a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f140000c480 tx=0x7f140000c940 comp rx=0 tx=0).stop 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 shutdown_connections 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f13f003dec0 0x7f13f0040380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 --2- 172.21.15.145:0/36879038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14101127a0 0x7f14101a7770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 >> 172.21.15.145:0/36879038 conn(0x7f141006fbd0 msgr2=0x7f1410071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 shutdown_connections 2024-09-10T04:50:06.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.541+0000 7f1414850640 1 -- 172.21.15.145:0/36879038 wait complete. 2024-09-10T04:50:06.556 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-10T04:50:06.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.660+0000 7f42e7f45640 1 Processor -- start 2024-09-10T04:50:06.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e7f45640 1 -- start start 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e7f45640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f42e010fff0 0x7f42e01103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e7f45640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e0110a90 con 0x7f42e0114dd0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e7f45640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f42e0115990 con 0x7f42e010fff0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e5ce1640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f42e010fff0 0x7f42e01103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e54e0640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f42e0114dd0 0x7f42e0115280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:43954/0 (socket says 172.21.15.145:43954) 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e54e0640 1 -- 172.21.15.145:0/576406691 learned_addr learned my addr 172.21.15.145:0/576406691 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e5ce1640 1 -- 172.21.15.145:0/576406691 >> v1:172.21.15.98:6789/0 conn(0x7f42e0114dd0 legacy=0x7f42e0115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.661+0000 7f42e5ce1640 1 -- 172.21.15.145:0/576406691 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e0115b40 con 0x7f42e010fff0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.662+0000 7f42e5ce1640 1 --2- 172.21.15.145:0/576406691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e01103d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009720 tx=0x7f42dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d91250f32017f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.662+0000 7f42e4cdf640 1 -- 172.21.15.145:0/576406691 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc037070 con 0x7f42e010fff0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.662+0000 7f42e4cdf640 1 -- 172.21.15.145:0/576406691 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc02ad90 con 0x7f42e010fff0 2024-09-10T04:50:06.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.662+0000 7f42e4cdf640 1 -- 172.21.15.145:0/576406691 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc032590 con 0x7f42e010fff0 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 -- 172.21.15.145:0/576406691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 msgr2=0x7f42e01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 --2- 172.21.15.145:0/576406691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e01103d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009720 tx=0x7f42dc02a110 comp rx=0 tx=0).stop 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 -- 172.21.15.145:0/576406691 shutdown_connections 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 --2- 172.21.15.145:0/576406691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e01103d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 -- 172.21.15.145:0/576406691 >> 172.21.15.145:0/576406691 conn(0x7f42e006ff80 msgr2=0x7f42e00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 -- 172.21.15.145:0/576406691 shutdown_connections 2024-09-10T04:50:06.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.663+0000 7f42e7f45640 1 -- 172.21.15.145:0/576406691 wait complete. 2024-09-10T04:50:06.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e7f45640 1 Processor -- start 2024-09-10T04:50:06.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e7f45640 1 -- start start 2024-09-10T04:50:06.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e7f45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:06.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e7f45640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42e00742a0 con 0x7f42e010fff0 2024-09-10T04:50:06.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e5ce1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e5ce1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47324/0 (socket says 172.21.15.145:47324) 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e5ce1640 1 -- 172.21.15.145:0/2435994058 learned_addr learned my addr 172.21.15.145:0/2435994058 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e5ce1640 1 -- 172.21.15.145:0/2435994058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e0112db0 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.664+0000 7f42e5ce1640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42dc02a150 tx=0x7f42dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc041070 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc032e30 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e0111450 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc037040 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e01119f0 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f42dc044070 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.665+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e0111d30 con 0x7f42e010fff0 2024-09-10T04:50:06.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.666+0000 7f42d67fc640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 0x7f42c4040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:06.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.666+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7f42dc072d90 con 0x7f42e010fff0 2024-09-10T04:50:06.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.666+0000 7f42e54e0640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 0x7f42c4040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:06.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.666+0000 7f42e54e0640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 0x7f42c4040330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007fd0 tx=0x7f42d0007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:06.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.670+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f42dc03cdf0 con 0x7f42e010fff0 2024-09-10T04:50:06.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:06.845+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f42e0110450 con 0x7f42e010fff0 2024-09-10T04:50:07.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.797+0000 7f42d67fc640 1 -- 172.21.15.145:0/2435994058 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7f42dc04ed60 con 0x7f42e010fff0 2024-09-10T04:50:07.798 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T04:50:07.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 msgr2=0x7f42c4040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:07.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 0x7f42c4040330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007fd0 tx=0x7f42d0007aa0 comp rx=0 tx=0).stop 2024-09-10T04:50:07.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 msgr2=0x7f42e0110eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:07.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42dc02a150 tx=0x7f42dc0046c0 comp rx=0 tx=0).stop 2024-09-10T04:50:07.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 shutdown_connections 2024-09-10T04:50:07.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f42c403de70 0x7f42c4040330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:07.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 --2- 172.21.15.145:0/2435994058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42e010fff0 0x7f42e0110eb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:07.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.801+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 >> 172.21.15.145:0/2435994058 conn(0x7f42e006ff80 msgr2=0x7f42e00729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:07.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.802+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 shutdown_connections 2024-09-10T04:50:07.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.802+0000 7f42e7f45640 1 -- 172.21.15.145:0/2435994058 wait complete. 2024-09-10T04:50:07.821 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.923+0000 7f6be8598640 1 Processor -- start 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be8598640 1 -- start start 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be8598640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6be0110490 0x7f6be011c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be8598640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be0110940 con 0x7f6be0074b00 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be8598640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f6be0075060 con 0x7f6be0110490 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be5b33640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6be0110490 0x7f6be011c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be6334640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f6be0074b00 0x7f6be010fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:43962/0 (socket says 172.21.15.145:43962) 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be6334640 1 -- 172.21.15.145:0/2601882272 learned_addr learned my addr 172.21.15.145:0/2601882272 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:07.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.924+0000 7f6be5b33640 1 --2- 172.21.15.145:0/2601882272 >> v2:172.21.15.98:3300/0 conn(0x7f6be0110490 0x7f6be011c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47340/0 (socket says 172.21.15.145:47340) 2024-09-10T04:50:07.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.925+0000 7f6be5b33640 1 -- 172.21.15.145:0/2601882272 >> v1:172.21.15.98:6789/0 conn(0x7f6be0074b00 legacy=0x7f6be010fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:07.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.925+0000 7f6be5b33640 1 -- 172.21.15.145:0/2601882272 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be0110b40 con 0x7f6be0110490 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.925+0000 7f6be5b33640 1 --2- 172.21.15.145:0/2601882272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0110490 0x7f6be011c110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009720 tx=0x7f6bdc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577e018345341adb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.925+0000 7f6be5332640 1 -- 172.21.15.145:0/2601882272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc037070 con 0x7f6be0110490 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be5332640 1 -- 172.21.15.145:0/2601882272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc02ad90 con 0x7f6be0110490 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be5332640 1 -- 172.21.15.145:0/2601882272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc032590 con 0x7f6be0110490 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 -- 172.21.15.145:0/2601882272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0110490 msgr2=0x7f6be011c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:07.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 --2- 172.21.15.145:0/2601882272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0110490 0x7f6be011c110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009720 tx=0x7f6bdc02a110 comp rx=0 tx=0).stop 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 -- 172.21.15.145:0/2601882272 shutdown_connections 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 --2- 172.21.15.145:0/2601882272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0110490 0x7f6be011c110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 -- 172.21.15.145:0/2601882272 >> 172.21.15.145:0/2601882272 conn(0x7f6be006ff80 msgr2=0x7f6be00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 -- 172.21.15.145:0/2601882272 shutdown_connections 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.926+0000 7f6be8598640 1 -- 172.21.15.145:0/2601882272 wait complete. 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be8598640 1 Processor -- start 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be8598640 1 -- start start 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be8598640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be8598640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6be011cb30 con 0x7f6be0074b00 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be6334640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be6334640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47354/0 (socket says 172.21.15.145:47354) 2024-09-10T04:50:07.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be6334640 1 -- 172.21.15.145:0/1915666784 learned_addr learned my addr 172.21.15.145:0/1915666784 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.927+0000 7f6be6334640 1 -- 172.21.15.145:0/1915666784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be01a5b40 con 0x7f6be0074b00 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6be6334640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c480 tx=0x7f6bd400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd4017070 con 0x7f6be0074b00 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd4005c10 con 0x7f6be0074b00 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd4007070 con 0x7f6be0074b00 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01a5e30 con 0x7f6be0074b00 2024-09-10T04:50:07.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.928+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be01ab000 con 0x7f6be0074b00 2024-09-10T04:50:07.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.929+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be01a6170 con 0x7f6be0074b00 2024-09-10T04:50:07.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.929+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6bd401a070 con 0x7f6be0074b00 2024-09-10T04:50:07.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.929+0000 7f6bd2ffd640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 0x7f6bc4040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:07.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.929+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4300+0+0 (secure 0 0 0) 0x7f6bd4051760 con 0x7f6be0074b00 2024-09-10T04:50:07.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.929+0000 7f6be5b33640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 0x7f6bc4040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:07.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.930+0000 7f6be5b33640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 0x7f6bc4040380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034000 tx=0x7f6bdc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:07.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:07.934+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f6bd401ac60 con 0x7f6be0074b00 2024-09-10T04:50:08.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.111+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6be011d190 con 0x7f6be0074b00 2024-09-10T04:50:08.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.798+0000 7f6bd2ffd640 1 -- 172.21.15.145:0/1915666784 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f6bd4051410 con 0x7f6be0074b00 2024-09-10T04:50:08.800 INFO:teuthology.orchestra.run.smithi145.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.803+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 msgr2=0x7f6bc4040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.803+0000 7f6be8598640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 0x7f6bc4040380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034000 tx=0x7f6bdc02e000 comp rx=0 tx=0).stop 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.803+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 msgr2=0x7f6be01a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.803+0000 7f6be8598640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c480 tx=0x7f6bd400c940 comp rx=0 tx=0).stop 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.804+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 shutdown_connections 2024-09-10T04:50:08.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.804+0000 7f6be8598640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f6bc403dec0 0x7f6bc4040380 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034000 tx=0x7f6bdc02e000 comp rx=0 tx=0).stop 2024-09-10T04:50:08.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.804+0000 7f6be8598640 1 --2- 172.21.15.145:0/1915666784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0074b00 0x7f6be01a5570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:08.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.804+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 >> 172.21.15.145:0/1915666784 conn(0x7f6be006ff80 msgr2=0x7f6be0116110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:08.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.804+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 shutdown_connections 2024-09-10T04:50:08.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.805+0000 7f6be8598640 1 -- 172.21.15.145:0/1915666784 wait complete. 2024-09-10T04:50:08.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T04:50:08.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.942+0000 7fee16bec640 1 Processor -- start 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.942+0000 7fee16bec640 1 -- start start 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.942+0000 7fee16bec640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fee10114780 0x7fee10114b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.942+0000 7fee16bec640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee101151f0 con 0x7fee10073fe0 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.942+0000 7fee16bec640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fee10074ba0 con 0x7fee10114780 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee14988640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fee10114780 0x7fee10114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee14988640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fee10114780 0x7fee10114b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47366/0 (socket says 172.21.15.145:47366) 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee0ffff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fee10073fe0 0x7fee10074490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:43976/0 (socket says 172.21.15.145:43976) 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee14988640 1 -- 172.21.15.145:0/486068597 learned_addr learned my addr 172.21.15.145:0/486068597 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee14988640 1 -- 172.21.15.145:0/486068597 >> v1:172.21.15.98:6789/0 conn(0x7fee10073fe0 legacy=0x7fee10074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:08.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.943+0000 7fee14988640 1 -- 172.21.15.145:0/486068597 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee10074d50 con 0x7fee10114780 2024-09-10T04:50:08.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.944+0000 7fee14988640 1 --2- 172.21.15.145:0/486068597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10114780 0x7fee10114b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee00009e50 tx=0x7fee0002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7902bda461d7c36c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:08.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.944+0000 7fee0f7fe640 1 -- 172.21.15.145:0/486068597 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee00036070 con 0x7fee10114780 2024-09-10T04:50:08.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.944+0000 7fee0f7fe640 1 -- 172.21.15.145:0/486068597 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee00031400 con 0x7fee10114780 2024-09-10T04:50:08.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.944+0000 7fee0f7fe640 1 -- 172.21.15.145:0/486068597 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee000315d0 con 0x7fee10114780 2024-09-10T04:50:08.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- 172.21.15.145:0/486068597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10114780 msgr2=0x7fee10114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 --2- 172.21.15.145:0/486068597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10114780 0x7fee10114b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee00009e50 tx=0x7fee0002a730 comp rx=0 tx=0).stop 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- 172.21.15.145:0/486068597 shutdown_connections 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 --2- 172.21.15.145:0/486068597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10114780 0x7fee10114b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- 172.21.15.145:0/486068597 >> 172.21.15.145:0/486068597 conn(0x7fee1006ff80 msgr2=0x7fee100723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- 172.21.15.145:0/486068597 shutdown_connections 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- 172.21.15.145:0/486068597 wait complete. 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 Processor -- start 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.945+0000 7fee16bec640 1 -- start start 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee16bec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee16bec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee10110140 con 0x7fee10073fe0 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee14988640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:08.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee14988640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47378/0 (socket says 172.21.15.145:47378) 2024-09-10T04:50:08.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee14988640 1 -- 172.21.15.145:0/1193647666 learned_addr learned my addr 172.21.15.145:0/1193647666 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:08.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee14988640 1 -- 172.21.15.145:0/1193647666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee101a3a20 con 0x7fee10073fe0 2024-09-10T04:50:08.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee14988640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee0002a770 tx=0x7fee00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee00041020 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0003c470 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee101a3cb0 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee00036040 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.946+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee101a8c80 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.947+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fee00044020 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.947+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee10114be0 con 0x7fee10073fe0 2024-09-10T04:50:08.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.948+0000 7fee0d7fa640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 0x7fedfc040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:08.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.948+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7fee000733b0 con 0x7fee10073fe0 2024-09-10T04:50:08.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.948+0000 7fee0ffff640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 0x7fedfc040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:08.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.948+0000 7fee0ffff640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 0x7fedfc040330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee04001630 tx=0x7fee04007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:08.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:08.952+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fee0004b030 con 0x7fee10073fe0 2024-09-10T04:50:09.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.125+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fee10114780 con 0x7fee10073fe0 2024-09-10T04:50:09.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.804+0000 7fee0d7fa640 1 -- 172.21.15.145:0/1193647666 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7fee00073070 con 0x7fee10073fe0 2024-09-10T04:50:09.805 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T04:50:09.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.806+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 msgr2=0x7fedfc040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:09.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.806+0000 7fee16bec640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 0x7fedfc040330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee04001630 tx=0x7fee04007a20 comp rx=0 tx=0).stop 2024-09-10T04:50:09.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.806+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 msgr2=0x7fee101a3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.806+0000 7fee16bec640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee0002a770 tx=0x7fee00004a40 comp rx=0 tx=0).stop 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 shutdown_connections 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fedfc03de70 0x7fedfc040330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 --2- 172.21.15.145:0/1193647666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee10073fe0 0x7fee101a3450 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 >> 172.21.15.145:0/1193647666 conn(0x7fee1006ff80 msgr2=0x7fee10072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 shutdown_connections 2024-09-10T04:50:09.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.807+0000 7fee16bec640 1 -- 172.21.15.145:0/1193647666 wait complete. 2024-09-10T04:50:09.824 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T04:50:09.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf1028e640 1 Processor -- start 2024-09-10T04:50:09.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf1028e640 1 -- start start 2024-09-10T04:50:09.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf1028e640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf08110490 0x7fcf0811c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:09.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf1028e640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf08110940 con 0x7fcf08074b00 2024-09-10T04:50:09.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf1028e640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fcf08075060 con 0x7fcf08110490 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf0d829640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcf08110490 0x7fcf0811c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.923+0000 7fcf0e02a640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcf08074b00 0x7fcf0810fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60714/0 (socket says 172.21.15.145:60714) 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.924+0000 7fcf0e02a640 1 -- 172.21.15.145:0/1722901659 learned_addr learned my addr 172.21.15.145:0/1722901659 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.924+0000 7fcf0d829640 1 -- 172.21.15.145:0/1722901659 >> v1:172.21.15.98:6789/0 conn(0x7fcf08074b00 legacy=0x7fcf0810fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.924+0000 7fcf0d829640 1 -- 172.21.15.145:0/1722901659 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf08110b40 con 0x7fcf08110490 2024-09-10T04:50:09.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf0d829640 1 --2- 172.21.15.145:0/1722901659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08110490 0x7fcf0811c110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009720 tx=0x7fcf0402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba60d25aeba42bac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf0d028640 1 -- 172.21.15.145:0/1722901659 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf04037070 con 0x7fcf08110490 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf0d028640 1 -- 172.21.15.145:0/1722901659 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0402ad90 con 0x7fcf08110490 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf0d028640 1 -- 172.21.15.145:0/1722901659 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf04032590 con 0x7fcf08110490 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 -- 172.21.15.145:0/1722901659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08110490 msgr2=0x7fcf0811c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 --2- 172.21.15.145:0/1722901659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08110490 0x7fcf0811c110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009720 tx=0x7fcf0402a110 comp rx=0 tx=0).stop 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 -- 172.21.15.145:0/1722901659 shutdown_connections 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 --2- 172.21.15.145:0/1722901659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08110490 0x7fcf0811c110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 -- 172.21.15.145:0/1722901659 >> 172.21.15.145:0/1722901659 conn(0x7fcf0806ff80 msgr2=0x7fcf080723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 -- 172.21.15.145:0/1722901659 shutdown_connections 2024-09-10T04:50:09.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.925+0000 7fcf1028e640 1 -- 172.21.15.145:0/1722901659 wait complete. 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf1028e640 1 Processor -- start 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf1028e640 1 -- start start 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf1028e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf1028e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0811cb30 con 0x7fcf08074b00 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf0e02a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf0e02a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:49326/0 (socket says 172.21.15.145:49326) 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.926+0000 7fcf0e02a640 1 -- 172.21.15.145:0/3919098478 learned_addr learned my addr 172.21.15.145:0/3919098478 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:09.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcf0e02a640 1 -- 172.21.15.145:0/3919098478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf081a5b40 con 0x7fcf08074b00 2024-09-10T04:50:09.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcf0e02a640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c450 tx=0x7fcef800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:09.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef8017070 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef8005c10 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf081a5e30 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef80070d0 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.927+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf081aaf80 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.928+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf081a6170 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.928+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcef801a070 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.928+0000 7fcefeffd640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 0x7fceec040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.928+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7fcef8051a10 con 0x7fcf08074b00 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.929+0000 7fcf0d829640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 0x7fceec040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:09.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.929+0000 7fcf0d829640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 0x7fceec040330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf04034000 tx=0x7fcf0402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:09.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:09.933+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fcef801ad50 con 0x7fcf08074b00 2024-09-10T04:50:10.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.112+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fcf0811d190 con 0x7fcf08074b00 2024-09-10T04:50:10.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.805+0000 7fcefeffd640 1 -- 172.21.15.145:0/3919098478 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7fcef801b8d0 con 0x7fcf08074b00 2024-09-10T04:50:10.806 INFO:teuthology.orchestra.run.smithi145.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 msgr2=0x7fceec040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 0x7fceec040330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf04034000 tx=0x7fcf0402e000 comp rx=0 tx=0).stop 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 msgr2=0x7fcf081a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c450 tx=0x7fcef800c910 comp rx=0 tx=0).stop 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 shutdown_connections 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fceec03de70 0x7fceec040330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 --2- 172.21.15.145:0/3919098478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf08074b00 0x7fcf081a5570 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 >> 172.21.15.145:0/3919098478 conn(0x7fcf0806ff80 msgr2=0x7fcf081160d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:10.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.809+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 shutdown_connections 2024-09-10T04:50:10.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:10.810+0000 7fcf1028e640 1 -- 172.21.15.145:0/3919098478 wait complete. 2024-09-10T04:50:10.837 DEBUG:tasks.rgw:Pools created 2024-09-10T04:50:10.837 INFO:tasks.rgw:Starting rgw... 2024-09-10T04:50:10.838 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T04:50:10.838 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T04:50:10.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo echo -n http://smithi145.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T04:50:10.865 INFO:teuthology.orchestra.run.smithi145.stdout:http://smithi145.front.sepia.ceph.com:80 2024-09-10T04:50:10.865 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T04:50:10.930 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T04:50:10.931 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T04:50:10.973 INFO:tasks.rgw.client.0:Started 2024-09-10T04:50:10.973 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:10.973 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:10.997 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T04:50:10.997 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-10T04:50:10.998 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T04:50:10.999 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T04:50:10.999 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80: Connection refused 2024-09-10T04:50:12.000 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:12.022 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T04:50:12.022 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-10T04:50:12.023 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T04:50:12.023 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T04:50:12.024 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80: Connection refused 2024-09-10T04:50:14.025 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:14.049 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T04:50:14.049 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-10T04:50:14.049 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T04:50:14.050 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T04:50:14.051 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80: Connection refused 2024-09-10T04:50:18.051 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:18.075 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T04:50:18.075 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-10T04:50:18.076 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T04:50:18.076 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T04:50:18.077 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80: Connection refused 2024-09-10T04:50:26.078 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-10T04:50:26.101 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T04:50:26.102 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-10T04:50:26.103 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-10T04:50:26.104 INFO:teuthology.orchestra.run.smithi145.stdout:anonymous 2024-09-10T04:50:26.104 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-10T04:50:26.633 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-10T04:50:26.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T04:50:26.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T04:50:26.634 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T04:50:26.683 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:26.684 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:26.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.682+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.682+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.682+0000 7f84a4d0c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56030ba074a0 0x56030ba078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.682+0000 7f84a4d0c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56030b8b2e40 con 0x56030ba07de0 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.682+0000 7f84a4d0c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x56030b87d680 con 0x56030ba074a0 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a27f6640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56030ba074a0 0x56030ba078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a27f6640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56030ba074a0 0x56030ba078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51042/0 (socket says 172.21.15.145:51042) 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f849bfff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x56030ba07de0 0x56030ba08290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60272/0 (socket says 172.21.15.145:60272) 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a27f6640 1 -- 172.21.15.145:0/741378543 learned_addr learned my addr 172.21.15.145:0/741378543 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a27f6640 1 -- 172.21.15.145:0/741378543 >> v1:172.21.15.98:6789/0 conn(0x56030ba07de0 legacy=0x56030ba08290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a27f6640 1 -- 172.21.15.145:0/741378543 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030b8996b0 con 0x56030ba074a0 2024-09-10T04:50:26.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.683+0000 7f84a1ff5640 1 -- 172.21.15.145:0/741378543 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433684256 0 0) 0x56030b8b2e40 con 0x56030ba07de0 2024-09-10T04:50:26.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a27f6640 1 --2- 172.21.15.145:0/741378543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030ba078a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f849400a520 tx=0x7f8494045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f8256f34e807e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a1ff5640 1 -- 172.21.15.145:0/741378543 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494055070 con 0x56030ba074a0 2024-09-10T04:50:26.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a1ff5640 1 -- 172.21.15.145:0/741378543 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84940515b0 con 0x56030ba074a0 2024-09-10T04:50:26.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a1ff5640 1 -- 172.21.15.145:0/741378543 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84940518d0 con 0x56030ba074a0 2024-09-10T04:50:26.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a4d0c800 1 -- 172.21.15.145:0/741378543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 msgr2=0x56030ba078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.685+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/741378543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030ba078a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f849400a520 tx=0x7f8494045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.686+0000 7f84a4d0c800 1 -- 172.21.15.145:0/741378543 shutdown_connections 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.686+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/741378543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030ba078a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.686+0000 7f84a4d0c800 1 -- 172.21.15.145:0/741378543 >> 172.21.15.145:0/741378543 conn(0x56030ba031b0 msgr2=0x56030ba05610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.686+0000 7f84a4d0c800 1 -- 172.21.15.145:0/741378543 shutdown_connections 2024-09-10T04:50:26.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.686+0000 7f84a4d0c800 1 -- 172.21.15.145:0/741378543 wait complete. 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.701+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.701+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a4d0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a4d0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56030b8a1dd0 con 0x56030ba074a0 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51046/0 (socket says 172.21.15.145:51046) 2024-09-10T04:50:26.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a27f6640 1 -- 172.21.15.145:0/2220853894 learned_addr learned my addr 172.21.15.145:0/2220853894 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a27f6640 1 -- 172.21.15.145:0/2220853894 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030b8bae10 con 0x56030ba074a0 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.702+0000 7f84a27f6640 1 --2- 172.21.15.145:0/2220853894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8494025da0 tx=0x7f8494051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280435b938b5ded2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f8390608640 1 -- 172.21.15.145:0/2220853894 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494051950 con 0x56030ba074a0 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f8390608640 1 -- 172.21.15.145:0/2220853894 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494051af0 con 0x56030ba074a0 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f8390608640 1 -- 172.21.15.145:0/2220853894 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494051dd0 con 0x56030ba074a0 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2220853894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 msgr2=0x56030bafa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/2220853894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8494025da0 tx=0x7f8494051000 comp rx=0 tx=0).stop 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2220853894 shutdown_connections 2024-09-10T04:50:26.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/2220853894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bafa690 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2220853894 >> 172.21.15.145:0/2220853894 conn(0x56030ba031b0 msgr2=0x56030baf6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2220853894 shutdown_connections 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.703+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2220853894 wait complete. 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a4d0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bb01e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a4d0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56030ba08d00 con 0x56030ba074a0 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bb01e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bb01e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51056/0 (socket says 172.21.15.145:51056) 2024-09-10T04:50:26.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a27f6640 1 -- 172.21.15.145:0/3463361834 learned_addr learned my addr 172.21.15.145:0/3463361834 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.704+0000 7f84a27f6640 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030bb02390 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f84a27f6640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bb01e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8494025da0 tx=0x7f8494002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f838ee05640 1 -- 172.21.15.145:0/3463361834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f849405a600 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f838ee05640 1 -- 172.21.15.145:0/3463361834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494073070 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030bb02620 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f838ee05640 1 -- 172.21.15.145:0/3463361834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f849405a910 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.705+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030bb03230 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.706+0000 7f838ee05640 1 -- 172.21.15.145:0/3463361834 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8494058070 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.706+0000 7f838ee05640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f838803c780 0x7f838803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.706+0000 7f838ee05640 1 -- 172.21.15.145:0/3463361834 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f849406b040 con 0x56030ba074a0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.706+0000 7f849bfff640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f838803c780 0x7f838803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030ba07de0 0x56030bb09480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb099c0 con 0x56030ba07de0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030ba07de0 0x56030bb09480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f849bfff640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f838803c780 0x7f838803ec40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030ba07de0 0x56030bb09480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a2ff7640 1 -- 172.21.15.145:0/3463361834 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030ba07de0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb0a300 0x56030bb0c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.707+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb0cec0 con 0x56030bb0a300 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.708+0000 7f84a27f6640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb0a300 0x56030bb0c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.708+0000 7f84a27f6640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb0a300 0x56030bb0c750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.708+0000 7f84a27f6640 1 -- 172.21.15.145:0/3463361834 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8494057030 con 0x56030bb0a300 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.708+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb0e770 con 0x56030ba07de0 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f84a2ff7640 1 -- 172.21.15.145:0/3463361834 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030ba07de0 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb0d9a0 con 0x56030bb0a300 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f84a27f6640 1 -- 172.21.15.145:0/3463361834 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8494057030 con 0x56030bb0a300 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56030bb0fb20 0x56030bb11f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb12450 con 0x56030bb0fb20 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.709+0000 7f849bfff640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56030bb0fb20 0x56030bb11f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f849bfff640 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56030bb0fb20 0x56030bb11f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f849bfff640 1 -- 172.21.15.145:0/3463361834 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f848c00f670 con 0x56030bb0fb20 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f84a4d0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.710+0000 7f84a4d0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56030b8ffa00 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51070/0 (socket says 172.21.15.145:51070) 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a27f6640 1 -- 172.21.15.145:0/1285235034 learned_addr learned my addr 172.21.15.145:0/1285235034 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a27f6640 1 -- 172.21.15.145:0/1285235034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030bb20a00 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a27f6640 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8494095b50 tx=0x7f8494050fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f8387fff640 1 -- 172.21.15.145:0/1285235034 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f849405ad80 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f8387fff640 1 -- 172.21.15.145:0/1285235034 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494064570 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030bb21230 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f8387fff640 1 -- 172.21.15.145:0/1285235034 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494064850 con 0x56030bb1ffa0 2024-09-10T04:50:26.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.711+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030bb217d0 con 0x56030bb1ffa0 2024-09-10T04:50:26.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.712+0000 7f8387fff640 1 -- 172.21.15.145:0/1285235034 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f849408b030 con 0x56030bb1ffa0 2024-09-10T04:50:26.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.712+0000 7f8387fff640 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 0x7f837c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.712+0000 7f8387fff640 1 -- 172.21.15.145:0/1285235034 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8494062070 con 0x56030bb1ffa0 2024-09-10T04:50:26.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f849bfff640 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 0x7f837c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f849bfff640 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 0x7f837c03eba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x56030bb03de0 tx=0x7f848c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a4d0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a4d0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56030bafae20 con 0x56030bb2c8c0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51080/0 (socket says 172.21.15.145:51080) 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.713+0000 7f84a27f6640 1 -- 172.21.15.145:0/2213570436 learned_addr learned my addr 172.21.15.145:0/2213570436 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a27f6640 1 -- 172.21.15.145:0/2213570436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030bb2d290 con 0x56030bb2c8c0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a27f6640 1 --2- 172.21.15.145:0/2213570436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f849408dfd0 tx=0x7f8494082e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14de7165dc54508b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f8385ffb640 1 -- 172.21.15.145:0/2213570436 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494094300 con 0x56030bb2c8c0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f8385ffb640 1 -- 172.21.15.145:0/2213570436 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494097340 con 0x56030bb2c8c0 2024-09-10T04:50:26.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f8385ffb640 1 -- 172.21.15.145:0/2213570436 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494068120 con 0x56030bb2c8c0 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2213570436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 msgr2=0x56030bb2cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/2213570436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f849408dfd0 tx=0x7f8494082e60 comp rx=0 tx=0).stop 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2213570436 shutdown_connections 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/2213570436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb2cca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2213570436 >> 172.21.15.145:0/2213570436 conn(0x56030bb28cc0 msgr2=0x56030bb26f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2213570436 shutdown_connections 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.714+0000 7f84a4d0c800 1 -- 172.21.15.145:0/2213570436 wait complete. 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a4d0c800 1 Processor -- start 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a4d0c800 1 -- start start 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a4d0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a4d0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56030bb2d720 con 0x56030bb2c8c0 2024-09-10T04:50:26.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a27f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51084/0 (socket says 172.21.15.145:51084) 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 learned_addr learned my addr 172.21.15.145:0/4212392789 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.715+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030bb342a0 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f84a27f6640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8494079fd0 tx=0x7f8494067f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f8373fff640 1 -- 172.21.15.145:0/4212392789 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8494091e90 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f8373fff640 1 -- 172.21.15.145:0/4212392789 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f849406e850 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030bb342a0 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f8373fff640 1 -- 172.21.15.145:0/4212392789 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f849406eb70 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.716+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030bb348a0 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.717+0000 7f8373fff640 1 -- 172.21.15.145:0/4212392789 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84940ac070 con 0x56030bb2c8c0 2024-09-10T04:50:26.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.717+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.717+0000 7f8373fff640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f836c03c920 0x7f836c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f8373fff640 1 -- 172.21.15.145:0/4212392789 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f84940b2070 con 0x56030bb2c8c0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f849bfff640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f836c03c920 0x7f836c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030bb3f250 0x56030bb416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb41e30 con 0x56030bb3f250 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030bb3f250 0x56030bb416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f849bfff640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f836c03c920 0x7f836c03ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f848c00ffd0 tx=0x7f848c023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030bb3f250 0x56030bb416e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.718+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 realm 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb3e5e0 con 0x56030bb3f250 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb428c0 con 0x56030bb3f250 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb43480 0x56030bb45940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb460b0 con 0x56030bb43480 2024-09-10T04:50:26.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.719+0000 7f84a27f6640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb43480 0x56030bb45940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a27f6640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb43480 0x56030bb45940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb46950 con 0x56030bb3f250 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 20 searching for the correct realm 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56030bb486c0 0x56030bb4aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.720+0000 7f849bfff640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56030bb486c0 0x56030bb4aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f849bfff640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56030bb486c0 0x56030bb4aaf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f84a27f6640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8494068c50 0x7f849406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.721+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8494068c50 0x7f849406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8494068c50 0x7f849406d7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f849c00a4d0 con 0x7f8494068c50 2024-09-10T04:50:26.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.722+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.723+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c00a4d0 con 0x56030bb3f250 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x7f8494068c50 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.724+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f849c030040 con 0x7f8494068c50 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.725+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.726+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.727+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb3f250 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c030040 con 0x7f8494068c50 2024-09-10T04:50:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.728+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb486c0 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.729+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b1c0 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:26.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f849c030040 con 0x56030bb3f250 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.730+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb47720 con 0x56030bb43480 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb47bc0 con 0x7f8494068c50 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 zone default found 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 4 Realm: () 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:26.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 zonegroup default 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.731+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4b690 con 0x7f8494068c50 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4d210 con 0x56030bb486c0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4d760 con 0x56030bb486c0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 started sync module instance, tier type = 2024-09-10T04:50:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.732+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4c520 con 0x56030bb43480 2024-09-10T04:50:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.734+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.734+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571081287952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4e070 con 0x56030bb43480 2024-09-10T04:50:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.734+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4e8c0 con 0x56030bb3f250 2024-09-10T04:50:26.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.735+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.735+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571081295136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4ef10 con 0x56030bb3f250 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.735+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4fa30 con 0x56030bb43480 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.735+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571081287952] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.736+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571081295136] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.738+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.738+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571081299200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4f9f0 con 0x56030bb43480 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.738+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb502d0 con 0x7f8494068c50 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.741+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.741+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571081301536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb506f0 con 0x7f8494068c50 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.741+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb50f40 con 0x56030bb43480 2024-09-10T04:50:26.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.743+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571081299200] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.746+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571081301536] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.746+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.746+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571081302592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb50b10 con 0x56030bb43480 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.746+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb51360 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.747+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571081302592] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.747+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.747+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571081304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb51750 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.747+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.749+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.749+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571081311600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52e40 con 0x56030bb486c0 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.749+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb53880 con 0x7f8494068c50 2024-09-10T04:50:26.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.749+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571081304128] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571081315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb53840 con 0x7f8494068c50 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=0 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=1 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=2 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=3 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=4 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=5 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571081311600] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.751+0000 7f84a4d0c800 20 add_watcher() i=6 2024-09-10T04:50:26.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571081315152] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a4d0c800 20 add_watcher() i=7 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a4d0c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52990 con 0x56030bb3f250 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.752+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571081305280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52990 con 0x56030bb3f250 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571081305280] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f8358fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 5 note: GC not initialized 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f82d37fe640 20 reqs_thread_entry: start 2024-09-10T04:50:26.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:26.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 20 Filter name: none 2024-09-10T04:50:26.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f82d17fa640 20 reqs_thread_entry: start 2024-09-10T04:50:26.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.754+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb89100 con 0x56030bb486c0 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb43480 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4e070 con 0x56030bb3f250 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.755+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb43480 2024-09-10T04:50:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.756+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb43480 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.757+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.758+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb43480 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.759+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb43480 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.760+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.761+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb3f250 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb43480 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.762+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x56030bb486c0 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.763+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.763+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030bb472a0 con 0x7f8494068c50 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.763+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.764+0000 7f8358fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.764+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571081305280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb3f250 2024-09-10T04:50:26.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.765+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94571081305280] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.765+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571081287952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4e070 con 0x56030bb43480 2024-09-10T04:50:26.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.766+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94571081287952] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.766+0000 7f84a4d0c800 20 remove_watcher() i=0 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.766+0000 7f84a4d0c800 2 removed watcher, disabling cache 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.766+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571081295136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb3f250 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.767+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94571081295136] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x56030bb3f250 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.767+0000 7f84a4d0c800 20 remove_watcher() i=1 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.767+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571081299200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb43480 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.768+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94571081299200] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.768+0000 7f84a4d0c800 20 remove_watcher() i=2 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.768+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571081301536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x7f8494068c50 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.769+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94571081301536] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.769+0000 7f84a4d0c800 20 remove_watcher() i=3 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.769+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571081302592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb43480 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.770+0000 7f84a27f6640 1 -- 172.21.15.145:0/4212392789 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94571081302592] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84940ab030 con 0x56030bb43480 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.770+0000 7f84a4d0c800 20 remove_watcher() i=4 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.770+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571081304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb52150 con 0x56030bb486c0 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.771+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94571081304128] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.771+0000 7f84a4d0c800 20 remove_watcher() i=5 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.771+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571081311600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4c910 con 0x56030bb486c0 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.772+0000 7f849bfff640 1 -- 172.21.15.145:0/4212392789 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94571081311600] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c037040 con 0x56030bb486c0 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.772+0000 7f84a4d0c800 20 remove_watcher() i=6 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.772+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571081315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030bb4f500 con 0x7f8494068c50 2024-09-10T04:50:26.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.773+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94571081315152] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f849c041040 con 0x7f8494068c50 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.773+0000 7f84a4d0c800 20 remove_watcher() i=7 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb43480 msgr2=0x56030bb45940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb43480 0x56030bb45940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030bb3f250 msgr2=0x56030bb416e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030bb3f250 0x56030bb416e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8494068c50 msgr2=0x7f849406d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8494068c50 0x7f849406d7a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56030bb486c0 msgr2=0x56030bb4aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56030bb486c0 0x56030bb4aaf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f836c03c920 msgr2=0x7f836c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f836c03c920 0x7f836c03ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f848c00ffd0 tx=0x7f848c023040 comp rx=0 tx=0).stop 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 msgr2=0x56030bb33d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a2ff7640 1 -- 172.21.15.145:0/4212392789 reap_dead start 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8494079fd0 tx=0x7f8494067f30 comp rx=0 tx=0).stop 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 shutdown_connections 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/4212392789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb2c8c0 0x56030bb33d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 >> 172.21.15.145:0/4212392789 conn(0x56030bb28cc0 msgr2=0x56030bb26ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 shutdown_connections 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/4212392789 wait complete. 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 msgr2=0x7f837c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 0x7f837c03eba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x56030bb03de0 tx=0x7f848c006000 comp rx=0 tx=0).stop 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 msgr2=0x56030bb203c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8494095b50 tx=0x7f8494050fe0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 shutdown_connections 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f837c03c6e0 0x7f837c03eba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/1285235034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030bb1ffa0 0x56030bb203c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 >> 172.21.15.145:0/1285235034 conn(0x56030bb14350 msgr2=0x56030bb14730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 shutdown_connections 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.774+0000 7f84a4d0c800 1 -- 172.21.15.145:0/1285235034 wait complete. 2024-09-10T04:50:26.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb0a300 msgr2=0x56030bb0c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56030bb0a300 0x56030bb0c750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030ba07de0 msgr2=0x56030bb09480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56030ba07de0 0x56030bb09480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56030bb0fb20 msgr2=0x56030bb11f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56030bb0fb20 0x56030bb11f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f838803c780 msgr2=0x7f838803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f838803c780 0x7f838803ec40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c0013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 msgr2=0x56030bb01e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 --2- 172.21.15.145:0/3463361834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56030ba074a0 0x56030bb01e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8494025da0 tx=0x7f8494002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a2ff7640 1 -- 172.21.15.145:0/3463361834 reap_dead start 2024-09-10T04:50:26.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 shutdown_connections 2024-09-10T04:50:26.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 >> 172.21.15.145:0/3463361834 conn(0x56030ba031b0 msgr2=0x56030baf4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 shutdown_connections 2024-09-10T04:50:26.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.775+0000 7f84a4d0c800 1 -- 172.21.15.145:0/3463361834 wait complete. 2024-09-10T04:50:26.795 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-10T04:50:26.795 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T04:50:26.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-10T04:50:26.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-10T04:50:26.796 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-10T04:50:26.841 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:26.841 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.839+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.839+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf9813800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5638942a64c0 0x5638942a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf9813800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563894151e40 con 0x5638942a6e00 2024-09-10T04:50:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf9813800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x56389411c680 con 0x5638942a64c0 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf4f48640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5638942a64c0 0x5638942a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf4f48640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5638942a64c0 0x5638942a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51096/0 (socket says 172.21.15.145:51096) 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf4f48640 1 -- 172.21.15.145:0/649852441 learned_addr learned my addr 172.21.15.145:0/649852441 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf4f48640 1 -- 172.21.15.145:0/649852441 >> v1:172.21.15.98:6789/0 conn(0x5638942a6e00 legacy=0x5638942a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cf4f48640 1 -- 172.21.15.145:0/649852441 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638941386b0 con 0x5638942a64c0 2024-09-10T04:50:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.840+0000 7f9cef7fe640 1 -- 172.21.15.145:0/649852441 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138454976 0 0) 0x563894151e40 con 0x5638942a6e00 2024-09-10T04:50:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.842+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/649852441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638942a68c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800a520 tx=0x7f9ce8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da49eac96c866b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.842+0000 7f9cef7fe640 1 -- 172.21.15.145:0/649852441 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8055070 con 0x5638942a64c0 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.842+0000 7f9cef7fe640 1 -- 172.21.15.145:0/649852441 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce80515b0 con 0x5638942a64c0 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.842+0000 7f9cef7fe640 1 -- 172.21.15.145:0/649852441 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce80518d0 con 0x5638942a64c0 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 -- 172.21.15.145:0/649852441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 msgr2=0x5638942a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 --2- 172.21.15.145:0/649852441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638942a68c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800a520 tx=0x7f9ce8045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 -- 172.21.15.145:0/649852441 shutdown_connections 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 --2- 172.21.15.145:0/649852441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638942a68c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 -- 172.21.15.145:0/649852441 >> 172.21.15.145:0/649852441 conn(0x5638942a21f0 msgr2=0x5638942a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 -- 172.21.15.145:0/649852441 shutdown_connections 2024-09-10T04:50:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.843+0000 7f9cf9813800 1 -- 172.21.15.145:0/649852441 wait complete. 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf9813800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf9813800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563894140dd0 con 0x5638942a64c0 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.857+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51112/0 (socket says 172.21.15.145:51112) 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9cf4f48640 1 -- 172.21.15.145:0/2755237004 learned_addr learned my addr 172.21.15.145:0/2755237004 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9cf4f48640 1 -- 172.21.15.145:0/2755237004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563894159e10 con 0x5638942a64c0 2024-09-10T04:50:26.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/2755237004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8045be0 tx=0x7f9ce8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256263d427b9c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9be2e05640 1 -- 172.21.15.145:0/2755237004 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8051ac0 con 0x5638942a64c0 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9be2e05640 1 -- 172.21.15.145:0/2755237004 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce8051c60 con 0x5638942a64c0 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.858+0000 7f9be2e05640 1 -- 172.21.15.145:0/2755237004 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8066460 con 0x5638942a64c0 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 -- 172.21.15.145:0/2755237004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 msgr2=0x563894399620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 --2- 172.21.15.145:0/2755237004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8045be0 tx=0x7f9ce8051000 comp rx=0 tx=0).stop 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 -- 172.21.15.145:0/2755237004 shutdown_connections 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 --2- 172.21.15.145:0/2755237004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x563894399620 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 -- 172.21.15.145:0/2755237004 >> 172.21.15.145:0/2755237004 conn(0x5638942a21f0 msgr2=0x563894394fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 -- 172.21.15.145:0/2755237004 shutdown_connections 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.859+0000 7f9cf9813800 1 -- 172.21.15.145:0/2755237004 wait complete. 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf9813800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638943a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf9813800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5638942a7d20 con 0x5638942a64c0 2024-09-10T04:50:26.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638943a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638943a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51122/0 (socket says 172.21.15.145:51122) 2024-09-10T04:50:26.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.860+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3478681726 learned_addr learned my addr 172.21.15.145:0/3478681726 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638943a1440 con 0x5638942a64c0 2024-09-10T04:50:26.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638943a0ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8045be0 tx=0x7f9ce8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9be1602640 1 -- 172.21.15.145:0/3478681726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce805a600 con 0x5638942a64c0 2024-09-10T04:50:26.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9be1602640 1 -- 172.21.15.145:0/3478681726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce805a7a0 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9be1602640 1 -- 172.21.15.145:0/3478681726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce805aa80 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638943a16d0 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.861+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638943a20d0 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9be1602640 1 -- 172.21.15.145:0/3478681726 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9ce8058070 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9be1602640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bdc03c780 0x7f9bdc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9be1602640 1 -- 172.21.15.145:0/3478681726 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9ce8062070 con 0x5638942a64c0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bdc03c780 0x7f9bdc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638942a6e00 0x5638943a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943a8a70 con 0x5638942a6e00 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.862+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638942a6e00 0x5638943a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bdc03c780 0x7f9bdc03ec40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000f60 tx=0x7f9ce00013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638942a6e00 0x5638943a8530 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9cf5749640 1 -- 172.21.15.145:0/3478681726 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638942a6e00 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943a9320 0x5638943ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943abf50 con 0x5638943a9320 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.863+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943a9320 0x5638943ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.864+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943a9320 0x5638943ab7e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.864+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3478681726 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943a9320 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.864+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943ad800 con 0x5638942a6e00 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9cf5749640 1 -- 172.21.15.145:0/3478681726 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638942a6e00 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943aca30 con 0x5638943a9320 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3478681726 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943a9320 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5638943aebb0 0x5638943b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943b14e0 con 0x5638943aebb0 2024-09-10T04:50:26.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5638943aebb0 0x5638943b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5638943aebb0 0x5638943b0fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.865+0000 7f9ceffff640 1 -- 172.21.15.145:0/3478681726 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ce0010540 con 0x5638943aebb0 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf9813800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf9813800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56389419ea00 con 0x5638943bf030 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51128/0 (socket says 172.21.15.145:51128) 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf4f48640 1 -- 172.21.15.145:0/212530106 learned_addr learned my addr 172.21.15.145:0/212530106 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.866+0000 7f9cf4f48640 1 -- 172.21.15.145:0/212530106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638943bfa90 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8065b40 tx=0x7f9ce8065f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9bda7fc640 1 -- 172.21.15.145:0/212530106 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce807a520 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9bda7fc640 1 -- 172.21.15.145:0/212530106 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce807a6c0 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638943c02c0 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9bda7fc640 1 -- 172.21.15.145:0/212530106 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8095120 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.867+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638943c02c0 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9bda7fc640 1 -- 172.21.15.145:0/212530106 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9ce804f070 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9bda7fc640 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 0x7f9bcc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9bda7fc640 1 -- 172.21.15.145:0/212530106 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9ce808f070 con 0x5638943bf030 2024-09-10T04:50:26.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9ceffff640 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 0x7f9bcc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9ceffff640 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 0x7f9bcc03ec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c010 tx=0x7f9ce0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf9813800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf9813800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563894399db0 con 0x5638943cb6e0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51132/0 (socket says 172.21.15.145:51132) 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.868+0000 7f9cf4f48640 1 -- 172.21.15.145:0/1474553832 learned_addr learned my addr 172.21.15.145:0/1474553832 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf4f48640 1 -- 172.21.15.145:0/1474553832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638943cc0d0 con 0x5638943cb6e0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/1474553832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ce804e010 tx=0x7f9ce80a03f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287b36b2409b9246 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9bcbfff640 1 -- 172.21.15.145:0/1474553832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8064880 con 0x5638943cb6e0 2024-09-10T04:50:26.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9bcbfff640 1 -- 172.21.15.145:0/1474553832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce807b3f0 con 0x5638943cb6e0 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9bcbfff640 1 -- 172.21.15.145:0/1474553832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce8064a20 con 0x5638943cb6e0 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf9813800 1 -- 172.21.15.145:0/1474553832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 msgr2=0x5638943cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf9813800 1 --2- 172.21.15.145:0/1474553832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ce804e010 tx=0x7f9ce80a03f0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf9813800 1 -- 172.21.15.145:0/1474553832 shutdown_connections 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf9813800 1 --2- 172.21.15.145:0/1474553832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943cbae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.869+0000 7f9cf9813800 1 -- 172.21.15.145:0/1474553832 >> 172.21.15.145:0/1474553832 conn(0x5638943c7ae0 msgr2=0x5638943c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 -- 172.21.15.145:0/1474553832 shutdown_connections 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 -- 172.21.15.145:0/1474553832 wait complete. 2024-09-10T04:50:26.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 Processor -- start 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 -- start start 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf9813800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5638943cc540 con 0x5638943cb6e0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf4f48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51144/0 (socket says 172.21.15.145:51144) 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.870+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 learned_addr learned my addr 172.21.15.145:0/3792945059 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638943d30c0 con 0x5638943cb6e0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ce807aa40 tx=0x7f9ce804dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9bca7fc640 1 -- 172.21.15.145:0/3792945059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce80b3040 con 0x5638943cb6e0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9bca7fc640 1 -- 172.21.15.145:0/3792945059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce8064360 con 0x5638943cb6e0 2024-09-10T04:50:26.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638943d30c0 con 0x5638943cb6e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9bca7fc640 1 -- 172.21.15.145:0/3792945059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce805b9e0 con 0x5638943cb6e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.871+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638943d36c0 con 0x5638943cb6e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.872+0000 7f9bca7fc640 1 -- 172.21.15.145:0/3792945059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9ce80c0020 con 0x5638943cb6e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.872+0000 7f9bca7fc640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bc003c780 0x7f9bc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.872+0000 7f9bca7fc640 1 -- 172.21.15.145:0/3792945059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9ce80be020 con 0x5638943cb6e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.872+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bc003c780 0x7f9bc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bc003c780 0x7f9bc003ec40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5638943a2e30 tx=0x7f9ce0022040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638943de0e0 0x5638943e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e0cf0 con 0x5638943de0e0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638943de0e0 0x5638943e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638943de0e0 0x5638943e05a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.873+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 realm 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943dd410 con 0x5638943de0e0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e1780 con 0x5638943de0e0 2024-09-10T04:50:26.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943e2560 0x5638943e4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e4fb0 con 0x5638943e2560 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.874+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943e2560 0x5638943e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943e2560 0x5638943e4950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e5800 con 0x5638943de0e0 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 20 searching for the correct realm 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5638943e7570 0x5638943e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5638943e7570 0x5638943e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.875+0000 7f9ceffff640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5638943e7570 0x5638943e9980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9cf4f48640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9ce805a070 0x7f9ce80a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:26.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9ce805a070 0x7f9ce80a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.876+0000 7f9cf5749640 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9ce805a070 0x7f9ce80a87b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9cf000a4d0 con 0x7f9ce805a070 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.877+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.878+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf000a4d0 con 0x5638943de0e0 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x7f9ce805a070 2024-09-10T04:50:26.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9cf0030040 con 0x7f9ce805a070 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.879+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.880+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.881+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x7f9ce805a070 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943de0e0 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x7f9ce805a070 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.882+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x7f9ce805a070 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cf0030040 con 0x7f9ce805a070 2024-09-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.883+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e7570 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea050 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:26.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e61b0 con 0x5638943de0e0 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cf0030040 con 0x5638943de0e0 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.884+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e6a50 con 0x5638943e2560 2024-09-10T04:50:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943e5df0 con 0x7f9ce805a070 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 zone default found 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 4 Realm: () 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 zonegroup default 2024-09-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943ea4d0 con 0x7f9ce805a070 2024-09-10T04:50:26.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.885+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943ebfc0 con 0x5638943e7570 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943ec8a0 con 0x5638943e7570 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 20 started sync module instance, tier type = 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:26.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.886+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb360 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.888+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.888+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801005295488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb360 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.888+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ed0f0 con 0x5638943de0e0 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.889+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.889+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801005300800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ed510 con 0x5638943de0e0 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.889+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943edfc0 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.889+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801005295488] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.890+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801005300800] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.890+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.890+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801005293232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ed060 con 0x5638943e2560 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.890+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ee860 con 0x7f9ce805a070 2024-09-10T04:50:26.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.891+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801005293232] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.891+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.891+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801005304480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ed060 con 0x7f9ce805a070 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.891+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eef50 con 0x5638943e2560 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.892+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801005304480] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.892+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.892+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801005308416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eef10 con 0x5638943e2560 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.892+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ef960 con 0x5638943e7570 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.893+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.893+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801005308416] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.893+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801005311152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f0200 con 0x5638943e7570 2024-09-10T04:50:26.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.893+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f07f0 con 0x5638943e7570 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.894+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801005311152] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.895+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.895+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801005306720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f0be0 con 0x5638943e7570 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.895+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f15a0 con 0x7f9ce805a070 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801005318384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f1510 con 0x7f9ce805a070 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=0 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=1 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=2 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=3 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=4 2024-09-10T04:50:26.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=5 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801005306720] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.897+0000 7f9cf9813800 20 add_watcher() i=6 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801005318384] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf9813800 20 add_watcher() i=7 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf9813800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638943efd50 con 0x5638943de0e0 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.898+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801005320512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943efd50 con 0x5638943de0e0 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.899+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801005320512] v32'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.899+0000 7f9baafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.899+0000 7f9cf9813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:26.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.899+0000 7f9cf9813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:26.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.900+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fd3e0 con 0x5638943e2560 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.901+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.901+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fd3e0 con 0x7f9ce805a070 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.902+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.902+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fd3e0 con 0x5638943e7570 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.903+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.903+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fd3e0 con 0x5638943de0e0 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.904+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'33 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.904+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fe520 con 0x5638943e2560 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.905+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.905+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fe520 con 0x5638943e7570 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.906+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.906+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fe8e0 con 0x5638943e2560 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.908+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.908+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fecb0 con 0x5638943de0e0 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.909+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.909+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fca50 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.910+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.910+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fca50 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.913+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.913+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc880 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.915+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.915+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc880 con 0x5638943e7570 2024-09-10T04:50:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.916+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.916+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ff740 con 0x5638943e2560 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.918+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.918+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ff740 con 0x5638943de0e0 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.919+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.919+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ff740 con 0x5638943de0e0 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.920+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.920+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ff7d0 con 0x5638943e2560 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.921+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.921+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ffdc0 con 0x5638943e2560 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.922+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.922+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ffce0 con 0x5638943e7570 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.924+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.924+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ffca0 con 0x5638943e2560 2024-09-10T04:50:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.924+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.924+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ffca0 con 0x5638943de0e0 2024-09-10T04:50:26.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.925+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.925+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e2560 2024-09-10T04:50:26.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.927+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.927+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e2560 2024-09-10T04:50:26.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.928+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.928+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e7570 2024-09-10T04:50:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.929+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.929+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e2560 2024-09-10T04:50:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.930+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.930+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e7570 2024-09-10T04:50:26.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.931+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.931+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e7570 2024-09-10T04:50:26.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.932+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.932+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e7570 2024-09-10T04:50:26.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.933+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.933+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e2560 2024-09-10T04:50:26.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.934+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.934+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943de0e0 2024-09-10T04:50:26.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.935+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.935+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943e2560 2024-09-10T04:50:26.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.936+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.936+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x5638943de0e0 2024-09-10T04:50:26.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.937+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.937+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943fc3d0 con 0x7f9ce805a070 2024-09-10T04:50:26.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.938+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9ba9fe3640 20 reqs_thread_entry: start 2024-09-10T04:50:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 20 Filter name: none 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9b1b7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 20 rados->read ofs=0 len=0 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389442ab20 con 0x7f9ce805a070 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.939+0000 7f9cf9813800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T04:50:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.940+0000 7f9baafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.940+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801005320512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943ff0e0 con 0x5638943de0e0 2024-09-10T04:50:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.941+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94801005320512] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.941+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801005295488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943f1940 con 0x5638943e2560 2024-09-10T04:50:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.942+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94801005295488] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.942+0000 7f9cf9813800 20 remove_watcher() i=0 2024-09-10T04:50:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.943+0000 7f9cf9813800 2 removed watcher, disabling cache 2024-09-10T04:50:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.943+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801005300800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb780 con 0x5638943de0e0 2024-09-10T04:50:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.943+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94801005300800] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x5638943de0e0 2024-09-10T04:50:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.943+0000 7f9cf9813800 20 remove_watcher() i=1 2024-09-10T04:50:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.943+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801005293232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb780 con 0x5638943e2560 2024-09-10T04:50:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.944+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94801005293232] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.944+0000 7f9cf9813800 20 remove_watcher() i=2 2024-09-10T04:50:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.944+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801005304480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eaeb0 con 0x7f9ce805a070 2024-09-10T04:50:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.945+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94801005304480] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.945+0000 7f9cf9813800 20 remove_watcher() i=3 2024-09-10T04:50:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.945+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801005308416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb780 con 0x5638943e2560 2024-09-10T04:50:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.946+0000 7f9cf4f48640 1 -- 172.21.15.145:0/3792945059 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94801005308416] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce8057030 con 0x5638943e2560 2024-09-10T04:50:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.946+0000 7f9cf9813800 20 remove_watcher() i=4 2024-09-10T04:50:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.946+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801005311152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eaeb0 con 0x5638943e7570 2024-09-10T04:50:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.947+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94801005311152] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.947+0000 7f9cf9813800 20 remove_watcher() i=5 2024-09-10T04:50:26.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.947+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801005306720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eea00 con 0x5638943e7570 2024-09-10T04:50:26.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.948+0000 7f9ceffff640 1 -- 172.21.15.145:0/3792945059 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94801005306720] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0036040 con 0x5638943e7570 2024-09-10T04:50:26.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.948+0000 7f9cf9813800 20 remove_watcher() i=6 2024-09-10T04:50:26.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.948+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801005318384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638943eb780 con 0x7f9ce805a070 2024-09-10T04:50:26.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94801005318384] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cf0041040 con 0x7f9ce805a070 2024-09-10T04:50:26.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 20 remove_watcher() i=7 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943e2560 msgr2=0x5638943e4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943e2560 0x5638943e4950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638943de0e0 msgr2=0x5638943e05a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638943de0e0 0x5638943e05a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9ce805a070 msgr2=0x7f9ce80a87b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9ce805a070 0x7f9ce80a87b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5638943e7570 msgr2=0x5638943e9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5638943e7570 0x5638943e9980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bc003c780 msgr2=0x7f9bc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bc003c780 0x7f9bc003ec40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5638943a2e30 tx=0x7f9ce0022040 comp rx=0 tx=0).stop 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 msgr2=0x5638943d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf5749640 1 -- 172.21.15.145:0/3792945059 reap_dead start 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ce807aa40 tx=0x7f9ce804dee0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 shutdown_connections 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3792945059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943cb6e0 0x5638943d2b60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 >> 172.21.15.145:0/3792945059 conn(0x5638943c7ae0 msgr2=0x5638943c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 shutdown_connections 2024-09-10T04:50:26.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.949+0000 7f9cf9813800 1 -- 172.21.15.145:0/3792945059 wait complete. 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 msgr2=0x7f9bcc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 0x7f9bcc03ec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c010 tx=0x7f9ce0006000 comp rx=0 tx=0).stop 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 msgr2=0x5638943bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8065b40 tx=0x7f9ce8065f80 comp rx=0 tx=0).stop 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 shutdown_connections 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bcc03c780 0x7f9bcc03ec40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/212530106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638943bf030 0x5638943bf450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 >> 172.21.15.145:0/212530106 conn(0x5638943b33e0 msgr2=0x5638943b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 shutdown_connections 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/212530106 wait complete. 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943a9320 msgr2=0x5638943ab7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5638943a9320 0x5638943ab7e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638942a6e00 msgr2=0x5638943a8530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5638942a6e00 0x5638943a8530 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5638943aebb0 msgr2=0x5638943b0fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5638943aebb0 0x5638943b0fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bdc03c780 msgr2=0x7f9bdc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9bdc03c780 0x7f9bdc03ec40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000f60 tx=0x7f9ce00013f0 comp rx=0 tx=0).stop 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 msgr2=0x5638943a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 --2- 172.21.15.145:0/3478681726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5638942a64c0 0x5638943a0ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8045be0 tx=0x7f9ce8003020 comp rx=0 tx=0).stop 2024-09-10T04:50:26.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf5749640 1 -- 172.21.15.145:0/3478681726 reap_dead start 2024-09-10T04:50:26.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 shutdown_connections 2024-09-10T04:50:26.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 >> 172.21.15.145:0/3478681726 conn(0x5638942a21f0 msgr2=0x56389439a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:26.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 shutdown_connections 2024-09-10T04:50:26.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:26.950+0000 7f9cf9813800 1 -- 172.21.15.145:0/3478681726 wait complete. 2024-09-10T04:50:26.961 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T04:50:26.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-10T04:50:26.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-10T04:50:26.962 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-10T04:50:27.006 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.006 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a7538800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55612549b4d0 0x55612549b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a7538800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556125346e40 con 0x55612549be10 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a7538800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x556125311680 con 0x55612549b4d0 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a3281640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55612549b4d0 0x55612549b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a3281640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55612549b4d0 0x55612549b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51148/0 (socket says 172.21.15.145:51148) 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a2a80640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55612549be10 0x55612549c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60284/0 (socket says 172.21.15.145:60284) 2024-09-10T04:50:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.005+0000 7f06a3281640 1 -- 172.21.15.145:0/4159668453 learned_addr learned my addr 172.21.15.145:0/4159668453 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.006+0000 7f06a3281640 1 -- 172.21.15.145:0/4159668453 >> v1:172.21.15.98:6789/0 conn(0x55612549be10 legacy=0x55612549c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.006+0000 7f06a3281640 1 -- 172.21.15.145:0/4159668453 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55612532d6b0 con 0x55612549b4d0 2024-09-10T04:50:27.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.006+0000 7f06a227f640 1 -- 172.21.15.145:0/4159668453 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530370965 0 0) 0x556125346e40 con 0x55612549be10 2024-09-10T04:50:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.007+0000 7f06a3281640 1 --2- 172.21.15.145:0/4159668453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612549b8d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759122a4c0b03389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.007+0000 7f06a227f640 1 -- 172.21.15.145:0/4159668453 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c04e600 con 0x55612549b4d0 2024-09-10T04:50:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a227f640 1 -- 172.21.15.145:0/4159668453 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c04e7a0 con 0x55612549b4d0 2024-09-10T04:50:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a227f640 1 -- 172.21.15.145:0/4159668453 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c04eaa0 con 0x55612549b4d0 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 -- 172.21.15.145:0/4159668453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 msgr2=0x55612549b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 --2- 172.21.15.145:0/4159668453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612549b8d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c045cf0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 -- 172.21.15.145:0/4159668453 shutdown_connections 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 --2- 172.21.15.145:0/4159668453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612549b8d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 -- 172.21.15.145:0/4159668453 >> 172.21.15.145:0/4159668453 conn(0x5561254971c0 msgr2=0x556125499620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 -- 172.21.15.145:0/4159668453 shutdown_connections 2024-09-10T04:50:27.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.008+0000 7f06a7538800 1 -- 172.21.15.145:0/4159668453 wait complete. 2024-09-10T04:50:27.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a7538800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a7538800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556125335dd0 con 0x55612549b4d0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51162/0 (socket says 172.21.15.145:51162) 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a3281640 1 -- 172.21.15.145:0/830570371 learned_addr learned my addr 172.21.15.145:0/830570371 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.022+0000 7f06a3281640 1 -- 172.21.15.145:0/830570371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55612534ee10 con 0x55612549b4d0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.023+0000 7f06a3281640 1 --2- 172.21.15.145:0/830570371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c90c12df4b418e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.023+0000 7f059160a640 1 -- 172.21.15.145:0/830570371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c04ea80 con 0x55612549b4d0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.023+0000 7f059160a640 1 -- 172.21.15.145:0/830570371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c066070 con 0x55612549b4d0 2024-09-10T04:50:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.023+0000 7f059160a640 1 -- 172.21.15.145:0/830570371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c04edc0 con 0x55612549b4d0 2024-09-10T04:50:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- 172.21.15.145:0/830570371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 msgr2=0x55612558e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 --2- 172.21.15.145:0/830570371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c050000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- 172.21.15.145:0/830570371 shutdown_connections 2024-09-10T04:50:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 --2- 172.21.15.145:0/830570371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x55612558e650 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- 172.21.15.145:0/830570371 >> 172.21.15.145:0/830570371 conn(0x5561254971c0 msgr2=0x556125589fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- 172.21.15.145:0/830570371 shutdown_connections 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- 172.21.15.145:0/830570371 wait complete. 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x556125595e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a7538800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55612549cd30 con 0x55612549b4d0 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x556125595e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x556125595e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51168/0 (socket says 172.21.15.145:51168) 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.024+0000 7f06a3281640 1 -- 172.21.15.145:0/2591215558 learned_addr learned my addr 172.21.15.145:0/2591215558 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f06a3281640 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556125596370 con 0x55612549b4d0 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f06a3281640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x556125595e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f058fe07640 1 -- 172.21.15.145:0/2591215558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c06d550 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f058fe07640 1 -- 172.21.15.145:0/2591215558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c071030 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556125596600 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f058fe07640 1 -- 172.21.15.145:0/2591215558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c06d820 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.025+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556125597000 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f058fe07640 1 -- 172.21.15.145:0/2591215558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f069c06dad0 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f058fe07640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f058803c730 0x7f058803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f058fe07640 1 -- 172.21.15.145:0/2591215558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f069c098430 con 0x55612549b4d0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f06a2a80640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f058803c730 0x7f058803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55612549be10 0x55612559d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.026+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55612559d9a0 con 0x55612549be10 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a3a82640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55612549be10 0x55612559d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a2a80640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f058803c730 0x7f058803ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f068c000c00 tx=0x7f068c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a3a82640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55612549be10 0x55612559d460 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a3a82640 1 -- 172.21.15.145:0/2591215558 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06940083e0 con 0x55612549be10 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55612559e250 0x5561255a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255a0e50 con 0x55612559e250 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.027+0000 7f06a3281640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55612559e250 0x5561255a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.028+0000 7f06a3281640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55612559e250 0x5561255a06e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.028+0000 7f06a3281640 1 -- 172.21.15.145:0/2591215558 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f069c07d070 con 0x55612559e250 2024-09-10T04:50:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.028+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255a2700 con 0x55612549be10 2024-09-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.028+0000 7f06a3a82640 1 -- 172.21.15.145:0/2591215558 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06940083e0 con 0x55612549be10 2024-09-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.028+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255a1930 con 0x55612559e250 2024-09-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a3281640 1 -- 172.21.15.145:0/2591215558 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f069c07d070 con 0x55612559e250 2024-09-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561255a3ab0 0x5561255a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255a63e0 con 0x5561255a3ab0 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a2a80640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561255a3ab0 0x5561255a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a2a80640 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561255a3ab0 0x5561255a5ea0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.029+0000 7f06a2a80640 1 -- 172.21.15.145:0/2591215558 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f068c00f670 con 0x5561255a3ab0 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a7538800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a7538800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556125393a00 con 0x5561255b3f30 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51182/0 (socket says 172.21.15.145:51182) 2024-09-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a3281640 1 -- 172.21.15.145:0/1196044283 learned_addr learned my addr 172.21.15.145:0/1196044283 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a3281640 1 -- 172.21.15.145:0/1196044283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561255b4990 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.030+0000 7f06a3281640 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f069c096790 tx=0x7f069c06de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f058d602640 1 -- 172.21.15.145:0/1196044283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c061a80 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f058d602640 1 -- 172.21.15.145:0/1196044283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c05c040 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f058d602640 1 -- 172.21.15.145:0/1196044283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c06a540 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561255b51c0 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561255b5760 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.031+0000 7f058d602640 1 -- 172.21.15.145:0/1196044283 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f069c08f170 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f058d602640 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 0x7f057c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f058d602640 1 -- 172.21.15.145:0/1196044283 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f069c081040 con 0x5561255b3f30 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 0x7f057c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 0x7f057c03ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556125597d20 tx=0x7f068c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a7538800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a7538800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55612558ede0 con 0x5561255c08d0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51188/0 (socket says 172.21.15.145:51188) 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.032+0000 7f06a3281640 1 -- 172.21.15.145:0/653977191 learned_addr learned my addr 172.21.15.145:0/653977191 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a3281640 1 -- 172.21.15.145:0/653977191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561255c12a0 con 0x5561255c08d0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a3281640 1 --2- 172.21.15.145:0/653977191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f069c06daa0 tx=0x7f069c075590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f345e4f596619b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f0586ffd640 1 -- 172.21.15.145:0/653977191 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c076420 con 0x5561255c08d0 2024-09-10T04:50:27.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f0586ffd640 1 -- 172.21.15.145:0/653977191 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c06bb70 con 0x5561255c08d0 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f0586ffd640 1 -- 172.21.15.145:0/653977191 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c096b70 con 0x5561255c08d0 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 -- 172.21.15.145:0/653977191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 msgr2=0x5561255c0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 --2- 172.21.15.145:0/653977191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f069c06daa0 tx=0x7f069c075590 comp rx=0 tx=0).stop 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 -- 172.21.15.145:0/653977191 shutdown_connections 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 --2- 172.21.15.145:0/653977191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c0cb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 -- 172.21.15.145:0/653977191 >> 172.21.15.145:0/653977191 conn(0x5561255bccd0 msgr2=0x5561255baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 -- 172.21.15.145:0/653977191 shutdown_connections 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.033+0000 7f06a7538800 1 -- 172.21.15.145:0/653977191 wait complete. 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a7538800 1 Processor -- start 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a7538800 1 -- start start 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a7538800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a7538800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561255c1730 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a3281640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51196/0 (socket says 172.21.15.145:51196) 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 learned_addr learned my addr 172.21.15.145:0/1245810781 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561255c8270 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.034+0000 7f06a3281640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f069c0955e0 tx=0x7f069c067f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f05857fa640 1 -- 172.21.15.145:0/1245810781 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c0bc070 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f05857fa640 1 -- 172.21.15.145:0/1245810781 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c075c60 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f05857fa640 1 -- 172.21.15.145:0/1245810781 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c004730 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561255c8270 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561255c8270 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.035+0000 7f05857fa640 1 -- 172.21.15.145:0/1245810781 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f069c0bf070 con 0x5561255c08d0 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f05857fa640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f056c03c730 0x7f056c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f05857fa640 1 -- 172.21.15.145:0/1245810781 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f069c0b4070 con 0x5561255c08d0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f056c03c730 0x7f056c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f056c03c730 0x7f056c03ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f068c00ffd0 tx=0x7f068c023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561255d3250 0x5561255d5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255d5e60 con 0x5561255d3250 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.036+0000 7f06a3a82640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561255d3250 0x5561255d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a3a82640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561255d3250 0x5561255d5710 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06940083e0 con 0x5561255d3250 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 realm 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255d2580 con 0x5561255d3250 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06940083e0 con 0x5561255d3250 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255d68f0 con 0x5561255d3250 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06940083e0 con 0x5561255d3250 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561255d76d0 0x5561255d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.037+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255da120 con 0x5561255d76d0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a3281640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561255d76d0 0x5561255d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a3281640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561255d76d0 0x5561255d9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06940083e0 con 0x5561255d3250 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 20 searching for the correct realm 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561255dc6e0 0x5561255deb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.038+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255df1e0 con 0x5561255dc6e0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561255dc6e0 0x5561255deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a2a80640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561255dc6e0 0x5561255deb10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255df1e0 con 0x5561255d76d0 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a3281640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f069c0c1060 0x7f069c058950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.039+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255df1e0 con 0x7f069c0c1060 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f069c0c1060 0x7f069c058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f069c0c1060 0x7f069c058950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06940083e0 con 0x7f069c0c1060 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06940083e0 con 0x5561255d3250 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.040+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.041+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x7f069c0c1060 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x7f069c0c1060 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.042+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.043+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.044+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x7f069c0c1060 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.045+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x7f069c0c1060 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x7f069c0c1060 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.046+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255dc6e0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561255da970 con 0x5561255d76d0 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.047+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255db1c0 con 0x5561255d3250 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255db5b0 con 0x5561255d76d0 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255db5b0 con 0x7f069c0c1060 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 zone default found 2024-09-10T04:50:27.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 4 Realm: () 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 zonegroup default 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255dadf0 con 0x7f069c0c1060 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.048+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255e1050 con 0x5561255dc6e0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255e13f0 con 0x5561255dc6e0 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 started sync module instance, tier type = 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:27.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.049+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e04f0 con 0x5561255d76d0 2024-09-10T04:50:27.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.051+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.051+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93875727108624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e04f0 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.051+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e1e60 con 0x5561255d3250 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.052+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93875727108624] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.052+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.052+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93875727112528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e04f0 con 0x5561255d3250 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.052+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e2910 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.053+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.053+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93875727115248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e2910 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.053+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93875727112528] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.053+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e38f0 con 0x7f069c0c1060 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.054+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.054+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93875727119360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e38f0 con 0x7f069c0c1060 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.054+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e4340 con 0x5561255d76d0 2024-09-10T04:50:27.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.054+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93875727115248] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.055+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93875727119360] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.055+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.055+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93875727106112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e3e50 con 0x5561255d76d0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.055+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e4c10 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.056+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93875727106112] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.056+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.056+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93875727124320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e3e50 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.056+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e55d0 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.057+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.057+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93875727129024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e6290 con 0x5561255dc6e0 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.057+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e6ce0 con 0x7f069c0c1060 2024-09-10T04:50:27.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.058+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93875727124320] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93875727132624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e6ca0 con 0x7f069c0c1060 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=0 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=1 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=2 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=3 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=4 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=5 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93875727129024] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.060+0000 7f06a7538800 20 add_watcher() i=6 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93875727132624] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a7538800 20 add_watcher() i=7 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a7538800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561255e5de0 con 0x5561255d3250 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.061+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93875727117456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e5de0 con 0x5561255d3250 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.062+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93875727117456] v32'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.062+0000 7f0559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.062+0000 7f06a7538800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.062+0000 7f06a7538800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.062+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f25d0 con 0x5561255d76d0 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.064+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'41 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.064+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f25d0 con 0x7f069c0c1060 2024-09-10T04:50:27.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.065+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.065+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f25d0 con 0x5561255dc6e0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.066+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.066+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f3100 con 0x5561255d3250 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.067+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'38 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.067+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f3670 con 0x5561255d76d0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.068+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.068+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f3670 con 0x5561255dc6e0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.069+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.069+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f3c20 con 0x5561255d76d0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.070+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.070+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f3c20 con 0x5561255d3250 2024-09-10T04:50:27.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.071+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.071+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4190 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.073+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.073+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4190 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.074+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.074+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4190 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.075+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.075+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4190 con 0x5561255dc6e0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.076+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.076+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4700 con 0x5561255d76d0 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.077+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.077+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4700 con 0x5561255d3250 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.078+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.078+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4bb0 con 0x5561255d3250 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.079+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.079+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4bb0 con 0x5561255d76d0 2024-09-10T04:50:27.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.081+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.081+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4bb0 con 0x5561255d76d0 2024-09-10T04:50:27.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.082+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.082+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4bb0 con 0x5561255dc6e0 2024-09-10T04:50:27.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.083+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.083+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.084+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.084+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d3250 2024-09-10T04:50:27.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.085+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.085+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.086+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.086+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.087+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.087+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255dc6e0 2024-09-10T04:50:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.088+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.088+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.089+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.089+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255dc6e0 2024-09-10T04:50:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.090+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.090+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255dc6e0 2024-09-10T04:50:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.091+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.091+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255dc6e0 2024-09-10T04:50:27.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.092+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.092+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.093+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.093+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d3250 2024-09-10T04:50:27.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.094+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.094+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d76d0 2024-09-10T04:50:27.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.095+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.095+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x5561255d3250 2024-09-10T04:50:27.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.096+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.096+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f4b10 con 0x7f069c0c1060 2024-09-10T04:50:27.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.097+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.097+0000 7f0558fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:27.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.097+0000 7f06a7538800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:27.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.097+0000 7f06a7538800 20 Filter name: none 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f04d27fc640 20 reqs_thread_entry: start 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55612561fc60 con 0x7f069c0c1060 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.098+0000 7f06a7538800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T04:50:27.101 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T04:50:27.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.099+0000 7f0559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.099+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93875727117456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255f1790 con 0x5561255d3250 2024-09-10T04:50:27.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.100+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93875727117456] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.100+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93875727108624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e2c90 con 0x5561255d76d0 2024-09-10T04:50:27.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.101+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93875727108624] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.101+0000 7f06a7538800 20 remove_watcher() i=0 2024-09-10T04:50:27.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.101+0000 7f06a7538800 2 removed watcher, disabling cache 2024-09-10T04:50:27.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.101+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93875727112528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e0a10 con 0x5561255d3250 2024-09-10T04:50:27.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.102+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93875727112528] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x5561255d3250 2024-09-10T04:50:27.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.102+0000 7f06a7538800 20 remove_watcher() i=1 2024-09-10T04:50:27.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.102+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93875727115248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e1950 con 0x5561255d76d0 2024-09-10T04:50:27.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.103+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93875727115248] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.103+0000 7f06a7538800 20 remove_watcher() i=2 2024-09-10T04:50:27.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.103+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93875727119360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e23f0 con 0x7f069c0c1060 2024-09-10T04:50:27.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.104+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93875727119360] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.104+0000 7f06a7538800 20 remove_watcher() i=3 2024-09-10T04:50:27.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.104+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93875727106112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e23f0 con 0x5561255d76d0 2024-09-10T04:50:27.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.105+0000 7f06a3281640 1 -- 172.21.15.145:0/1245810781 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93875727106112] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f069c0be030 con 0x5561255d76d0 2024-09-10T04:50:27.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.105+0000 7f06a7538800 20 remove_watcher() i=4 2024-09-10T04:50:27.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.105+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93875727124320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e23f0 con 0x5561255dc6e0 2024-09-10T04:50:27.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.106+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93875727124320] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.106+0000 7f06a7538800 20 remove_watcher() i=5 2024-09-10T04:50:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.106+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93875727129024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e23f0 con 0x5561255dc6e0 2024-09-10T04:50:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.107+0000 7f06a2a80640 1 -- 172.21.15.145:0/1245810781 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93875727129024] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068c037040 con 0x5561255dc6e0 2024-09-10T04:50:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.107+0000 7f06a7538800 20 remove_watcher() i=6 2024-09-10T04:50:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.107+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93875727132624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561255e23f0 con 0x7f069c0c1060 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93875727132624] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0694025040 con 0x7f069c0c1060 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 20 remove_watcher() i=7 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561255d76d0 msgr2=0x5561255d9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561255d76d0 0x5561255d9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561255d3250 msgr2=0x5561255d5710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561255d3250 0x5561255d5710 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f069c0c1060 msgr2=0x7f069c058950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f069c0c1060 0x7f069c058950 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561255dc6e0 msgr2=0x5561255deb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561255dc6e0 0x5561255deb10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f056c03c730 msgr2=0x7f056c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f056c03c730 0x7f056c03ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f068c00ffd0 tx=0x7f068c023040 comp rx=0 tx=0).stop 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 msgr2=0x5561255c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a3a82640 1 -- 172.21.15.145:0/1245810781 reap_dead start 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.108+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f069c0955e0 tx=0x7f069c067f10 comp rx=0 tx=0).stop 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 shutdown_connections 2024-09-10T04:50:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/1245810781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255c08d0 0x5561255c7d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 >> 172.21.15.145:0/1245810781 conn(0x5561255bccd0 msgr2=0x5561255baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 shutdown_connections 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1245810781 wait complete. 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 msgr2=0x7f057c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 0x7f057c03ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556125597d20 tx=0x7f068c006000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 msgr2=0x5561255b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f069c096790 tx=0x7f069c06de90 comp rx=0 tx=0).stop 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 shutdown_connections 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f057c03c730 0x7f057c03ebf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/1196044283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561255b3f30 0x5561255b4350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 >> 172.21.15.145:0/1196044283 conn(0x5561255a82e0 msgr2=0x5561255a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 shutdown_connections 2024-09-10T04:50:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/1196044283 wait complete. 2024-09-10T04:50:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55612559e250 msgr2=0x5561255a06e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55612559e250 0x5561255a06e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55612549be10 msgr2=0x55612559d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55612549be10 0x55612559d460 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561255a3ab0 msgr2=0x5561255a5ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.109+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561255a3ab0 0x5561255a5ea0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f058803c730 msgr2=0x7f058803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f058803c730 0x7f058803ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f068c000c00 tx=0x7f068c0013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 msgr2=0x556125595e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 --2- 172.21.15.145:0/2591215558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55612549b4d0 0x556125595e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c003330 comp rx=0 tx=0).stop 2024-09-10T04:50:27.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a3a82640 1 -- 172.21.15.145:0/2591215558 reap_dead start 2024-09-10T04:50:27.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 shutdown_connections 2024-09-10T04:50:27.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 >> 172.21.15.145:0/2591215558 conn(0x5561254971c0 msgr2=0x5561255887c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 shutdown_connections 2024-09-10T04:50:27.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.110+0000 7f06a7538800 1 -- 172.21.15.145:0/2591215558 wait complete. 2024-09-10T04:50:27.120 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T04:50:27.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:27.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:27.121 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T04:50:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa82b52c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5645156e0fb0 0x5645156e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa82b52c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56451558ae40 con 0x5645156df490 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa82b52c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x564515555680 con 0x5645156e0fb0 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa826944640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5645156e0fb0 0x5645156e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa826944640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5645156e0fb0 0x5645156e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51202/0 (socket says 172.21.15.145:51202) 2024-09-10T04:50:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.165+0000 7fa826944640 1 -- 172.21.15.145:0/3125097232 learned_addr learned my addr 172.21.15.145:0/3125097232 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.166+0000 7fa826944640 1 -- 172.21.15.145:0/3125097232 >> v1:172.21.15.98:6789/0 conn(0x5645156df490 legacy=0x5645156df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.166+0000 7fa826944640 1 -- 172.21.15.145:0/3125097232 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645155716b0 con 0x5645156e0fb0 2024-09-10T04:50:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.167+0000 7fa826944640 1 --2- 172.21.15.145:0/3125097232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156e0fb0 0x5645156e9ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa81000a520 tx=0x7fa810045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdd41a2268d39d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa826143640 1 -- 172.21.15.145:0/3125097232 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa810055070 con 0x5645156e0fb0 2024-09-10T04:50:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa826143640 1 -- 172.21.15.145:0/3125097232 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8100515b0 con 0x5645156e0fb0 2024-09-10T04:50:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa826143640 1 -- 172.21.15.145:0/3125097232 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8100518d0 con 0x5645156e0fb0 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 -- 172.21.15.145:0/3125097232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156e0fb0 msgr2=0x5645156e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3125097232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156e0fb0 0x5645156e9ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa81000a520 tx=0x7fa810045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 -- 172.21.15.145:0/3125097232 shutdown_connections 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3125097232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156e0fb0 0x5645156e9ad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 -- 172.21.15.145:0/3125097232 >> 172.21.15.145:0/3125097232 conn(0x5645156db1c0 msgr2=0x5645156dd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 -- 172.21.15.145:0/3125097232 shutdown_connections 2024-09-10T04:50:27.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.168+0000 7fa82b52c800 1 -- 172.21.15.145:0/3125097232 wait complete. 2024-09-10T04:50:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa82b52c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa82b52c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564515579dd0 con 0x5645156df490 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51218/0 (socket says 172.21.15.145:51218) 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.182+0000 7fa827145640 1 -- 172.21.15.145:0/886440619 learned_addr learned my addr 172.21.15.145:0/886440619 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.183+0000 7fa827145640 1 -- 172.21.15.145:0/886440619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564515592e10 con 0x5645156df490 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.183+0000 7fa827145640 1 --2- 172.21.15.145:0/886440619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa818001d40 tx=0x7fa81800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf3f76ff650f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.183+0000 7fa71560a640 1 -- 172.21.15.145:0/886440619 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81800f400 con 0x5645156df490 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.183+0000 7fa71560a640 1 -- 172.21.15.145:0/886440619 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81800f5a0 con 0x5645156df490 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.183+0000 7fa71560a640 1 -- 172.21.15.145:0/886440619 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81800f900 con 0x5645156df490 2024-09-10T04:50:27.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- 172.21.15.145:0/886440619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 msgr2=0x5645157d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 --2- 172.21.15.145:0/886440619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa818001d40 tx=0x7fa81800b5b0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- 172.21.15.145:0/886440619 shutdown_connections 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 --2- 172.21.15.145:0/886440619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157d2860 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- 172.21.15.145:0/886440619 >> 172.21.15.145:0/886440619 conn(0x5645156db1c0 msgr2=0x5645157ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- 172.21.15.145:0/886440619 shutdown_connections 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- 172.21.15.145:0/886440619 wait complete. 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157da210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.184+0000 7fa82b52c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5645156ea2e0 con 0x5645156df490 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157da210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51230/0 (socket says 172.21.15.145:51230) 2024-09-10T04:50:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa827145640 1 -- 172.21.15.145:0/1558668970 learned_addr learned my addr 172.21.15.145:0/1558668970 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa827145640 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645157da770 con 0x5645156df490 2024-09-10T04:50:27.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa827145640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157da210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5645157d37f0 tx=0x7fa818000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa713e07640 1 -- 172.21.15.145:0/1558668970 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81801a690 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa713e07640 1 -- 172.21.15.145:0/1558668970 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81801a830 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645157daa00 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa713e07640 1 -- 172.21.15.145:0/1558668970 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81801ab50 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.185+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645157db610 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa713e07640 1 -- 172.21.15.145:0/1558668970 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa818017070 con 0x5645156df490 2024-09-10T04:50:27.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa713e07640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70c03c780 0x7fa70c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa713e07640 1 -- 172.21.15.145:0/1558668970 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa818015020 con 0x5645156df490 2024-09-10T04:50:27.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa826944640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70c03c780 0x7fa70c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5645156e0fb0 0x5645157e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.186+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645157e1da0 con 0x5645156e0fb0 2024-09-10T04:50:27.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa827946640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5645156e0fb0 0x5645157e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa826944640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70c03c780 0x7fa70c03ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa810057000 tx=0x7fa810052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa827946640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5645156e0fb0 0x5645157e1860 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa827946640 1 -- 172.21.15.145:0/1558668970 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82000a4d0 con 0x5645156e0fb0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5645157e2650 0x5645157e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645157e5230 con 0x5645157e2650 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.187+0000 7fa827145640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5645157e2650 0x5645157e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa827145640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5645157e2650 0x5645157e4ac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa827145640 1 -- 172.21.15.145:0/1558668970 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa81802e070 con 0x5645157e2650 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645157e6ae0 con 0x5645156e0fb0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa827946640 1 -- 172.21.15.145:0/1558668970 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa82000a4d0 con 0x5645156e0fb0 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645157e5d10 con 0x5645157e2650 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa827145640 1 -- 172.21.15.145:0/1558668970 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa81802e070 con 0x5645157e2650 2024-09-10T04:50:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5645157e7e90 0x5645157ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.188+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645157ea7c0 con 0x5645157e7e90 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.189+0000 7fa826944640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5645157e7e90 0x5645157ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.189+0000 7fa826944640 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5645157e7e90 0x5645157ea280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.189+0000 7fa826944640 1 -- 172.21.15.145:0/1558668970 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa810057030 con 0x5645157e7e90 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.189+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa82b52c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa82b52c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5645155d7a00 con 0x5645157f8310 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51244/0 (socket says 172.21.15.145:51244) 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa827145640 1 -- 172.21.15.145:0/1489872776 learned_addr learned my addr 172.21.15.145:0/1489872776 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa827145640 1 -- 172.21.15.145:0/1489872776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645157f8d70 con 0x5645157f8310 2024-09-10T04:50:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa827145640 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8180521b0 tx=0x7fa81804b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa711602640 1 -- 172.21.15.145:0/1489872776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81801c450 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa711602640 1 -- 172.21.15.145:0/1489872776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81801c5f0 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645157f95a0 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.190+0000 7fa711602640 1 -- 172.21.15.145:0/1489872776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81804b8f0 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.191+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645157f95a0 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.191+0000 7fa711602640 1 -- 172.21.15.145:0/1489872776 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa81800e070 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.191+0000 7fa711602640 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 0x7fa70003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.191+0000 7fa711602640 1 -- 172.21.15.145:0/1489872776 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa81803fa20 con 0x5645157f8310 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.191+0000 7fa826944640 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 0x7fa70003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa826944640 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 0x7fa70003ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5645157dc0f0 tx=0x7fa810005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa82b52c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa82b52c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5645157d30b0 con 0x564515804a50 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51258/0 (socket says 172.21.15.145:51258) 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa827145640 1 -- 172.21.15.145:0/1087439096 learned_addr learned my addr 172.21.15.145:0/1087439096 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa827145640 1 -- 172.21.15.145:0/1087439096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564515805440 con 0x564515804a50 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.192+0000 7fa827145640 1 --2- 172.21.15.145:0/1087439096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa81800bff0 tx=0x7fa818045f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2427131ef2150c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa70affd640 1 -- 172.21.15.145:0/1087439096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa818027b20 con 0x564515804a50 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa70affd640 1 -- 172.21.15.145:0/1087439096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa818031d60 con 0x564515804a50 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa70affd640 1 -- 172.21.15.145:0/1087439096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa818027430 con 0x564515804a50 2024-09-10T04:50:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- 172.21.15.145:0/1087439096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 msgr2=0x564515804e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1087439096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa81800bff0 tx=0x7fa818045f30 comp rx=0 tx=0).stop 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- 172.21.15.145:0/1087439096 shutdown_connections 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1087439096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x564515804e50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- 172.21.15.145:0/1087439096 >> 172.21.15.145:0/1087439096 conn(0x564515800e50 msgr2=0x5645157ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- 172.21.15.145:0/1087439096 shutdown_connections 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- 172.21.15.145:0/1087439096 wait complete. 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 Processor -- start 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.193+0000 7fa82b52c800 1 -- start start 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa82b52c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa82b52c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5645158058b0 con 0x564515804a50 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa827145640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51274/0 (socket says 172.21.15.145:51274) 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 learned_addr learned my addr 172.21.15.145:0/3747252344 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451580c370 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa827145640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa81800bff0 tx=0x7fa81803af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa7097fa640 1 -- 172.21.15.145:0/3747252344 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa818064030 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa7097fa640 1 -- 172.21.15.145:0/3747252344 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81802e830 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56451580c370 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa7097fa640 1 -- 172.21.15.145:0/3747252344 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81802eb10 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.194+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451580c370 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.195+0000 7fa7097fa640 1 -- 172.21.15.145:0/3747252344 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa81803a850 con 0x564515804a50 2024-09-10T04:50:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.195+0000 7fa7097fa640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6f003c780 0x7fa6f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.195+0000 7fa7097fa640 1 -- 172.21.15.145:0/3747252344 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa81805b070 con 0x564515804a50 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.195+0000 7fa826944640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6f003c780 0x7fa6f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa826944640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6f003c780 0x7fa6f003ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa810051580 tx=0x7fa81006d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564515817170 0x564515819630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564515819d80 con 0x564515817170 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa827946640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564515817170 0x564515819630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.196+0000 7fa827946640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564515817170 0x564515819630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 realm 2024-09-10T04:50:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645158164a0 con 0x564515817170 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581a810 con 0x564515817170 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56451581b5f0 0x56451581d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581e040 con 0x56451581b5f0 2024-09-10T04:50:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.197+0000 7fa827145640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56451581b5f0 0x56451581d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa827145640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56451581b5f0 0x56451581d9e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581e890 con 0x564515817170 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 20 searching for the correct realm 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564515820600 0x5645158229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.198+0000 7fa826944640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564515820600 0x5645158229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa826944640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564515820600 0x5645158229f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa827145640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa81803ab40 0x7fa818060640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa827946640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa81803ab40 0x7fa818060640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.199+0000 7fa827946640 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa81803ab40 0x7fa818060640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa82000a4d0 con 0x7fa81803ab40 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.200+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000a4d0 con 0x564515817170 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.201+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x7fa81803ab40 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa820030040 con 0x7fa81803ab40 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.202+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.203+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x7fa81803ab40 2024-09-10T04:50:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.204+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515817170 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x7fa81803ab40 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x7fa81803ab40 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa820030040 con 0x7fa81803ab40 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.205+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x564515820600 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645158230c0 con 0x56451581b5f0 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.206+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:27.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:27.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:27.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:27.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581f210 con 0x564515817170 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa820030040 con 0x564515817170 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581fab0 con 0x56451581b5f0 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451581ee50 con 0x7fa81803ab40 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 zone default found 2024-09-10T04:50:27.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 4 Realm: () 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 zonegroup default 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.207+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645158235a0 con 0x7fa81803ab40 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564515825420 con 0x564515820600 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564515825900 con 0x564515820600 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 started sync module instance, tier type = 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.208+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515824870 con 0x56451581b5f0 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.209+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.209+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94854713592928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158244d0 con 0x56451581b5f0 2024-09-10T04:50:27.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.209+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515826700 con 0x564515817170 2024-09-10T04:50:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.210+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94854713592928] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.210+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.210+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94854713597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515826b20 con 0x564515817170 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.210+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515827550 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.211+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.211+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94854713602144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515827540 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.211+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515828350 con 0x7fa81803ab40 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.212+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94854713597280] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.212+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94854713602144] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.212+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.212+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94854713598336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515827a80 con 0x7fa81803ab40 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.212+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515828a70 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.214+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94854713598336] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.214+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.214+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94854713607488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515828a30 con 0x56451581b5f0 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.214+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515829480 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.215+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94854713607488] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.215+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.215+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94854713610192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515829820 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.215+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582a220 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.216+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94854713610192] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.217+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.217+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94854713605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582aaf0 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.217+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582b4b0 con 0x7fa81803ab40 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94854713605744] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94854713618432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582b8d0 con 0x7fa81803ab40 2024-09-10T04:50:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=0 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=1 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=2 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=3 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=4 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=5 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.219+0000 7fa82b52c800 20 add_watcher() i=6 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94854713618432] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa82b52c800 20 add_watcher() i=7 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa82b52c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56451582ebb0 con 0x564515817170 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.220+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94854713619856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582be60 con 0x564515817170 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.221+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94854713619856] v32'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.221+0000 7fa6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.222+0000 7fa82b52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.222+0000 7fa82b52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.222+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158374e0 con 0x56451581b5f0 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.223+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'42 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.223+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515837540 con 0x7fa81803ab40 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.224+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.224+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515837bb0 con 0x564515820600 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.225+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.225+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515837fb0 con 0x564515817170 2024-09-10T04:50:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.226+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'43 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.226+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838520 con 0x56451581b5f0 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.227+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.227+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838520 con 0x564515820600 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.228+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.228+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838a90 con 0x56451581b5f0 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.229+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.229+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838f40 con 0x564515817170 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.230+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.230+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838f40 con 0x56451581b5f0 2024-09-10T04:50:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.232+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.232+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838f40 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.233+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.233+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838f40 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.234+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.234+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515838f40 con 0x564515820600 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.235+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.235+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158394f0 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.236+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.236+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158394d0 con 0x564515817170 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.237+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.237+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839980 con 0x564515817170 2024-09-10T04:50:27.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.239+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.239+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839980 con 0x56451581b5f0 2024-09-10T04:50:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.240+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.240+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839960 con 0x56451581b5f0 2024-09-10T04:50:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.241+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.241+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839960 con 0x564515820600 2024-09-10T04:50:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.242+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.242+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158397f0 con 0x56451581b5f0 2024-09-10T04:50:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.243+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.243+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158397f0 con 0x564515817170 2024-09-10T04:50:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.244+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.244+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158397f0 con 0x56451581b5f0 2024-09-10T04:50:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.245+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.245+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158397f0 con 0x56451581b5f0 2024-09-10T04:50:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.246+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.246+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839830 con 0x564515820600 2024-09-10T04:50:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.247+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.247+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839930 con 0x56451581b5f0 2024-09-10T04:50:27.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.248+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.248+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839930 con 0x564515820600 2024-09-10T04:50:27.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.250+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.250+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158399f0 con 0x564515820600 2024-09-10T04:50:27.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.252+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.252+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645158399f0 con 0x564515820600 2024-09-10T04:50:27.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.255+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.255+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839a30 con 0x56451581b5f0 2024-09-10T04:50:27.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.256+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.256+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839a60 con 0x564515817170 2024-09-10T04:50:27.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.257+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.257+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839a60 con 0x56451581b5f0 2024-09-10T04:50:27.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.258+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.258+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839a60 con 0x564515817170 2024-09-10T04:50:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.263+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.263+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515839a60 con 0x7fa81803ab40 2024-09-10T04:50:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.264+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa6dcfe1640 20 reqs_thread_entry: start 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 20 Filter name: none 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa6567fc640 20 reqs_thread_entry: start 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564515864980 con 0x7fa81803ab40 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T04:50:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.265+0000 7fa82b52c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T04:50:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.266+0000 7fa6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.266+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94854713619856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582d7e0 con 0x564515817170 2024-09-10T04:50:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.267+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94854713619856] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.267+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94854713592928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582b590 con 0x56451581b5f0 2024-09-10T04:50:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.268+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94854713592928] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.268+0000 7fa82b52c800 20 remove_watcher() i=0 2024-09-10T04:50:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.268+0000 7fa82b52c800 2 removed watcher, disabling cache 2024-09-10T04:50:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.268+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94854713597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582b590 con 0x564515817170 2024-09-10T04:50:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.269+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94854713597280] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x564515817170 2024-09-10T04:50:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.269+0000 7fa82b52c800 20 remove_watcher() i=1 2024-09-10T04:50:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.269+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94854713602144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515825d60 con 0x56451581b5f0 2024-09-10T04:50:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.270+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94854713602144] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.270+0000 7fa82b52c800 20 remove_watcher() i=2 2024-09-10T04:50:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.270+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94854713598336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56451582b590 con 0x7fa81803ab40 2024-09-10T04:50:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.271+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94854713598336] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.271+0000 7fa82b52c800 20 remove_watcher() i=3 2024-09-10T04:50:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.271+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94854713607488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515827060 con 0x56451581b5f0 2024-09-10T04:50:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.272+0000 7fa827145640 1 -- 172.21.15.145:0/3747252344 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94854713607488] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81806a070 con 0x56451581b5f0 2024-09-10T04:50:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.272+0000 7fa82b52c800 20 remove_watcher() i=4 2024-09-10T04:50:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.272+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94854713610192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515826210 con 0x564515820600 2024-09-10T04:50:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.273+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94854713610192] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.273+0000 7fa82b52c800 20 remove_watcher() i=5 2024-09-10T04:50:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.273+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94854713605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515826210 con 0x564515820600 2024-09-10T04:50:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.276+0000 7fa826944640 1 -- 172.21.15.145:0/3747252344 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94854713605744] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa810057030 con 0x564515820600 2024-09-10T04:50:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.276+0000 7fa82b52c800 20 remove_watcher() i=6 2024-09-10T04:50:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.276+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94854713618432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564515826210 con 0x7fa81803ab40 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.278+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94854713618432] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa820041040 con 0x7fa81803ab40 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.278+0000 7fa82b52c800 20 remove_watcher() i=7 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56451581b5f0 msgr2=0x56451581d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56451581b5f0 0x56451581d9e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564515817170 msgr2=0x564515819630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564515817170 0x564515819630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa81803ab40 msgr2=0x7fa818060640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa81803ab40 0x7fa818060640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564515820600 msgr2=0x5645158229f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564515820600 0x5645158229f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6f003c780 msgr2=0x7fa6f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa6f003c780 0x7fa6f003ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa810051580 tx=0x7fa81006d040 comp rx=0 tx=0).stop 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 msgr2=0x56451580be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa827946640 1 -- 172.21.15.145:0/3747252344 reap_dead start 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa81800bff0 tx=0x7fa81803af20 comp rx=0 tx=0).stop 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 shutdown_connections 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/3747252344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564515804a50 0x56451580be10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 >> 172.21.15.145:0/3747252344 conn(0x564515800e50 msgr2=0x5645157ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 shutdown_connections 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/3747252344 wait complete. 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 msgr2=0x7fa70003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 0x7fa70003ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5645157dc0f0 tx=0x7fa810005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 msgr2=0x5645157f8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8180521b0 tx=0x7fa81804b3f0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 shutdown_connections 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70003c780 0x7fa70003ec40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1489872776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645157f8310 0x5645157f8730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 >> 172.21.15.145:0/1489872776 conn(0x5645157ec6c0 msgr2=0x5645157ecaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 shutdown_connections 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.279+0000 7fa82b52c800 1 -- 172.21.15.145:0/1489872776 wait complete. 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5645157e2650 msgr2=0x5645157e4ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5645157e2650 0x5645157e4ac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5645156e0fb0 msgr2=0x5645157e1860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5645156e0fb0 0x5645157e1860 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5645157e7e90 msgr2=0x5645157ea280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5645157e7e90 0x5645157ea280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70c03c780 msgr2=0x7fa70c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa70c03c780 0x7fa70c03ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa810057000 tx=0x7fa810052000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 msgr2=0x5645157da210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 --2- 172.21.15.145:0/1558668970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5645156df490 0x5645157da210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5645157d37f0 tx=0x7fa818000bc0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa827946640 1 -- 172.21.15.145:0/1558668970 reap_dead start 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 shutdown_connections 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 >> 172.21.15.145:0/1558668970 conn(0x5645156db1c0 msgr2=0x5645157d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 shutdown_connections 2024-09-10T04:50:27.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.280+0000 7fa82b52c800 1 -- 172.21.15.145:0/1558668970 wait complete. 2024-09-10T04:50:27.290 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T04:50:27.291 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:27.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:27.291 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T04:50:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.374+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.374+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.374+0000 7fd34ff75800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x564979366df0 0x564979367af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.374+0000 7fd34ff75800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564979211e40 con 0x564979368030 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.374+0000 7fd34ff75800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5649791dc680 con 0x564979366df0 2024-09-10T04:50:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd34da5f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x564979366df0 0x564979367af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd347fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x564979368030 0x56497936cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60300/0 (socket says 172.21.15.145:60300) 2024-09-10T04:50:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd34da5f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x564979366df0 0x564979367af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51284/0 (socket says 172.21.15.145:51284) 2024-09-10T04:50:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd347fff640 1 -- 172.21.15.145:0/1497881985 learned_addr learned my addr 172.21.15.145:0/1497881985 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd34da5f640 1 -- 172.21.15.145:0/1497881985 >> v1:172.21.15.98:6789/0 conn(0x564979368030 legacy=0x56497936cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.375+0000 7fd34da5f640 1 -- 172.21.15.145:0/1497881985 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649791f86b0 con 0x564979366df0 2024-09-10T04:50:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34da5f640 1 --2- 172.21.15.145:0/1497881985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979367af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd34000a470 tx=0x7fd340045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4657634b0d14ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34d25e640 1 -- 172.21.15.145:0/1497881985 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340053570 con 0x564979366df0 2024-09-10T04:50:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34d25e640 1 -- 172.21.15.145:0/1497881985 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340058070 con 0x564979366df0 2024-09-10T04:50:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34d25e640 1 -- 172.21.15.145:0/1497881985 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340053880 con 0x564979366df0 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 -- 172.21.15.145:0/1497881985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 msgr2=0x564979367af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 --2- 172.21.15.145:0/1497881985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979367af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd34000a470 tx=0x7fd340045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 -- 172.21.15.145:0/1497881985 shutdown_connections 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 --2- 172.21.15.145:0/1497881985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979367af0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 -- 172.21.15.145:0/1497881985 >> 172.21.15.145:0/1497881985 conn(0x5649793621c0 msgr2=0x564979364620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 -- 172.21.15.145:0/1497881985 shutdown_connections 2024-09-10T04:50:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.377+0000 7fd34ff75800 1 -- 172.21.15.145:0/1497881985 wait complete. 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.391+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.391+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.391+0000 7fd34ff75800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.391+0000 7fd34ff75800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564979200dd0 con 0x564979366df0 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51286/0 (socket says 172.21.15.145:51286) 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd34da5f640 1 -- 172.21.15.145:0/2700389154 learned_addr learned my addr 172.21.15.145:0/2700389154 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd34da5f640 1 -- 172.21.15.145:0/2700389154 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564979219e10 con 0x564979366df0 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd34da5f640 1 --2- 172.21.15.145:0/2700389154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd340025c20 tx=0x7fd340051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c382edd2839a599 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd23be07640 1 -- 172.21.15.145:0/2700389154 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340053570 con 0x564979366df0 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd23be07640 1 -- 172.21.15.145:0/2700389154 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340063070 con 0x564979366df0 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.392+0000 7fd23be07640 1 -- 172.21.15.145:0/2700389154 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340053840 con 0x564979366df0 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- 172.21.15.145:0/2700389154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 msgr2=0x564979455460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 --2- 172.21.15.145:0/2700389154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd340025c20 tx=0x7fd340051000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- 172.21.15.145:0/2700389154 shutdown_connections 2024-09-10T04:50:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 --2- 172.21.15.145:0/2700389154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x564979455460 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- 172.21.15.145:0/2700389154 >> 172.21.15.145:0/2700389154 conn(0x5649793621c0 msgr2=0x564979450de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- 172.21.15.145:0/2700389154 shutdown_connections 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- 172.21.15.145:0/2700389154 wait complete. 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x56497945cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.393+0000 7fd34ff75800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564979368720 con 0x564979366df0 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x56497945cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x56497945cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51292/0 (socket says 172.21.15.145:51292) 2024-09-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34da5f640 1 -- 172.21.15.145:0/390130540 learned_addr learned my addr 172.21.15.145:0/390130540 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34da5f640 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497945d1e0 con 0x564979366df0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34da5f640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x56497945cc80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd340053d60 tx=0x7fd340002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd23a604640 1 -- 172.21.15.145:0/390130540 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340068470 con 0x564979366df0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd23a604640 1 -- 172.21.15.145:0/390130540 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340068610 con 0x564979366df0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56497945d470 con 0x564979366df0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd23a604640 1 -- 172.21.15.145:0/390130540 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3400688f0 con 0x564979366df0 2024-09-10T04:50:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.394+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497945de70 con 0x564979366df0 2024-09-10T04:50:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd23a604640 1 -- 172.21.15.145:0/390130540 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd340068a90 con 0x564979366df0 2024-09-10T04:50:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd23a604640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd23403c730 0x7fd23403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd23a604640 1 -- 172.21.15.145:0/390130540 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd340097f00 con 0x564979366df0 2024-09-10T04:50:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd347fff640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd23403c730 0x7fd23403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564979368030 0x5649794642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.395+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56497945ea00 con 0x564979368030 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34e260640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564979368030 0x5649794642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd347fff640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd23403c730 0x7fd23403ebf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd338001d70 tx=0x7fd3380012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34e260640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564979368030 0x5649794642d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34e260640 1 -- 172.21.15.145:0/390130540 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34800a4d0 con 0x564979368030 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564979465200 0x5649794675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564979467c50 con 0x564979465200 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.396+0000 7fd34da5f640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564979465200 0x5649794675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.397+0000 7fd34da5f640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564979465200 0x5649794675f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.397+0000 7fd34da5f640 1 -- 172.21.15.145:0/390130540 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd340079020 con 0x564979465200 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.397+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564979469500 con 0x564979368030 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.397+0000 7fd34e260640 1 -- 172.21.15.145:0/390130540 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd34800a4d0 con 0x564979368030 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.397+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564979468640 con 0x564979465200 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd34da5f640 1 -- 172.21.15.145:0/390130540 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd340079020 con 0x564979465200 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649794690b0 0x56497946c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56497946d030 con 0x5649794690b0 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd347fff640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649794690b0 0x56497946c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd347fff640 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649794690b0 0x56497946c8c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.398+0000 7fd347fff640 1 -- 172.21.15.145:0/390130540 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd338009050 con 0x5649794690b0 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34ff75800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34ff75800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56497925ea00 con 0x56497947f0c0 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51306/0 (socket says 172.21.15.145:51306) 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34da5f640 1 -- 172.21.15.145:0/4002075559 learned_addr learned my addr 172.21.15.145:0/4002075559 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34da5f640 1 -- 172.21.15.145:0/4002075559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497947fb20 con 0x56497947f0c0 2024-09-10T04:50:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.399+0000 7fd34da5f640 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd340052d00 tx=0x7fd34005d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd2337fe640 1 -- 172.21.15.145:0/4002075559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34005c410 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd2337fe640 1 -- 172.21.15.145:0/4002075559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34005c5b0 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564979480350 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd2337fe640 1 -- 172.21.15.145:0/4002075559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34005c8d0 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649794808f0 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.400+0000 7fd2337fe640 1 -- 172.21.15.145:0/4002075559 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd34007c440 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd2337fe640 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 0x7fd22803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd2337fe640 1 -- 172.21.15.145:0/4002075559 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd340090070 con 0x56497947f0c0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd347fff640 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 0x7fd22803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd347fff640 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 0x7fd22803ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3380016b0 tx=0x7fd33800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34ff75800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34ff75800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564979455c50 con 0x56497948ba00 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51310/0 (socket says 172.21.15.145:51310) 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.401+0000 7fd34da5f640 1 -- 172.21.15.145:0/3609660783 learned_addr learned my addr 172.21.15.145:0/3609660783 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34da5f640 1 -- 172.21.15.145:0/3609660783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497948c3d0 con 0x56497948ba00 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34da5f640 1 --2- 172.21.15.145:0/3609660783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd34009b7e0 tx=0x7fd34009b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b120d89103aaae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd2317fa640 1 -- 172.21.15.145:0/3609660783 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340088af0 con 0x56497948ba00 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd2317fa640 1 -- 172.21.15.145:0/3609660783 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3400ab070 con 0x56497948ba00 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd2317fa640 1 -- 172.21.15.145:0/3609660783 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340088400 con 0x56497948ba00 2024-09-10T04:50:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 -- 172.21.15.145:0/3609660783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 msgr2=0x56497948bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 --2- 172.21.15.145:0/3609660783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd34009b7e0 tx=0x7fd34009b6e0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 -- 172.21.15.145:0/3609660783 shutdown_connections 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 --2- 172.21.15.145:0/3609660783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x56497948bde0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 -- 172.21.15.145:0/3609660783 >> 172.21.15.145:0/3609660783 conn(0x564979487e00 msgr2=0x564979486040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 -- 172.21.15.145:0/3609660783 shutdown_connections 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.402+0000 7fd34ff75800 1 -- 172.21.15.145:0/3609660783 wait complete. 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34ff75800 1 Processor -- start 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34ff75800 1 -- start start 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34ff75800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x564979492e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34ff75800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56497948c860 con 0x56497948ba00 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x564979492e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34da5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x564979492e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51314/0 (socket says 172.21.15.145:51314) 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 learned_addr learned my addr 172.21.15.145:0/949789656 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564979493380 con 0x56497948ba00 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.403+0000 7fd34da5f640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x564979492e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd34007cb20 tx=0x7fd34006dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd21f7fe640 1 -- 172.21.15.145:0/949789656 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340087390 con 0x56497948ba00 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd21f7fe640 1 -- 172.21.15.145:0/949789656 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340074d50 con 0x56497948ba00 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564979493380 con 0x56497948ba00 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd21f7fe640 1 -- 172.21.15.145:0/949789656 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340088730 con 0x56497948ba00 2024-09-10T04:50:27.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564979493380 con 0x56497948ba00 2024-09-10T04:50:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.404+0000 7fd21f7fe640 1 -- 172.21.15.145:0/949789656 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd3400bd030 con 0x56497948ba00 2024-09-10T04:50:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd21f7fe640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd21803c780 0x7fd21803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd21f7fe640 1 -- 172.21.15.145:0/949789656 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd3400bb070 con 0x56497948ba00 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd347fff640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd21803c780 0x7fd21803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd347fff640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd21803c780 0x7fd21803ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd33800efd0 tx=0x7fd338010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56497949e350 0x5649794a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a0f60 con 0x56497949e350 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.405+0000 7fd34e260640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56497949e350 0x5649794a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34e260640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56497949e350 0x5649794a0810 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 realm 2024-09-10T04:50:27.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56497949d680 con 0x56497949e350 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a19f0 con 0x56497949e350 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649794a27d0 0x5649794a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.406+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a5220 con 0x5649794a27d0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34da5f640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649794a27d0 0x5649794a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34da5f640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649794a27d0 0x5649794a4bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a5760 con 0x56497949e350 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 20 searching for the correct realm 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649794a74d0 0x5649794a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.407+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649794a9f40 con 0x5649794a74d0 2024-09-10T04:50:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd347fff640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649794a74d0 0x5649794a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd347fff640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649794a74d0 0x5649794a98c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649794a9f40 con 0x5649794a27d0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd34da5f640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd34005f040 0x7fd34009b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.408+0000 7fd34e260640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd34005f040 0x7fd34009b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd34005f040 0x7fd34009b850 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd34800a4d0 con 0x7fd34005f040 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.409+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.410+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34800a4d0 con 0x56497949e350 2024-09-10T04:50:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x7fd34005f040 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd348030040 con 0x7fd34005f040 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.411+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.412+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x7fd34005f040 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.413+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x56497949e350 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x7fd34005f040 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x7fd34005f040 2024-09-10T04:50:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd348030040 con 0x7fd34005f040 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.414+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a74d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd3400a6070 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.415+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a5fb0 con 0x56497949e350 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd348030040 con 0x56497949e350 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a63a0 con 0x5649794a27d0 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a63a0 con 0x7fd34005f040 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 zone default found 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 4 Realm: () 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 zonegroup default 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.416+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794a5be0 con 0x7fd34005f040 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794abdb0 con 0x5649794a74d0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794ac150 con 0x5649794a74d0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 started sync module instance, tier type = 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.417+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ab250 con 0x5649794a27d0 2024-09-10T04:50:27.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.418+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.418+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94873567541120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ab250 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.418+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794acb10 con 0x56497949e350 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.419+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94873567541120] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.419+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.419+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94873567545408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ab250 con 0x56497949e350 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.420+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ad560 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.420+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.420+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94873567547504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ad510 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.420+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ae510 con 0x7fd34005f040 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.421+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94873567547504] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.422+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.422+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94873567551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ae4d0 con 0x7fd34005f040 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.422+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794aef70 con 0x5649794a27d0 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.422+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94873567545408] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.423+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.423+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94873567554112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794aef30 con 0x5649794a27d0 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.423+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794af980 con 0x5649794a74d0 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.424+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94873567554112] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.425+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94873567551488] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.425+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.425+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94873567556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ad980 con 0x5649794a74d0 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.426+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b0220 con 0x5649794a74d0 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.426+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.426+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94873567561152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b0e90 con 0x5649794a74d0 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.426+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b18e0 con 0x7fd34005f040 2024-09-10T04:50:27.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.427+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94873567556816] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94873567564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b1cd0 con 0x7fd34005f040 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=0 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=1 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=2 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=3 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=4 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=5 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94873567561152] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.428+0000 7fd34ff75800 20 add_watcher() i=6 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94873567564752] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34ff75800 20 add_watcher() i=7 2024-09-10T04:50:27.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34ff75800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794b09e0 con 0x56497949e350 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.429+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94873567562208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b21a0 con 0x56497949e350 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.431+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94873567562208] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.431+0000 7fd1ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.431+0000 7fd34ff75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.431+0000 7fd34ff75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.431+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a27d0 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.432+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.432+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x7fd34005f040 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.435+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.435+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a74d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.436+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.436+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x56497949e350 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.437+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'48 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.437+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a27d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.438+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.438+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a74d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.440+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.440+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a27d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.441+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.441+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x56497949e350 2024-09-10T04:50:27.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.442+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.442+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bf0a0 con 0x5649794a27d0 2024-09-10T04:50:27.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.443+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.443+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bf0a0 con 0x5649794a27d0 2024-09-10T04:50:27.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.444+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.444+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a27d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.445+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.445+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a74d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.446+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.446+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x5649794a27d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.447+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.447+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bd5a0 con 0x56497949e350 2024-09-10T04:50:27.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.449+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.449+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfb60 con 0x56497949e350 2024-09-10T04:50:27.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.450+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.450+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfac0 con 0x5649794a27d0 2024-09-10T04:50:27.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.451+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.451+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfac0 con 0x5649794a27d0 2024-09-10T04:50:27.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.452+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.452+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfac0 con 0x5649794a74d0 2024-09-10T04:50:27.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.453+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.453+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfac0 con 0x5649794a27d0 2024-09-10T04:50:27.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.454+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.454+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bfac0 con 0x56497949e350 2024-09-10T04:50:27.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.456+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'50 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.456+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bcca0 con 0x5649794a27d0 2024-09-10T04:50:27.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.457+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.457+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bcca0 con 0x5649794a27d0 2024-09-10T04:50:27.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.458+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.458+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bcc10 con 0x5649794a74d0 2024-09-10T04:50:27.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.461+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.461+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bcc10 con 0x5649794a27d0 2024-09-10T04:50:27.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.463+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.463+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bcc30 con 0x5649794a74d0 2024-09-10T04:50:27.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.464+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.464+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bce00 con 0x5649794a74d0 2024-09-10T04:50:27.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.465+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.465+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bce00 con 0x5649794a74d0 2024-09-10T04:50:27.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.466+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.466+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794c0280 con 0x5649794a27d0 2024-09-10T04:50:27.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.467+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.467+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794c0280 con 0x56497949e350 2024-09-10T04:50:27.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.468+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.468+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794c0280 con 0x5649794a27d0 2024-09-10T04:50:27.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.469+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.469+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794c0280 con 0x56497949e350 2024-09-10T04:50:27.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.470+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.470+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794c0280 con 0x7fd34005f040 2024-09-10T04:50:27.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.471+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.471+0000 7fd1fe7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:27.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.471+0000 7fd34ff75800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:27.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.471+0000 7fd34ff75800 20 Filter name: none 2024-09-10T04:50:27.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.471+0000 7fd16ffff640 20 reqs_thread_entry: start 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649794eab00 con 0x56497949e350 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.472+0000 7fd34ff75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:27.475 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T04:50:27.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.473+0000 7fd1ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.473+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94873567562208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794bc1f0 con 0x56497949e350 2024-09-10T04:50:27.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.474+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94873567562208] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.474+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94873567541120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794b09e0 con 0x5649794a27d0 2024-09-10T04:50:27.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.475+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94873567541120] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.475+0000 7fd34ff75800 20 remove_watcher() i=0 2024-09-10T04:50:27.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.475+0000 7fd34ff75800 2 removed watcher, disabling cache 2024-09-10T04:50:27.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.475+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94873567545408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ab780 con 0x56497949e350 2024-09-10T04:50:27.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.476+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94873567545408] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x56497949e350 2024-09-10T04:50:27.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.476+0000 7fd34ff75800 20 remove_watcher() i=1 2024-09-10T04:50:27.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.476+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94873567547504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ac840 con 0x5649794a27d0 2024-09-10T04:50:27.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.477+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94873567547504] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.477+0000 7fd34ff75800 20 remove_watcher() i=2 2024-09-10T04:50:27.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.477+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94873567551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ac840 con 0x7fd34005f040 2024-09-10T04:50:27.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.478+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94873567551488] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.478+0000 7fd34ff75800 20 remove_watcher() i=3 2024-09-10T04:50:27.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.478+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94873567554112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ac840 con 0x5649794a27d0 2024-09-10T04:50:27.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.479+0000 7fd34da5f640 1 -- 172.21.15.145:0/949789656 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94873567554112] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd340079020 con 0x5649794a27d0 2024-09-10T04:50:27.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.479+0000 7fd34ff75800 20 remove_watcher() i=4 2024-09-10T04:50:27.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.479+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94873567556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794aea40 con 0x5649794a74d0 2024-09-10T04:50:27.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.480+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94873567556816] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.480+0000 7fd34ff75800 20 remove_watcher() i=5 2024-09-10T04:50:27.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.480+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94873567561152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ae000 con 0x5649794a74d0 2024-09-10T04:50:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.481+0000 7fd347fff640 1 -- 172.21.15.145:0/949789656 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94873567561152] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd338009050 con 0x5649794a74d0 2024-09-10T04:50:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.481+0000 7fd34ff75800 20 remove_watcher() i=6 2024-09-10T04:50:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.481+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94873567564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649794ae000 con 0x7fd34005f040 2024-09-10T04:50:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94873567564752] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd348041040 con 0x7fd34005f040 2024-09-10T04:50:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 20 remove_watcher() i=7 2024-09-10T04:50:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649794a27d0 msgr2=0x5649794a4bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649794a27d0 0x5649794a4bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56497949e350 msgr2=0x5649794a0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56497949e350 0x5649794a0810 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd34005f040 msgr2=0x7fd34009b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd34005f040 0x7fd34009b850 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649794a74d0 msgr2=0x5649794a98c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649794a74d0 0x5649794a98c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd21803c780 msgr2=0x7fd21803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd21803c780 0x7fd21803ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd33800efd0 tx=0x7fd338010000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 msgr2=0x564979492e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 --2- 172.21.15.145:0/949789656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497948ba00 0x564979492e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd34007cb20 tx=0x7fd34006dea0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 reap_dead start 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34e260640 1 -- 172.21.15.145:0/949789656 reap_dead start 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 shutdown_connections 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 >> 172.21.15.145:0/949789656 conn(0x564979487e00 msgr2=0x564979486010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 shutdown_connections 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.482+0000 7fd34ff75800 1 -- 172.21.15.145:0/949789656 wait complete. 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 msgr2=0x7fd22803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 0x7fd22803ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3380016b0 tx=0x7fd33800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 msgr2=0x56497947f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd340052d00 tx=0x7fd34005d460 comp rx=0 tx=0).stop 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 shutdown_connections 2024-09-10T04:50:27.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd22803c780 0x7fd22803ec40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/4002075559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56497947f0c0 0x56497947f4e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 >> 172.21.15.145:0/4002075559 conn(0x56497946f010 msgr2=0x56497946f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 shutdown_connections 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/4002075559 wait complete. 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564979465200 msgr2=0x5649794675f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564979465200 0x5649794675f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564979368030 msgr2=0x5649794642d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564979368030 0x5649794642d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649794690b0 msgr2=0x56497946c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649794690b0 0x56497946c8c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd23403c730 msgr2=0x7fd23403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd23403c730 0x7fd23403ebf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd338001d70 tx=0x7fd3380012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 msgr2=0x56497945cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 --2- 172.21.15.145:0/390130540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564979366df0 0x56497945cc80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd340053d60 tx=0x7fd340002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34e260640 1 -- 172.21.15.145:0/390130540 reap_dead start 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 shutdown_connections 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 >> 172.21.15.145:0/390130540 conn(0x5649793621c0 msgr2=0x56497944f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 shutdown_connections 2024-09-10T04:50:27.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.483+0000 7fd34ff75800 1 -- 172.21.15.145:0/390130540 wait complete. 2024-09-10T04:50:27.494 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T04:50:27.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T04:50:27.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T04:50:27.494 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T04:50:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cfd28800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d99e5d6860 0x55d99e5d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cfd28800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d99e47fe40 con 0x55d99e5d9190 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cfd28800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55d99e44a680 con 0x55d99e5d6860 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cba6f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d99e5d6860 0x55d99e5d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cba6f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d99e5d6860 0x55d99e5d8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51316/0 (socket says 172.21.15.145:51316) 2024-09-10T04:50:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cb26e640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55d99e5d9190 0x55d99e5db620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60310/0 (socket says 172.21.15.145:60310) 2024-09-10T04:50:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cba6f640 1 -- 172.21.15.145:0/2179045404 learned_addr learned my addr 172.21.15.145:0/2179045404 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72cba6f640 1 -- 172.21.15.145:0/2179045404 >> v1:172.21.15.98:6789/0 conn(0x55d99e5d9190 legacy=0x55d99e5db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.541+0000 7f72cba6f640 1 -- 172.21.15.145:0/2179045404 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e4666b0 con 0x55d99e5d6860 2024-09-10T04:50:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.540+0000 7f72caa6d640 1 -- 172.21.15.145:0/2179045404 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563852978 0 0) 0x55d99e47fe40 con 0x55d99e5d9190 2024-09-10T04:50:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.542+0000 7f72cba6f640 1 --2- 172.21.15.145:0/2179045404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e5d8c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00a520 tx=0x7f72bc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c004754ec95469a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.542+0000 7f72caa6d640 1 -- 172.21.15.145:0/2179045404 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc055070 con 0x55d99e5d6860 2024-09-10T04:50:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.542+0000 7f72caa6d640 1 -- 172.21.15.145:0/2179045404 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0515b0 con 0x55d99e5d6860 2024-09-10T04:50:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.542+0000 7f72caa6d640 1 -- 172.21.15.145:0/2179045404 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0518d0 con 0x55d99e5d6860 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 -- 172.21.15.145:0/2179045404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 msgr2=0x55d99e5d8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2179045404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e5d8c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00a520 tx=0x7f72bc045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 -- 172.21.15.145:0/2179045404 shutdown_connections 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2179045404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e5d8c50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 -- 172.21.15.145:0/2179045404 >> 172.21.15.145:0/2179045404 conn(0x55d99e5d0320 msgr2=0x55d99e5d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 -- 172.21.15.145:0/2179045404 shutdown_connections 2024-09-10T04:50:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.543+0000 7f72cfd28800 1 -- 172.21.15.145:0/2179045404 wait complete. 2024-09-10T04:50:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cfd28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cfd28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d99e46edd0 con 0x55d99e5d6860 2024-09-10T04:50:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51320/0 (socket says 172.21.15.145:51320) 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.557+0000 7f72cba6f640 1 -- 172.21.15.145:0/119863311 learned_addr learned my addr 172.21.15.145:0/119863311 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.558+0000 7f72cba6f640 1 -- 172.21.15.145:0/119863311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e487e10 con 0x55d99e5d6860 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.558+0000 7f72cba6f640 1 --2- 172.21.15.145:0/119863311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72bc045be0 tx=0x7f72bc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f986e23c26cf687 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.558+0000 7f71b9e0b640 1 -- 172.21.15.145:0/119863311 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc051ac0 con 0x55d99e5d6860 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.558+0000 7f71b9e0b640 1 -- 172.21.15.145:0/119863311 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc051c60 con 0x55d99e5d6860 2024-09-10T04:50:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.558+0000 7f71b9e0b640 1 -- 172.21.15.145:0/119863311 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc066460 con 0x55d99e5d6860 2024-09-10T04:50:27.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- 172.21.15.145:0/119863311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 msgr2=0x55d99e6c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 --2- 172.21.15.145:0/119863311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72bc045be0 tx=0x7f72bc051000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- 172.21.15.145:0/119863311 shutdown_connections 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 --2- 172.21.15.145:0/119863311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6c5540 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- 172.21.15.145:0/119863311 >> 172.21.15.145:0/119863311 conn(0x55d99e5d0320 msgr2=0x55d99e6c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- 172.21.15.145:0/119863311 shutdown_connections 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- 172.21.15.145:0/119863311 wait complete. 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cfd28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d99e5dd180 con 0x55d99e5d6860 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51336/0 (socket says 172.21.15.145:51336) 2024-09-10T04:50:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.559+0000 7f72cba6f640 1 -- 172.21.15.145:0/416368182 learned_addr learned my addr 172.21.15.145:0/416368182 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f72cba6f640 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e6cd290 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f72cba6f640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72bc045be0 tx=0x7f72bc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f71b3fff640 1 -- 172.21.15.145:0/416368182 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc05a650 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f71b3fff640 1 -- 172.21.15.145:0/416368182 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc05a7f0 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99e6cd520 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f71b3fff640 1 -- 172.21.15.145:0/416368182 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc05aad0 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.560+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99e6cdf20 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f71b3fff640 1 -- 172.21.15.145:0/416368182 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72bc079060 con 0x55d99e5d6860 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cfd28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cfd28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d99e4cca00 con 0x55d99e5d4860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f71b3fff640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 0x7f71b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cc270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f71b3fff640 1 -- 172.21.15.145:0/416368182 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72bc062070 con 0x55d99e5d6860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cc270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51352/0 (socket says 172.21.15.145:51352) 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cc270640 1 -- 172.21.15.145:0/1574955326 learned_addr learned my addr 172.21.15.145:0/1574955326 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cba6f640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 0x7f71b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.561+0000 7f72cc270640 1 -- 172.21.15.145:0/1574955326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e5d51a0 con 0x55d99e5d4860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cba6f640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 0x7f71b403ebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72bc07b5c0 tx=0x7f72bc07b4d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cc270640 1 --2- 172.21.15.145:0/1574955326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72c400a3e0 tx=0x7f72c400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1effea3fead8d7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f71b1ffb640 1 -- 172.21.15.145:0/1574955326 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c4015070 con 0x55d99e5d4860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f71b1ffb640 1 -- 172.21.15.145:0/1574955326 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4001670 con 0x55d99e5d4860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f71b1ffb640 1 -- 172.21.15.145:0/1574955326 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c4001990 con 0x55d99e5d4860 2024-09-10T04:50:27.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 -- 172.21.15.145:0/1574955326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 msgr2=0x55d99e5d4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 --2- 172.21.15.145:0/1574955326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72c400a3e0 tx=0x7f72c400a8a0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 -- 172.21.15.145:0/1574955326 shutdown_connections 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 --2- 172.21.15.145:0/1574955326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e5d4c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 -- 172.21.15.145:0/1574955326 >> 172.21.15.145:0/1574955326 conn(0x55d99e5d9190 msgr2=0x55d99e6d4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 -- 172.21.15.145:0/1574955326 shutdown_connections 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 -- 172.21.15.145:0/1574955326 wait complete. 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.562+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cfd28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cfd28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d99e5d5520 con 0x55d99e5d4860 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cc270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cc270640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51358/0 (socket says 172.21.15.145:51358) 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cc270640 1 -- 172.21.15.145:0/2744908505 learned_addr learned my addr 172.21.15.145:0/2744908505 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cc270640 1 -- 172.21.15.145:0/2744908505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e6e3990 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cc270640 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f72c4013040 tx=0x7f72c4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f71abfff640 1 -- 172.21.15.145:0/2744908505 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c4020020 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f71abfff640 1 -- 172.21.15.145:0/2744908505 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4010780 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99e6e3c20 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.563+0000 7f71abfff640 1 -- 172.21.15.145:0/2744908505 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72c4015040 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.564+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99e6e45a0 con 0x55d99e5d4860 2024-09-10T04:50:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.564+0000 7f71abfff640 1 -- 172.21.15.145:0/2744908505 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72c4023020 con 0x55d99e5d4860 2024-09-10T04:50:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.564+0000 7f71abfff640 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 0x7f71a403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f71abfff640 1 -- 172.21.15.145:0/2744908505 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72c4053210 con 0x55d99e5d4860 2024-09-10T04:50:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cb26e640 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 0x7f71a403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cb26e640 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 0x7f71a403ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000c00 tx=0x7f72c0001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 1 Processor -- start 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 1 -- start start 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.565+0000 7f72cfd28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d99e6c5cd0 con 0x55d99e6fd220 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cba6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51362/0 (socket says 172.21.15.145:51362) 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cba6f640 1 -- 172.21.15.145:0/3067995695 learned_addr learned my addr 172.21.15.145:0/3067995695 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cba6f640 1 -- 172.21.15.145:0/3067995695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99e6fdc80 con 0x55d99e6fd220 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cba6f640 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72bc051c30 tx=0x7f72bc066830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f7143fff640 1 -- 172.21.15.145:0/3067995695 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc095070 con 0x55d99e6fd220 2024-09-10T04:50:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f7143fff640 1 -- 172.21.15.145:0/3067995695 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc097140 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99e6fe4b0 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f7143fff640 1 -- 172.21.15.145:0/3067995695 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc095340 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.566+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99e6fe4b0 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.567+0000 7f7143fff640 1 -- 172.21.15.145:0/3067995695 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72bc084070 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.567+0000 7f7143fff640 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 0x7f710c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.567+0000 7f7143fff640 1 -- 172.21.15.145:0/3067995695 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72bc08d070 con 0x55d99e6fd220 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.567+0000 7f72cb26e640 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 0x7f710c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f72cb26e640 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 0x7f710c03ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000f60 tx=0x7f72c0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f7141ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 0x55d99e70ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d99e70d4e0 con 0x55d99e70a980 2024-09-10T04:50:27.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f72cc270640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 0x55d99e70ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.568+0000 7f72cc270640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 0x55d99e70ce10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cc270640 1 -- 172.21.15.145:0/416368182 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72c400e070 con 0x55d99e70a980 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 0x55d99e711700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d99e711e90 con 0x55d99e70f2b0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cba6f640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 0x55d99e711700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cba6f640 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 0x55d99e711700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cba6f640 1 -- 172.21.15.145:0/416368182 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(2 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72bc09e070 con 0x55d99e70f2b0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.569+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d99e716c30 con 0x55d99e70f2b0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.570+0000 7f72cba6f640 1 -- 172.21.15.145:0/416368182 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f72bc09e070 con 0x55d99e70f2b0 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 msgr2=0x7f71a403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 0x7f71a403ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000c00 tx=0x7f72c0001330 comp rx=0 tx=0).stop 2024-09-10T04:50:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 msgr2=0x55d99e6e3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f72c4013040 tx=0x7f72c4003370 comp rx=0 tx=0).stop 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 shutdown_connections 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71a403c780 0x7f71a403ec40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 --2- 172.21.15.145:0/2744908505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d4860 0x55d99e6e3430 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 >> 172.21.15.145:0/2744908505 conn(0x55d99e5d9190 msgr2=0x55d99e6d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 shutdown_connections 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.571+0000 7f72cfd28800 1 -- 172.21.15.145:0/2744908505 wait complete. 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 msgr2=0x7f710c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 0x7f710c03ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000f60 tx=0x7f72c0006000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 msgr2=0x55d99e6fd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72bc051c30 tx=0x7f72bc066830 comp rx=0 tx=0).stop 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 shutdown_connections 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f710c03c780 0x7f710c03ec40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/3067995695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e6fd220 0x55d99e6fd640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 >> 172.21.15.145:0/3067995695 conn(0x55d99e6f2760 msgr2=0x55d99e6f2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 shutdown_connections 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/3067995695 wait complete. 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 msgr2=0x55d99e70ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 0x55d99e70ce10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 msgr2=0x55d99e711700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 0x55d99e711700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 msgr2=0x7f71b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 0x7f71b403ebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72bc07b5c0 tx=0x7f72bc07b4d0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 msgr2=0x55d99e6ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72bc045be0 tx=0x7f72bc003020 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 shutdown_connections 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d99e70f2b0 0x55d99e711700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d99e70a980 0x55d99e70ce10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f71b403c730 0x7f71b403ebf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 --2- 172.21.15.145:0/416368182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d99e5d6860 0x55d99e6ccd30 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72bc045be0 tx=0x7f72bc003020 comp rx=0 tx=0).stop 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 >> 172.21.15.145:0/416368182 conn(0x55d99e5d0320 msgr2=0x55d99e6c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 shutdown_connections 2024-09-10T04:50:27.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.572+0000 7f72cfd28800 1 -- 172.21.15.145:0/416368182 wait complete. 2024-09-10T04:50:27.584 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T04:50:27.585 DEBUG:tasks.util.rgw: json result: {'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T04:50:27.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T04:50:27.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T04:50:27.586 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T04:50:27.628 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.628 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3397f28800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e588fe6de0 0x55e588fe7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3397f28800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e588e91e40 con 0x55e588fe8020 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3397f28800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55e588e5c680 con 0x55e588fe6de0 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3393b5d640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e588fe6de0 0x55e588fe7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f338b35c640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55e588fe8020 0x55e588fecd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60322/0 (socket says 172.21.15.145:60322) 2024-09-10T04:50:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3393b5d640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e588fe6de0 0x55e588fe7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51372/0 (socket says 172.21.15.145:51372) 2024-09-10T04:50:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f338b35c640 1 -- 172.21.15.145:0/2015209219 learned_addr learned my addr 172.21.15.145:0/2015209219 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3393b5d640 1 -- 172.21.15.145:0/2015209219 >> v1:172.21.15.98:6789/0 conn(0x55e588fe8020 legacy=0x55e588fecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f3393b5d640 1 -- 172.21.15.145:0/2015209219 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e588e786b0 con 0x55e588fe6de0 2024-09-10T04:50:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.627+0000 7f339335c640 1 -- 172.21.15.145:0/2015209219 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589204545 0 0) 0x55e588e91e40 con 0x55e588fe8020 2024-09-10T04:50:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.629+0000 7f3393b5d640 1 --2- 172.21.15.145:0/2015209219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e588fe7ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f338400a470 tx=0x7f3384045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec31e0a44c629fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.629+0000 7f339335c640 1 -- 172.21.15.145:0/2015209219 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384053570 con 0x55e588fe6de0 2024-09-10T04:50:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.629+0000 7f339335c640 1 -- 172.21.15.145:0/2015209219 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3384058070 con 0x55e588fe6de0 2024-09-10T04:50:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.629+0000 7f339335c640 1 -- 172.21.15.145:0/2015209219 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384053880 con 0x55e588fe6de0 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 -- 172.21.15.145:0/2015209219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 msgr2=0x55e588fe7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 --2- 172.21.15.145:0/2015209219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e588fe7ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f338400a470 tx=0x7f3384045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 -- 172.21.15.145:0/2015209219 shutdown_connections 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 --2- 172.21.15.145:0/2015209219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e588fe7ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 -- 172.21.15.145:0/2015209219 >> 172.21.15.145:0/2015209219 conn(0x55e588fe21b0 msgr2=0x55e588fe4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 -- 172.21.15.145:0/2015209219 shutdown_connections 2024-09-10T04:50:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.630+0000 7f3397f28800 1 -- 172.21.15.145:0/2015209219 wait complete. 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3397f28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3397f28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e588e80dd0 con 0x55e588fe6de0 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51378/0 (socket says 172.21.15.145:51378) 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3393b5d640 1 -- 172.21.15.145:0/2051756976 learned_addr learned my addr 172.21.15.145:0/2051756976 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.644+0000 7f3393b5d640 1 -- 172.21.15.145:0/2051756976 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e588e99e10 con 0x55e588fe6de0 2024-09-10T04:50:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3393b5d640 1 --2- 172.21.15.145:0/2051756976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3384025c20 tx=0x7f3384051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f86a99b05dadbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3281e0b640 1 -- 172.21.15.145:0/2051756976 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f338405e2c0 con 0x55e588fe6de0 2024-09-10T04:50:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3281e0b640 1 -- 172.21.15.145:0/2051756976 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338405e8b0 con 0x55e588fe6de0 2024-09-10T04:50:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3281e0b640 1 -- 172.21.15.145:0/2051756976 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f338405ebd0 con 0x55e588fe6de0 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 -- 172.21.15.145:0/2051756976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 msgr2=0x55e5890d63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 --2- 172.21.15.145:0/2051756976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3384025c20 tx=0x7f3384051000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 -- 172.21.15.145:0/2051756976 shutdown_connections 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 --2- 172.21.15.145:0/2051756976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890d63a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 -- 172.21.15.145:0/2051756976 >> 172.21.15.145:0/2051756976 conn(0x55e588fe21b0 msgr2=0x55e5890d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.645+0000 7f3397f28800 1 -- 172.21.15.145:0/2051756976 shutdown_connections 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3397f28800 1 -- 172.21.15.145:0/2051756976 wait complete. 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3397f28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3397f28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e588fe8710 con 0x55e588fe6de0 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51384/0 (socket says 172.21.15.145:51384) 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3393b5d640 1 -- 172.21.15.145:0/2969444031 learned_addr learned my addr 172.21.15.145:0/2969444031 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.646+0000 7f3393b5d640 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5890e13c0 con 0x55e588fe6de0 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f3393b5d640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890e0e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3384025c20 tx=0x7f3384002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f327bfff640 1 -- 172.21.15.145:0/2969444031 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384053570 con 0x55e588fe6de0 2024-09-10T04:50:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f327bfff640 1 -- 172.21.15.145:0/2969444031 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3384074070 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5890e1650 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f327bfff640 1 -- 172.21.15.145:0/2969444031 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384053840 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5890e2050 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.647+0000 7f327bfff640 1 -- 172.21.15.145:0/2969444031 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3384053a30 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f327bfff640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f327c03c730 0x7f327c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f327bfff640 1 -- 172.21.15.145:0/2969444031 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3384064070 con 0x55e588fe6de0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f338b35c640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f327c03c730 0x7f327c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e588fe8020 0x55e5890e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5890e89f0 con 0x55e588fe8020 2024-09-10T04:50:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f339435e640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e588fe8020 0x55e5890e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f338b35c640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f327c03c730 0x7f327c03ebf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f337c000c00 tx=0x7f337c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.648+0000 7f339435e640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e588fe8020 0x55e5890e84b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f339435e640 1 -- 172.21.15.145:0/2969444031 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e588fe8020 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e5890e92a0 0x55e5890eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5890ebe60 con 0x55e5890e92a0 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3393b5d640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e5890e92a0 0x55e5890eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3393b5d640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e5890e92a0 0x55e5890eb6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3393b5d640 1 -- 172.21.15.145:0/2969444031 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3384051070 con 0x55e5890e92a0 2024-09-10T04:50:27.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.649+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5890ed710 con 0x55e588fe8020 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f339435e640 1 -- 172.21.15.145:0/2969444031 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e588fe8020 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5890ec940 con 0x55e5890e92a0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f3393b5d640 1 -- 172.21.15.145:0/2969444031 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3384051070 con 0x55e5890e92a0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e5890eeac0 0x55e5890f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5890f13f0 con 0x55e5890eeac0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f338b35c640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e5890eeac0 0x55e5890f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.650+0000 7f338b35c640 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e5890eeac0 0x55e5890f0eb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f338b35c640 1 -- 172.21.15.145:0/2969444031 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f337c00f670 con 0x55e5890eeac0 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3397f28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3397f28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e588edea00 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51386/0 (socket says 172.21.15.145:51386) 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.651+0000 7f3393b5d640 1 -- 172.21.15.145:0/3638241202 learned_addr learned my addr 172.21.15.145:0/3638241202 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f3393b5d640 1 -- 172.21.15.145:0/3638241202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5890ff9a0 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f3393b5d640 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3384045a60 tx=0x7f338405cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f32797fa640 1 -- 172.21.15.145:0/3638241202 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384090040 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f32797fa640 1 -- 172.21.15.145:0/3638241202 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3384066780 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f32797fa640 1 -- 172.21.15.145:0/3638241202 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3384078410 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5891001d0 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.652+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e589100770 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f32797fa640 1 -- 172.21.15.145:0/3638241202 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33840785b0 con 0x55e5890fef40 2024-09-10T04:50:27.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f32797fa640 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 0x7f326c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f32797fa640 1 -- 172.21.15.145:0/3638241202 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f33840990c0 con 0x55e5890fef40 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f338b35c640 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 0x7f326c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f338b35c640 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 0x7f326c03ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55e5890e2d30 tx=0x7f337c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.653+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3397f28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3397f28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e5890d6b30 con 0x55e58910b820 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51400/0 (socket says 172.21.15.145:51400) 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3393b5d640 1 -- 172.21.15.145:0/797183967 learned_addr learned my addr 172.21.15.145:0/797183967 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3393b5d640 1 -- 172.21.15.145:0/797183967 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e58910c1f0 con 0x55e58910b820 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.654+0000 7f3393b5d640 1 --2- 172.21.15.145:0/797183967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3384053a00 tx=0x7f3384082b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665eb4520da7c6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3272ffd640 1 -- 172.21.15.145:0/797183967 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f338406e370 con 0x55e58910b820 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3272ffd640 1 -- 172.21.15.145:0/797183967 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3384097930 con 0x55e58910b820 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3272ffd640 1 -- 172.21.15.145:0/797183967 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33840943b0 con 0x55e58910b820 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- 172.21.15.145:0/797183967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 msgr2=0x55e58910bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 --2- 172.21.15.145:0/797183967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3384053a00 tx=0x7f3384082b80 comp rx=0 tx=0).stop 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- 172.21.15.145:0/797183967 shutdown_connections 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 --2- 172.21.15.145:0/797183967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e58910bc00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- 172.21.15.145:0/797183967 >> 172.21.15.145:0/797183967 conn(0x55e589107c20 msgr2=0x55e589105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- 172.21.15.145:0/797183967 shutdown_connections 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- 172.21.15.145:0/797183967 wait complete. 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 Processor -- start 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.655+0000 7f3397f28800 1 -- start start 2024-09-10T04:50:27.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3397f28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3397f28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e58910c680 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3393b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51408/0 (socket says 172.21.15.145:51408) 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 learned_addr learned my addr 172.21.15.145:0/1594140259 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e589113090 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3393b5d640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f338405c8d0 tx=0x7f338404fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f32717fa640 1 -- 172.21.15.145:0/1594140259 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33840c5070 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f32717fa640 1 -- 172.21.15.145:0/1594140259 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338406e370 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f32717fa640 1 -- 172.21.15.145:0/1594140259 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33840943b0 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.656+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e589113090 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.657+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e589113090 con 0x55e58910b820 2024-09-10T04:50:27.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.657+0000 7f32717fa640 1 -- 172.21.15.145:0/1594140259 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33840c8070 con 0x55e58910b820 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.657+0000 7f32717fa640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f325c03c780 0x7f325c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.657+0000 7f32717fa640 1 -- 172.21.15.145:0/1594140259 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f33840bc030 con 0x55e58910b820 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f338b35c640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f325c03c780 0x7f325c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e58911ddd0 0x55e589120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589120990 con 0x55e58911ddd0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f339435e640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e58911ddd0 0x55e589120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f338b35c640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f325c03c780 0x7f325c03ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f337c00ffd0 tx=0x7f337c023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f339435e640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e58911ddd0 0x55e589120290 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 20 realm 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.658+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e58911d150 con 0x55e58911ddd0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589121420 con 0x55e58911ddd0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e589122200 0x55e5891245f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589124c20 con 0x55e589122200 2024-09-10T04:50:27.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3393b5d640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e589122200 0x55e5891245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.659+0000 7f3393b5d640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e589122200 0x55e5891245f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589125010 con 0x55e58911ddd0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 20 searching for the correct realm 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e589126ef0 0x55e5891292e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e589129990 con 0x55e589126ef0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f338b35c640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e589126ef0 0x55e5891292e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f338b35c640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e589126ef0 0x55e5891292e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.660+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e589129990 con 0x55e589122200 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f3393b5d640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33840ca060 0x7f3384067a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f339435e640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33840ca060 0x7f3384067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f339435e640 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33840ca060 0x7f3384067a30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f338c00a4d0 con 0x7f33840ca060 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.661+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.662+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c00a4d0 con 0x55e58911ddd0 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x7f33840ca060 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.663+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f338c030040 con 0x7f33840ca060 2024-09-10T04:50:27.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.664+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.665+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x7f33840ca060 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e58911ddd0 2024-09-10T04:50:27.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.666+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x7f33840ca060 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x7f33840ca060 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f338c030040 con 0x7f33840ca060 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.667+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589126ef0 2024-09-10T04:50:27.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f33840bf030 con 0x55e589122200 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589125860 con 0x55e58911ddd0 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f338c030040 con 0x55e58911ddd0 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.668+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589125c50 con 0x55e589122200 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589125c50 con 0x7f33840ca060 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 zone default found 2024-09-10T04:50:27.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 4 Realm: () 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 zonegroup default 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589126070 con 0x7f33840ca060 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589126070 con 0x55e589126ef0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.669+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e58912b7e0 con 0x55e589126ef0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.670+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.670+0000 7f3397f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.670+0000 7f3397f28800 20 started sync module instance, tier type = 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.670+0000 7f3397f28800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.670+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912ac80 con 0x55e589122200 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.671+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.671+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94444335575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912ac80 con 0x55e589122200 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.671+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912ac80 con 0x55e58911ddd0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.672+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.672+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94444335578496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912c7c0 con 0x55e58911ddd0 2024-09-10T04:50:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.672+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94444335575504] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.672+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912d290 con 0x55e589122200 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.673+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94444335578496] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.673+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.673+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94444335582592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912c310 con 0x55e589122200 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.673+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912db30 con 0x7f33840ca060 2024-09-10T04:50:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.674+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94444335582592] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.674+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.674+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94444335572944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912c310 con 0x7f33840ca060 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.674+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912e200 con 0x55e589122200 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.675+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94444335572944] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.676+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.676+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94444335586512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912e1c0 con 0x55e589122200 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.676+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912ec00 con 0x55e589126ef0 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.677+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94444335586512] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.677+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.677+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94444335589072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912eff0 con 0x55e589126ef0 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.677+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e58912fa10 con 0x55e589126ef0 2024-09-10T04:50:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.678+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.678+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94444335595008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891306d0 con 0x55e589126ef0 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.678+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e589131120 con 0x7f33840ca060 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.679+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94444335589072] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94444335595008] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94444335598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e589130220 con 0x7f33840ca060 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=0 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=1 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=2 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=3 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=4 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=5 2024-09-10T04:50:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.680+0000 7f3397f28800 20 add_watcher() i=6 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.681+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94444335598608] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.681+0000 7f3397f28800 20 add_watcher() i=7 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.681+0000 7f3397f28800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.681+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e589130220 con 0x55e58911ddd0 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.682+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.682+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94444335584768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e589131970 con 0x55e58911ddd0 2024-09-10T04:50:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94444335584768] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3249fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3397f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3397f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3397f28800 5 note: GC not initialized 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3248fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3397f28800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.683+0000 7f3397f28800 20 Filter name: none 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f31c27fc640 20 reqs_thread_entry: start 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678e0 con 0x55e589122200 2024-09-10T04:50:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678e0 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.684+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.685+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.686+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x7f33840ca060 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x7f33840ca060 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.687+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.688+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.689+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.690+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.691+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.691+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.691+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.691+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.692+0000 7f3249fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.692+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94444335584768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.693+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94444335584768] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.693+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94444335575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.694+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94444335575504] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.694+0000 7f3397f28800 20 remove_watcher() i=0 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.694+0000 7f3397f28800 2 removed watcher, disabling cache 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.694+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94444335578496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e58911ddd0 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.695+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94444335578496] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x55e58911ddd0 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.695+0000 7f3397f28800 20 remove_watcher() i=1 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.695+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94444335582592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.696+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94444335582592] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.696+0000 7f3397f28800 20 remove_watcher() i=2 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.696+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94444335572944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x7f33840ca060 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.697+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94444335572944] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.697+0000 7f3397f28800 20 remove_watcher() i=3 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.697+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94444335586512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589122200 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.698+0000 7f3393b5d640 1 -- 172.21.15.145:0/1594140259 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94444335586512] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33840c7030 con 0x55e589122200 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.698+0000 7f3397f28800 20 remove_watcher() i=4 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.698+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94444335589072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.699+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94444335589072] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.699+0000 7f3397f28800 20 remove_watcher() i=5 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.699+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94444335595008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x55e589126ef0 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.700+0000 7f338b35c640 1 -- 172.21.15.145:0/1594140259 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94444335595008] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337c037040 con 0x55e589126ef0 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.700+0000 7f3397f28800 20 remove_watcher() i=6 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.700+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94444335598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5891678a0 con 0x7f33840ca060 2024-09-10T04:50:27.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94444335598608] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f338c041040 con 0x7f33840ca060 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 20 remove_watcher() i=7 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e589122200 msgr2=0x55e5891245f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e589122200 0x55e5891245f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e58911ddd0 msgr2=0x55e589120290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e58911ddd0 0x55e589120290 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33840ca060 msgr2=0x7f3384067a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33840ca060 0x7f3384067a30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e589126ef0 msgr2=0x55e5891292e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e589126ef0 0x55e5891292e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f325c03c780 msgr2=0x7f325c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f325c03c780 0x7f325c03ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f337c00ffd0 tx=0x7f337c023040 comp rx=0 tx=0).stop 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 msgr2=0x55e589112b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f338405c8d0 tx=0x7f338404fe90 comp rx=0 tx=0).stop 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f339435e640 1 -- 172.21.15.145:0/1594140259 reap_dead start 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 shutdown_connections 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/1594140259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e58910b820 0x55e589112b30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 >> 172.21.15.145:0/1594140259 conn(0x55e589107c20 msgr2=0x55e589105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 shutdown_connections 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/1594140259 wait complete. 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 msgr2=0x7f326c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 0x7f326c03ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55e5890e2d30 tx=0x7f337c006000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 msgr2=0x55e5890ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.702+0000 7f3397f28800 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3384045a60 tx=0x7f338405cc80 comp rx=0 tx=0).stop 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 shutdown_connections 2024-09-10T04:50:27.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f326c03c780 0x7f326c03ec40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/3638241202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5890fef40 0x55e5890ff360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 >> 172.21.15.145:0/3638241202 conn(0x55e5890f32f0 msgr2=0x55e5890f36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 shutdown_connections 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/3638241202 wait complete. 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e5890e92a0 msgr2=0x55e5890eb6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e5890e92a0 0x55e5890eb6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e588fe8020 msgr2=0x55e5890e84b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e588fe8020 0x55e5890e84b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e5890eeac0 msgr2=0x55e5890f0eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e5890eeac0 0x55e5890f0eb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f327c03c730 msgr2=0x7f327c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f327c03c730 0x7f327c03ebf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f337c000c00 tx=0x7f337c0013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 msgr2=0x55e5890e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 --2- 172.21.15.145:0/2969444031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e588fe6de0 0x55e5890e0e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3384025c20 tx=0x7f3384002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f339435e640 1 -- 172.21.15.145:0/2969444031 reap_dead start 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 shutdown_connections 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 >> 172.21.15.145:0/2969444031 conn(0x55e588fe21b0 msgr2=0x55e5890d7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 shutdown_connections 2024-09-10T04:50:27.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.703+0000 7f3397f28800 1 -- 172.21.15.145:0/2969444031 wait complete. 2024-09-10T04:50:27.722 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[],"summary":[]} 2024-09-10T04:50:27.722 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T04:50:27.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:27.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:27.723 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:27.808 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.809 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6db28800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5646668dc600 0x5646668de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6db28800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564666785e40 con 0x5646668df020 2024-09-10T04:50:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6db28800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x564666750680 con 0x5646668dc600 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6984b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5646668dc600 0x5646668de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6984b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5646668dc600 0x5646668de9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51424/0 (socket says 172.21.15.145:51424) 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.807+0000 7f4d6984b640 1 -- 172.21.15.145:0/365195264 learned_addr learned my addr 172.21.15.145:0/365195264 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.808+0000 7f4d6984b640 1 -- 172.21.15.145:0/365195264 >> v1:172.21.15.98:6789/0 conn(0x5646668df020 legacy=0x5646668e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.808+0000 7f4d6984b640 1 -- 172.21.15.145:0/365195264 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466676c6b0 con 0x5646668dc600 2024-09-10T04:50:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.808+0000 7f4d68849640 1 -- 172.21.15.145:0/365195264 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468229506 0 0) 0x564666785e40 con 0x5646668df020 2024-09-10T04:50:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.809+0000 7f4d6984b640 1 --2- 172.21.15.145:0/365195264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668de9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00a520 tx=0x7f4d5c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8674541064a6d215 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.809+0000 7f4d68849640 1 -- 172.21.15.145:0/365195264 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c055070 con 0x5646668dc600 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d68849640 1 -- 172.21.15.145:0/365195264 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c0515b0 con 0x5646668dc600 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d68849640 1 -- 172.21.15.145:0/365195264 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c0518d0 con 0x5646668dc600 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 -- 172.21.15.145:0/365195264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 msgr2=0x5646668de9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 --2- 172.21.15.145:0/365195264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668de9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00a520 tx=0x7f4d5c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 -- 172.21.15.145:0/365195264 shutdown_connections 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 --2- 172.21.15.145:0/365195264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668de9f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 -- 172.21.15.145:0/365195264 >> 172.21.15.145:0/365195264 conn(0x5646668d61c0 msgr2=0x5646668d8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 -- 172.21.15.145:0/365195264 shutdown_connections 2024-09-10T04:50:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.810+0000 7f4d6db28800 1 -- 172.21.15.145:0/365195264 wait complete. 2024-09-10T04:50:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6db28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6db28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564666774dd0 con 0x5646668dc600 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51430/0 (socket says 172.21.15.145:51430) 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.824+0000 7f4d6984b640 1 -- 172.21.15.145:0/3452315282 learned_addr learned my addr 172.21.15.145:0/3452315282 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.825+0000 7f4d6984b640 1 -- 172.21.15.145:0/3452315282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466678de10 con 0x5646668dc600 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.825+0000 7f4d6984b640 1 --2- 172.21.15.145:0/3452315282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c045be0 tx=0x7f4d5c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1859f11511f960 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.825+0000 7f4c57e07640 1 -- 172.21.15.145:0/3452315282 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c051ac0 con 0x5646668dc600 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.825+0000 7f4c57e07640 1 -- 172.21.15.145:0/3452315282 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c051c60 con 0x5646668dc600 2024-09-10T04:50:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.825+0000 7f4c57e07640 1 -- 172.21.15.145:0/3452315282 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c066460 con 0x5646668dc600 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- 172.21.15.145:0/3452315282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 msgr2=0x5646669cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 --2- 172.21.15.145:0/3452315282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c045be0 tx=0x7f4d5c051000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- 172.21.15.145:0/3452315282 shutdown_connections 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 --2- 172.21.15.145:0/3452315282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646669cb470 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- 172.21.15.145:0/3452315282 >> 172.21.15.145:0/3452315282 conn(0x5646668d61c0 msgr2=0x5646669c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- 172.21.15.145:0/3452315282 shutdown_connections 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- 172.21.15.145:0/3452315282 wait complete. 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668dbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.826+0000 7f4d6db28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5646668e3040 con 0x5646668dc600 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668dbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668dbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51434/0 (socket says 172.21.15.145:51434) 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6984b640 1 -- 172.21.15.145:0/299104881 learned_addr learned my addr 172.21.15.145:0/299104881 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6984b640 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646668dc280 con 0x5646668dc600 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6984b640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668dbd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c045be0 tx=0x7f4d5c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4c56604640 1 -- 172.21.15.145:0/299104881 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c05a600 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4c56604640 1 -- 172.21.15.145:0/299104881 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c05a7a0 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646668da630 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4c56604640 1 -- 172.21.15.145:0/299104881 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c05aa80 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.827+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646668dabf0 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.828+0000 7f4c56604640 1 -- 172.21.15.145:0/299104881 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4d5c058070 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.828+0000 7f4c56604640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c5003c730 0x7f4c5003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.828+0000 7f4c56604640 1 -- 172.21.15.145:0/299104881 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4d5c062070 con 0x5646668dc600 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.828+0000 7f4d6904a640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c5003c730 0x7f4c5003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5646668df020 0x5646669dc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646669dc7b0 con 0x5646668df020 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5646668df020 0x5646669dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6904a640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c5003c730 0x7f4c5003ebf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d540013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5646668df020 0x5646669dc230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6a04c640 1 -- 172.21.15.145:0/299104881 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6400a4d0 con 0x5646668df020 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5646669dd580 0x5646669df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646669dffa0 con 0x5646669dd580 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.829+0000 7f4d6984b640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5646669dd580 0x5646669df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.830+0000 7f4d6984b640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5646669dd580 0x5646669df970 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.830+0000 7f4d6984b640 1 -- 172.21.15.145:0/299104881 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d5c057030 con 0x5646669dd580 2024-09-10T04:50:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.830+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646669e1850 con 0x5646668df020 2024-09-10T04:50:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.830+0000 7f4d6a04c640 1 -- 172.21.15.145:0/299104881 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d6400a4d0 con 0x5646668df020 2024-09-10T04:50:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.830+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646669e0a80 con 0x5646669dd580 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6984b640 1 -- 172.21.15.145:0/299104881 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d5c057030 con 0x5646669dd580 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5646669e2c00 0x5646669e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646669e5530 con 0x5646669e2c00 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6904a640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5646669e2c00 0x5646669e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6904a640 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5646669e2c00 0x5646669e4ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6904a640 1 -- 172.21.15.145:0/299104881 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d54010540 con 0x5646669e2c00 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.831+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6db28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6db28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5646667d2a00 con 0x5646669f3080 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51446/0 (socket says 172.21.15.145:51446) 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6984b640 1 -- 172.21.15.145:0/615095184 learned_addr learned my addr 172.21.15.145:0/615095184 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6984b640 1 -- 172.21.15.145:0/615095184 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646669f3ae0 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.832+0000 7f4d6984b640 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c065b40 tx=0x7f4d5c065f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4c4f7fe640 1 -- 172.21.15.145:0/615095184 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c07a520 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4c4f7fe640 1 -- 172.21.15.145:0/615095184 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c07a6c0 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646669f4310 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4c4f7fe640 1 -- 172.21.15.145:0/615095184 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c095120 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646669f4310 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.833+0000 7f4c4f7fe640 1 -- 172.21.15.145:0/615095184 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4d5c04f070 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4c4f7fe640 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 0x7f4c4403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4c4f7fe640 1 -- 172.21.15.145:0/615095184 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4d5c08f070 con 0x5646669f3080 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6904a640 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 0x7f4c4403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6904a640 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 0x7f4c4403ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c010 tx=0x7f4d54006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6db28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6db28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5646669cbc00 con 0x5646669ff780 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51462/0 (socket says 172.21.15.145:51462) 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.834+0000 7f4d6984b640 1 -- 172.21.15.145:0/1903712799 learned_addr learned my addr 172.21.15.145:0/1903712799 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6984b640 1 -- 172.21.15.145:0/1903712799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564666a00170 con 0x5646669ff780 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6984b640 1 --2- 172.21.15.145:0/1903712799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c081fd0 tx=0x7f4d5c097e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795a28e036fc771e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4c4d7fa640 1 -- 172.21.15.145:0/1903712799 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c0b2070 con 0x5646669ff780 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4c4d7fa640 1 -- 172.21.15.145:0/1903712799 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c07b5d0 con 0x5646669ff780 2024-09-10T04:50:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4c4d7fa640 1 -- 172.21.15.145:0/1903712799 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c097c30 con 0x5646669ff780 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 -- 172.21.15.145:0/1903712799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 msgr2=0x5646669ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 --2- 172.21.15.145:0/1903712799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c081fd0 tx=0x7f4d5c097e20 comp rx=0 tx=0).stop 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 -- 172.21.15.145:0/1903712799 shutdown_connections 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 --2- 172.21.15.145:0/1903712799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x5646669ffb80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 -- 172.21.15.145:0/1903712799 >> 172.21.15.145:0/1903712799 conn(0x5646669fbb80 msgr2=0x5646669f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.835+0000 7f4d6db28800 1 -- 172.21.15.145:0/1903712799 shutdown_connections 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6db28800 1 -- 172.21.15.145:0/1903712799 wait complete. 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6db28800 1 Processor -- start 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6db28800 1 -- start start 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6db28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x564666a06c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6db28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564666a005e0 con 0x5646669ff780 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x564666a06c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6984b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x564666a06c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51472/0 (socket says 172.21.15.145:51472) 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 learned_addr learned my addr 172.21.15.145:0/69437468 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.836+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564666a07160 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4d6984b640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x564666a06c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c05e950 tx=0x7f4d5c06ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4c3b7fe640 1 -- 172.21.15.145:0/69437468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c0bd070 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4c3b7fe640 1 -- 172.21.15.145:0/69437468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c07b780 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564666a07160 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4c3b7fe640 1 -- 172.21.15.145:0/69437468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c0b2040 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.837+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564666a07160 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4c3b7fe640 1 -- 172.21.15.145:0/69437468 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4d5c0c0070 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4c3b7fe640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c3403c780 0x7f4c3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4c3b7fe640 1 -- 172.21.15.145:0/69437468 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4d5c0aa070 con 0x5646669ff780 2024-09-10T04:50:27.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6904a640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c3403c780 0x7f4c3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564666a12210 0x564666a146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a14e20 con 0x564666a12210 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564666a12210 0x564666a146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6904a640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c3403c780 0x7f4c3403ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5646668db0a0 tx=0x7f4d54022040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.838+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564666a12210 0x564666a146d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 realm 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a11540 con 0x564666a12210 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a158b0 con 0x564666a12210 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564666a16690 0x564666a18a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a190b0 con 0x564666a16690 2024-09-10T04:50:27.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.839+0000 7f4d6984b640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564666a16690 0x564666a18a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6984b640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564666a16690 0x564666a18a80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a19950 con 0x564666a12210 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 20 searching for the correct realm 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564666a1b6c0 0x564666a1daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.840+0000 7f4d6904a640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564666a1b6c0 0x564666a1daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6904a640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564666a1b6c0 0x564666a1daf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6984b640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4d5c0c2070 0x7f4d5c04f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.841+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4d5c0c2070 0x7f4d5c04f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4d5c0c2070 0x7f4d5c04f7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d6400a4d0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.842+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6400a4d0 con 0x564666a12210 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.843+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d64030040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.844+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.845+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.846+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a12210 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d64030040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.847+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a1b6c0 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.848+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564666a1e1c0 con 0x564666a16690 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:27.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a1a300 con 0x564666a12210 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d64030040 con 0x564666a12210 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a1a780 con 0x564666a16690 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a1aba0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:27.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 zone default found 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 4 Realm: () 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 zonegroup default 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.849+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a1aba0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a20080 con 0x564666a1b6c0 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a20420 con 0x564666a1b6c0 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 started sync module instance, tier type = 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.850+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a1f520 con 0x564666a16690 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.851+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.851+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860369590896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a1f520 con 0x564666a16690 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.851+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a20f40 con 0x564666a12210 2024-09-10T04:50:27.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.852+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860369590896] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.852+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.853+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860369588336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a20f40 con 0x564666a12210 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.853+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a21a00 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.854+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860369588336] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.854+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.854+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860369597648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a219c0 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.854+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a224b0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.854+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860369597648] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.855+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.855+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860369594912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a224b0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.855+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a22ec0 con 0x564666a16690 2024-09-10T04:50:27.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.856+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.856+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860369603088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a22e30 con 0x564666a16690 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.856+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a23e90 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.856+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860369594912] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.857+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860369603088] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.857+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.857+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860369605296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a21f90 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.857+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a246e0 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.860+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860369605296] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.860+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.860+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860369609264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a24650 con 0x564666a1b6c0 2024-09-10T04:50:27.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.860+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a255a0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860369609264] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860369611472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a255a0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=0 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=1 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=2 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=3 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=4 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=5 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.866+0000 7f4d6db28800 20 add_watcher() i=6 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.868+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860369611472] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.868+0000 7f4d6db28800 20 add_watcher() i=7 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.868+0000 7f4d6db28800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.868+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a289a0 con 0x564666a12210 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.869+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.869+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860369613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a25ec0 con 0x564666a12210 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860369613504] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4c207e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 5 note: GC not initialized 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4c1f7e6640 20 reqs_thread_entry: start 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 20 Filter name: none 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4c1d7e2640 20 reqs_thread_entry: start 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.870+0000 7f4d6db28800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.871+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b510 con 0x564666a12210 2024-09-10T04:50:27.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.871+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.871+0000 7f4d6db28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:could not fetch user info: no user info saved 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.872+0000 7f4c207e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.872+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860369613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a12210 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.873+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94860369613504] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.873+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860369590896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a16690 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.874+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94860369590896] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.874+0000 7f4d6db28800 20 remove_watcher() i=0 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.874+0000 7f4d6db28800 2 removed watcher, disabling cache 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.874+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860369588336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a12210 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.875+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94860369588336] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x564666a12210 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.875+0000 7f4d6db28800 20 remove_watcher() i=1 2024-09-10T04:50:27.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.875+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860369597648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a16690 2024-09-10T04:50:27.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.876+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94860369597648] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.876+0000 7f4d6db28800 20 remove_watcher() i=2 2024-09-10T04:50:27.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.876+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860369594912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.877+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94860369594912] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.877+0000 7f4d6db28800 20 remove_watcher() i=3 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.877+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860369603088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a16690 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.878+0000 7f4d6984b640 1 -- 172.21.15.145:0/69437468 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94860369603088] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5c0c9070 con 0x564666a16690 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.878+0000 7f4d6db28800 20 remove_watcher() i=4 2024-09-10T04:50:27.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.878+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860369605296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a1b6c0 2024-09-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.879+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94860369605296] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.879+0000 7f4d6db28800 20 remove_watcher() i=5 2024-09-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.879+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860369609264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x564666a1b6c0 2024-09-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.882+0000 7f4d6904a640 1 -- 172.21.15.145:0/69437468 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94860369609264] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d54036040 con 0x564666a1b6c0 2024-09-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.882+0000 7f4d6db28800 20 remove_watcher() i=6 2024-09-10T04:50:27.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.882+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860369611472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564666a5b4d0 con 0x7f4d5c0c2070 2024-09-10T04:50:27.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94860369611472] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d64041040 con 0x7f4d5c0c2070 2024-09-10T04:50:27.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 20 remove_watcher() i=7 2024-09-10T04:50:27.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564666a16690 msgr2=0x564666a18a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564666a16690 0x564666a18a80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564666a12210 msgr2=0x564666a146d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564666a12210 0x564666a146d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4d5c0c2070 msgr2=0x7f4d5c04f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4d5c0c2070 0x7f4d5c04f7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564666a1b6c0 msgr2=0x564666a1daf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x564666a1b6c0 0x564666a1daf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c3403c780 msgr2=0x7f4c3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c3403c780 0x7f4c3403ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5646668db0a0 tx=0x7f4d54022040 comp rx=0 tx=0).stop 2024-09-10T04:50:27.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 msgr2=0x564666a06c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/69437468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669ff780 0x564666a06c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c05e950 tx=0x7f4d5c06ff00 comp rx=0 tx=0).stop 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 reap_dead start 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6a04c640 1 -- 172.21.15.145:0/69437468 reap_dead start 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 shutdown_connections 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 >> 172.21.15.145:0/69437468 conn(0x5646669fbb80 msgr2=0x5646669f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 shutdown_connections 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/69437468 wait complete. 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 msgr2=0x7f4c4403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 0x7f4c4403ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c010 tx=0x7f4d54006000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 msgr2=0x5646669f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c065b40 tx=0x7f4d5c065f80 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 shutdown_connections 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c4403c780 0x7f4c4403ec40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 --2- 172.21.15.145:0/615095184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646669f3080 0x5646669f34a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 >> 172.21.15.145:0/615095184 conn(0x5646669e7430 msgr2=0x5646669e7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 shutdown_connections 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.883+0000 7f4d6db28800 1 -- 172.21.15.145:0/615095184 wait complete. 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5646669dd580 msgr2=0x5646669df970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5646669dd580 0x5646669df970 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5646668df020 msgr2=0x5646669dc230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5646668df020 0x5646669dc230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5646669e2c00 msgr2=0x5646669e4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5646669e2c00 0x5646669e4ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c5003c730 msgr2=0x7f4c5003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4c5003c730 0x7f4c5003ebf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d540013f0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 msgr2=0x5646668dbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 --2- 172.21.15.145:0/299104881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646668dc600 0x5646668dbd20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c045be0 tx=0x7f4d5c003020 comp rx=0 tx=0).stop 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6a04c640 1 -- 172.21.15.145:0/299104881 reap_dead start 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 shutdown_connections 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 >> 172.21.15.145:0/299104881 conn(0x5646668d61c0 msgr2=0x5646669cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 shutdown_connections 2024-09-10T04:50:27.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.884+0000 7f4d6db28800 1 -- 172.21.15.145:0/299104881 wait complete. 2024-09-10T04:50:27.894 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T04:50:27.895 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T04:50:27.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T04:50:27.895 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-10T04:50:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.948+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.948+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.948+0000 7f176891f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55bcbef15500 0x55bcbef15900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.948+0000 7f176891f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bcbedc0e40 con 0x55bcbef15e40 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.948+0000 7f176891f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55bcbed8b680 con 0x55bcbef15500 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f17646a9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55bcbef15500 0x55bcbef15900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f17646a9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55bcbef15500 0x55bcbef15900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51476/0 (socket says 172.21.15.145:51476) 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f17646a9640 1 -- 172.21.15.145:0/2357298832 learned_addr learned my addr 172.21.15.145:0/2357298832 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f1763ea8640 1 --1- 172.21.15.145:0/2357298832 >> v1:172.21.15.98:6789/0 conn(0x55bcbef15e40 0x55bcbef162f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60336/0 (socket says 172.21.15.145:60336) 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f17646a9640 1 -- 172.21.15.145:0/2357298832 >> v1:172.21.15.98:6789/0 conn(0x55bcbef15e40 legacy=0x55bcbef162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.949+0000 7f17646a9640 1 -- 172.21.15.145:0/2357298832 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbeda76b0 con 0x55bcbef15500 2024-09-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f17646a9640 1 --2- 172.21.15.145:0/2357298832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbef15900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f175400a520 tx=0x7f1754045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88617f8750734975 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f17636a7640 1 -- 172.21.15.145:0/2357298832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754055070 con 0x55bcbef15500 2024-09-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f17636a7640 1 -- 172.21.15.145:0/2357298832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17540515b0 con 0x55bcbef15500 2024-09-10T04:50:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f17636a7640 1 -- 172.21.15.145:0/2357298832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17540518d0 con 0x55bcbef15500 2024-09-10T04:50:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f176891f800 1 -- 172.21.15.145:0/2357298832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 msgr2=0x55bcbef15900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.951+0000 7f176891f800 1 --2- 172.21.15.145:0/2357298832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbef15900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f175400a520 tx=0x7f1754045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.952+0000 7f176891f800 1 -- 172.21.15.145:0/2357298832 shutdown_connections 2024-09-10T04:50:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.952+0000 7f176891f800 1 --2- 172.21.15.145:0/2357298832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbef15900 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.952+0000 7f176891f800 1 -- 172.21.15.145:0/2357298832 >> 172.21.15.145:0/2357298832 conn(0x55bcbef11250 msgr2=0x55bcbef13690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.952+0000 7f176891f800 1 -- 172.21.15.145:0/2357298832 shutdown_connections 2024-09-10T04:50:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.952+0000 7f176891f800 1 -- 172.21.15.145:0/2357298832 wait complete. 2024-09-10T04:50:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.965+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.965+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.965+0000 7f176891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.965+0000 7f176891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bcbedafdd0 con 0x55bcbef15500 2024-09-10T04:50:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51486/0 (socket says 172.21.15.145:51486) 2024-09-10T04:50:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f17646a9640 1 -- 172.21.15.145:0/2569506144 learned_addr learned my addr 172.21.15.145:0/2569506144 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f17646a9640 1 -- 172.21.15.145:0/2569506144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbedc8e10 con 0x55bcbef15500 2024-09-10T04:50:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f17646a9640 1 --2- 172.21.15.145:0/2569506144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17540460d0 tx=0x7f1754051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e336c104b6009f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f165260c640 1 -- 172.21.15.145:0/2569506144 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17540519d0 con 0x55bcbef15500 2024-09-10T04:50:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f165260c640 1 -- 172.21.15.145:0/2569506144 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754051b70 con 0x55bcbef15500 2024-09-10T04:50:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.966+0000 7f165260c640 1 -- 172.21.15.145:0/2569506144 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754051e50 con 0x55bcbef15500 2024-09-10T04:50:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- 172.21.15.145:0/2569506144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 msgr2=0x55bcbf008930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 --2- 172.21.15.145:0/2569506144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17540460d0 tx=0x7f1754051000 comp rx=0 tx=0).stop 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- 172.21.15.145:0/2569506144 shutdown_connections 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 --2- 172.21.15.145:0/2569506144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf008930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- 172.21.15.145:0/2569506144 >> 172.21.15.145:0/2569506144 conn(0x55bcbef11250 msgr2=0x55bcbf0042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- 172.21.15.145:0/2569506144 shutdown_connections 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- 172.21.15.145:0/2569506144 wait complete. 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.967+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f176891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf010150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f176891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bcbef16dc0 con 0x55bcbef15500 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf010150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf010150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51500/0 (socket says 172.21.15.145:51500) 2024-09-10T04:50:27.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f17646a9640 1 -- 172.21.15.145:0/3285650398 learned_addr learned my addr 172.21.15.145:0/3285650398 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f17646a9640 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbf0106b0 con 0x55bcbef15500 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.968+0000 7f17646a9640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf010150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17540460d0 tx=0x7f1754002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.969+0000 7f1650e09640 1 -- 172.21.15.145:0/3285650398 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754073020 con 0x55bcbef15500 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.969+0000 7f1650e09640 1 -- 172.21.15.145:0/3285650398 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175406f580 con 0x55bcbef15500 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.969+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbf010940 con 0x55bcbef15500 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.969+0000 7f1650e09640 1 -- 172.21.15.145:0/3285650398 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175406f8a0 con 0x55bcbef15500 2024-09-10T04:50:27.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.969+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbf011550 con 0x55bcbef15500 2024-09-10T04:50:27.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1650e09640 1 -- 172.21.15.145:0/3285650398 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1754076020 con 0x55bcbef15500 2024-09-10T04:50:27.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1650e09640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f164c03c730 0x7f164c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1650e09640 1 -- 172.21.15.145:0/3285650398 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f175406b040 con 0x55bcbef15500 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1763ea8640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f164c03c730 0x7f164c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbef15e40 0x55bcbf0177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf017ce0 con 0x55bcbef15e40 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1764eaa640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbef15e40 0x55bcbf0177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.970+0000 7f1763ea8640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f164c03c730 0x7f164c03ebf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1758001e30 tx=0x7f1758001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.971+0000 7f1764eaa640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbef15e40 0x55bcbf0177a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.971+0000 7f1764eaa640 1 -- 172.21.15.145:0/3285650398 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbef15e40 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.971+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0185e0 0x55bcbf01aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.971+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf01b1e0 con 0x55bcbf0185e0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.971+0000 7f17646a9640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0185e0 0x55bcbf01aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f17646a9640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0185e0 0x55bcbf01aa70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f17646a9640 1 -- 172.21.15.145:0/3285650398 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1754057030 con 0x55bcbf0185e0 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf01ca90 con 0x55bcbef15e40 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f1764eaa640 1 -- 172.21.15.145:0/3285650398 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbef15e40 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf01bcc0 con 0x55bcbf0185e0 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f17646a9640 1 -- 172.21.15.145:0/3285650398 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1754057030 con 0x55bcbf0185e0 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.972+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bcbf01de40 0x55bcbf020230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf020770 con 0x55bcbf01de40 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f1763ea8640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bcbf01de40 0x55bcbf020230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f1763ea8640 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bcbf01de40 0x55bcbf020230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f1763ea8640 1 -- 172.21.15.145:0/3285650398 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f175800bd50 con 0x55bcbf01de40 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.973+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f176891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f176891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bcbee0da00 con 0x55bcbf02e310 2024-09-10T04:50:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51508/0 (socket says 172.21.15.145:51508) 2024-09-10T04:50:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f17646a9640 1 -- 172.21.15.145:0/2195919382 learned_addr learned my addr 172.21.15.145:0/2195919382 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f17646a9640 1 -- 172.21.15.145:0/2195919382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbf02ed70 con 0x55bcbf02e310 2024-09-10T04:50:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.974+0000 7f17646a9640 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1754096330 tx=0x7f1754064b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f1649ffb640 1 -- 172.21.15.145:0/2195919382 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175407ce70 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f1649ffb640 1 -- 172.21.15.145:0/2195919382 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175408f900 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f1649ffb640 1 -- 172.21.15.145:0/2195919382 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175408fbe0 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbf02f5a0 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbf02fb40 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.975+0000 7f1649ffb640 1 -- 172.21.15.145:0/2195919382 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1754058070 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f1649ffb640 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 0x7f163c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f1649ffb640 1 -- 172.21.15.145:0/2195919382 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1754062070 con 0x55bcbf02e310 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f1763ea8640 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 0x7f163c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f1763ea8640 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 0x7f163c03ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bcbf012070 tx=0x7f175800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f176891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f176891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bcbf0090c0 con 0x55bcbf03aba0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51512/0 (socket says 172.21.15.145:51512) 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.976+0000 7f17646a9640 1 -- 172.21.15.145:0/3156913326 learned_addr learned my addr 172.21.15.145:0/3156913326 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f17646a9640 1 -- 172.21.15.145:0/3156913326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbf03b590 con 0x55bcbf03aba0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f17646a9640 1 --2- 172.21.15.145:0/3156913326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f175408f130 tx=0x7f1754079cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94d0a2ddc7e3cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f163b7fe640 1 -- 172.21.15.145:0/3156913326 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754081440 con 0x55bcbf03aba0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f163b7fe640 1 -- 172.21.15.145:0/3156913326 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754078400 con 0x55bcbf03aba0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f163b7fe640 1 -- 172.21.15.145:0/3156913326 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754079830 con 0x55bcbf03aba0 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 -- 172.21.15.145:0/3156913326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 msgr2=0x55bcbf03afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 --2- 172.21.15.145:0/3156913326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f175408f130 tx=0x7f1754079cc0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 -- 172.21.15.145:0/3156913326 shutdown_connections 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 --2- 172.21.15.145:0/3156913326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf03afa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 -- 172.21.15.145:0/3156913326 >> 172.21.15.145:0/3156913326 conn(0x55bcbf036fa0 msgr2=0x55bcbf0351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 -- 172.21.15.145:0/3156913326 shutdown_connections 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.977+0000 7f176891f800 1 -- 172.21.15.145:0/3156913326 wait complete. 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f176891f800 1 Processor -- start 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f176891f800 1 -- start start 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f176891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f176891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bcbf03ba00 con 0x55bcbf03aba0 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f17646a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51528/0 (socket says 172.21.15.145:51528) 2024-09-10T04:50:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 learned_addr learned my addr 172.21.15.145:0/1169920557 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbf042580 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.978+0000 7f17646a9640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1754070970 tx=0x7f1754063f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f1639ffb640 1 -- 172.21.15.145:0/1169920557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17540bc070 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f1639ffb640 1 -- 172.21.15.145:0/1169920557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754081750 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f1639ffb640 1 -- 172.21.15.145:0/1169920557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1754077790 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbf042580 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbf042580 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.979+0000 7f1639ffb640 1 -- 172.21.15.145:0/1169920557 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f17540bf070 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f1639ffb640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f162c03c780 0x7f162c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f1639ffb640 1 -- 172.21.15.145:0/1169920557 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f17540b4070 con 0x55bcbf03aba0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f1763ea8640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f162c03c780 0x7f162c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f1763ea8640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f162c03c780 0x7f162c03ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bcbf01ca60 tx=0x7f1758010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbf04d570 0x55bcbf04fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf050180 con 0x55bcbf04d570 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.980+0000 7f1764eaa640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbf04d570 0x55bcbf04fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f1764eaa640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbf04d570 0x55bcbf04fa30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 realm 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf04c8a0 con 0x55bcbf04d570 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf050c10 con 0x55bcbf04d570 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0519f0 0x55bcbf053de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.981+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf054440 con 0x55bcbf0519f0 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f17646a9640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0519f0 0x55bcbf053de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f17646a9640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0519f0 0x55bcbf053de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f176891f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf054c90 con 0x55bcbf04d570 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.982+0000 7f176891f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f176891f800 20 searching for the correct realm 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bcbf056a00 0x55bcbf058e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f1763ea8640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bcbf056a00 0x55bcbf058e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f1763ea8640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bcbf056a00 0x55bcbf058e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f17646a9640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f17540c1060 0x7f1754078690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.983+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f17540c1060 0x7f1754078690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f17540c1060 0x7f1754078690 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f175c00a4d0 con 0x7f17540c1060 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.984+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.985+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c00a4d0 con 0x55bcbf04d570 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x7f17540c1060 2024-09-10T04:50:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.986+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f175c030040 con 0x7f17540c1060 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.987+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.988+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x7f17540c1060 2024-09-10T04:50:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf04d570 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x7f17540c1060 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.989+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x7f17540c1060 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175c030040 con 0x7f17540c1060 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.990+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf056a00 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0594e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf055640 con 0x55bcbf04d570 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175c030040 con 0x55bcbf04d570 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.991+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf055ee0 con 0x55bcbf0519f0 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf055280 con 0x7f17540c1060 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 zone default found 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 4 Realm: () 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 zonegroup default 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0599f0 con 0x7f17540c1060 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.992+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05b850 con 0x55bcbf056a00 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05bda0 con 0x55bcbf056a00 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 20 started sync module instance, tier type = 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.993+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05acc0 con 0x55bcbf0519f0 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.994+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.994+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94269147033776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05a920 con 0x55bcbf0519f0 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.994+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05ccd0 con 0x55bcbf04d570 2024-09-10T04:50:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.995+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94269147033776] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.995+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.995+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94269147038208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05ccd0 con 0x55bcbf04d570 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.995+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05d6f0 con 0x55bcbf0519f0 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.998+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94269147038208] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.998+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.998+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94269147042272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05ccd0 con 0x55bcbf0519f0 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.998+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05e180 con 0x7f17540c1060 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.999+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.999+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94269147044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05e180 con 0x7f17540c1060 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:27.999+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05f120 con 0x55bcbf0519f0 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.000+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94269147042272] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.000+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.000+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94269147048944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05f0e0 con 0x55bcbf0519f0 2024-09-10T04:50:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.000+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05fb30 con 0x55bcbf056a00 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.002+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94269147044992] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.002+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94269147048944] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.003+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.003+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94269147039776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf05e5a0 con 0x55bcbf056a00 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.003+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0603d0 con 0x55bcbf056a00 2024-09-10T04:50:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.004+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94269147039776] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.006+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.006+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94269147051648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf060c20 con 0x55bcbf056a00 2024-09-10T04:50:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.006+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0615e0 con 0x7f17540c1060 2024-09-10T04:50:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94269147051648] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94269147056464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0615e0 con 0x7f17540c1060 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=0 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=1 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=2 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=3 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=4 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=5 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.009+0000 7f176891f800 20 add_watcher() i=6 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.011+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94269147056464] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.011+0000 7f176891f800 20 add_watcher() i=7 2024-09-10T04:50:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.011+0000 7f176891f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.011+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0649e0 con 0x55bcbf04d570 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.012+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.012+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94269147058944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf061f30 con 0x55bcbf04d570 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94269147058944] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f161afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f176891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f176891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f176891f800 5 note: GC not initialized 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.013+0000 7f1619fdb640 20 reqs_thread_entry: start 2024-09-10T04:50:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 Filter name: none 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f158b7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf097b10 con 0x55bcbf04d570 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T04:50:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0961b0 con 0x55bcbf04d570 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf0961b0 con 0x55bcbf04d570 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.014+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.015+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf096b00 con 0x55bcbf04d570 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f176891f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f176891f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94269147276832 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf09b400 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94269147048944 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55bcbf02f5a0 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f163b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94269147048944 notifier 4293 bl.length()=567 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.4 [notify cookie 94269147276832 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f163b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f163b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f163b7fe640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1630003ea0 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94269147276832 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bcbf02ed70 con 0x55bcbf0519f0 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.016+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf096620 con 0x55bcbf04d570 2024-09-10T04:50:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.017+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.017+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.017+0000 7f176891f800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.017+0000 7f176891f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.017+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94269147276720 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf09b810 con 0x7f17540c1060 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== watch-notify(notify (1) cookie 94269147044992 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55bcbf096ea0 con 0x7f17540c1060 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f163b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94269147044992 notifier 4293 bl.length()=169 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f163b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f163b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [notify cookie 94269147276720 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f163b7fe640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1630003ea0 con 0x7f17540c1060 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== watch-notify(notify_complete (2) cookie 94269147276720 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bcbf097630 con 0x7f17540c1060 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.018+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf099540 con 0x55bcbf04d570 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.019+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.019+0000 7f176891f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.019+0000 7f176891f800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.019+0000 7f176891f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.019+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94269147291456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf09b370 con 0x7f17540c1060 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== watch-notify(notify (1) cookie 94269147044992 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55bcbf097630 con 0x7f17540c1060 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f163affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94269147044992 notifier 4293 bl.length()=177 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f163affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f163affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T04:50:28.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f163affd640 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1598003400 con 0x7f17540c1060 2024-09-10T04:50:28.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(72 notify.3 [notify cookie 94269147291456 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== watch-notify(notify_complete (2) cookie 94269147291456 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f175c00d820 con 0x7f17540c1060 2024-09-10T04:50:28.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.020+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.034 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.021+0000 7f161afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.021+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94269147058944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf04d570 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.022+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94269147058944] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.022+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94269147033776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf0519f0 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.023+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94269147033776] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.023+0000 7f176891f800 20 remove_watcher() i=0 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.023+0000 7f176891f800 2 removed watcher, disabling cache 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.023+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94269147038208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf04d570 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.024+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94269147038208] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x55bcbf04d570 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.024+0000 7f176891f800 20 remove_watcher() i=1 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.024+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94269147042272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf0519f0 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.025+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94269147042272] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.025+0000 7f176891f800 20 remove_watcher() i=2 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.025+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94269147044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x7f17540c1060 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.026+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94269147044992] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.026+0000 7f176891f800 20 remove_watcher() i=3 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.026+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94269147048944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf0519f0 2024-09-10T04:50:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.027+0000 7f17646a9640 1 -- 172.21.15.145:0/1169920557 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94269147048944] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17540be030 con 0x55bcbf0519f0 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.027+0000 7f176891f800 20 remove_watcher() i=4 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.027+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94269147039776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf056a00 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.028+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94269147039776] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.028+0000 7f176891f800 20 remove_watcher() i=5 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.028+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94269147051648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x55bcbf056a00 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.029+0000 7f1763ea8640 1 -- 172.21.15.145:0/1169920557 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94269147051648] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1758037040 con 0x55bcbf056a00 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.029+0000 7f176891f800 20 remove_watcher() i=6 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.029+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94269147056464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcbf095920 con 0x7f17540c1060 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94269147056464] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175c041040 con 0x7f17540c1060 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 20 remove_watcher() i=7 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0519f0 msgr2=0x55bcbf053de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0519f0 0x55bcbf053de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbf04d570 msgr2=0x55bcbf04fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbf04d570 0x55bcbf04fa30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f17540c1060 msgr2=0x7f1754078690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f17540c1060 0x7f1754078690 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bcbf056a00 msgr2=0x55bcbf058e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bcbf056a00 0x55bcbf058e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f162c03c780 msgr2=0x7f162c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f162c03c780 0x7f162c03ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bcbf01ca60 tx=0x7f1758010000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 msgr2=0x55bcbf042020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f1764eaa640 1 -- 172.21.15.145:0/1169920557 reap_dead start 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1754070970 tx=0x7f1754063f20 comp rx=0 tx=0).stop 2024-09-10T04:50:28.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 shutdown_connections 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 --2- 172.21.15.145:0/1169920557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf03aba0 0x55bcbf042020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.032+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 >> 172.21.15.145:0/1169920557 conn(0x55bcbf036fa0 msgr2=0x55bcbf0351b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 shutdown_connections 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/1169920557 wait complete. 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 msgr2=0x7f163c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 0x7f163c03ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bcbf012070 tx=0x7f175800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 msgr2=0x55bcbf02e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1754096330 tx=0x7f1754064b00 comp rx=0 tx=0).stop 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 shutdown_connections 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f163c03c780 0x7f163c03ec40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/2195919382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbf02e310 0x55bcbf02e730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 >> 172.21.15.145:0/2195919382 conn(0x55bcbf0226c0 msgr2=0x55bcbf022aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 shutdown_connections 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/2195919382 wait complete. 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0185e0 msgr2=0x55bcbf01aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bcbf0185e0 0x55bcbf01aa70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbef15e40 msgr2=0x55bcbf0177a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bcbef15e40 0x55bcbf0177a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bcbf01de40 msgr2=0x55bcbf020230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bcbf01de40 0x55bcbf020230 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f164c03c730 msgr2=0x7f164c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f164c03c730 0x7f164c03ebf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1758001e30 tx=0x7f1758001390 comp rx=0 tx=0).stop 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 msgr2=0x55bcbf010150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f176891f800 1 --2- 172.21.15.145:0/3285650398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bcbef15500 0x55bcbf010150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17540460d0 tx=0x7f1754002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.033+0000 7f1764eaa640 1 -- 172.21.15.145:0/3285650398 reap_dead start 2024-09-10T04:50:28.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.034+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 shutdown_connections 2024-09-10T04:50:28.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.034+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 >> 172.21.15.145:0/3285650398 conn(0x55bcbef11250 msgr2=0x55bcbf002aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.034+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 shutdown_connections 2024-09-10T04:50:28.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.034+0000 7f176891f800 1 -- 172.21.15.145:0/3285650398 wait complete. 2024-09-10T04:50:28.047 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.047 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T04:50:28.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T04:50:28.047 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-10T04:50:28.095 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.096 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f238252c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55915c2d7e10 0x55915c2d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f238252c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55915c182e40 con 0x55915c2d9050 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f238252c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55915c14d680 con 0x55915c2d7e10 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f237e2da640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55915c2d7e10 0x55915c2d8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f237e2da640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55915c2d7e10 0x55915c2d8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51530/0 (socket says 172.21.15.145:51530) 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.094+0000 7f237e2da640 1 -- 172.21.15.145:0/4257070558 learned_addr learned my addr 172.21.15.145:0/4257070558 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.095+0000 7f237e2da640 1 -- 172.21.15.145:0/4257070558 >> v1:172.21.15.98:6789/0 conn(0x55915c2d9050 legacy=0x55915c2dddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.095+0000 7f237e2da640 1 -- 172.21.15.145:0/4257070558 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c1696b0 con 0x55915c2d7e10 2024-09-10T04:50:28.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.096+0000 7f237e2da640 1 --2- 172.21.15.145:0/4257070558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c2d8b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f237000c710 tx=0x7f23700483b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c18d542545011ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f237d2d8640 1 -- 172.21.15.145:0/4257070558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237004fc30 con 0x55915c2d7e10 2024-09-10T04:50:28.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f237d2d8640 1 -- 172.21.15.145:0/4257070558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2370053070 con 0x55915c2d7e10 2024-09-10T04:50:28.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f237d2d8640 1 -- 172.21.15.145:0/4257070558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370057410 con 0x55915c2d7e10 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 -- 172.21.15.145:0/4257070558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 msgr2=0x55915c2d8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 --2- 172.21.15.145:0/4257070558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c2d8b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f237000c710 tx=0x7f23700483b0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 -- 172.21.15.145:0/4257070558 shutdown_connections 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 --2- 172.21.15.145:0/4257070558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c2d8b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 -- 172.21.15.145:0/4257070558 >> 172.21.15.145:0/4257070558 conn(0x55915c2d31e0 msgr2=0x55915c2d5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 -- 172.21.15.145:0/4257070558 shutdown_connections 2024-09-10T04:50:28.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.097+0000 7f238252c800 1 -- 172.21.15.145:0/4257070558 wait complete. 2024-09-10T04:50:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f238252c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f238252c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55915c171dd0 con 0x55915c2d7e10 2024-09-10T04:50:28.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51534/0 (socket says 172.21.15.145:51534) 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.111+0000 7f237e2da640 1 -- 172.21.15.145:0/1110927694 learned_addr learned my addr 172.21.15.145:0/1110927694 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.112+0000 7f237e2da640 1 -- 172.21.15.145:0/1110927694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c18ae10 con 0x55915c2d7e10 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.112+0000 7f237e2da640 1 --2- 172.21.15.145:0/1110927694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2370059040 tx=0x7f2370051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eefd5f16bd2440 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.112+0000 7f226c608640 1 -- 172.21.15.145:0/1110927694 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370068070 con 0x55915c2d7e10 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.112+0000 7f226c608640 1 -- 172.21.15.145:0/1110927694 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2370057600 con 0x55915c2d7e10 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.112+0000 7f226c608640 1 -- 172.21.15.145:0/1110927694 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23700578e0 con 0x55915c2d7e10 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- 172.21.15.145:0/1110927694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 msgr2=0x55915c3c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 --2- 172.21.15.145:0/1110927694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2370059040 tx=0x7f2370051000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- 172.21.15.145:0/1110927694 shutdown_connections 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 --2- 172.21.15.145:0/1110927694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3c6450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- 172.21.15.145:0/1110927694 >> 172.21.15.145:0/1110927694 conn(0x55915c2d31e0 msgr2=0x55915c3c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- 172.21.15.145:0/1110927694 shutdown_connections 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- 172.21.15.145:0/1110927694 wait complete. 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f238252c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55915c2d9740 con 0x55915c2d7e10 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.113+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51538/0 (socket says 172.21.15.145:51538) 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f237e2da640 1 -- 172.21.15.145:0/4066129973 learned_addr learned my addr 172.21.15.145:0/4066129973 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f237e2da640 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c3ce220 con 0x55915c2d7e10 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f237e2da640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3cdcc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23700281e0 tx=0x7f2370003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f226ae05640 1 -- 172.21.15.145:0/4066129973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370068070 con 0x55915c2d7e10 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f226ae05640 1 -- 172.21.15.145:0/4066129973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2370069040 con 0x55915c2d7e10 2024-09-10T04:50:28.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55915c3ce4b0 con 0x55915c2d7e10 2024-09-10T04:50:28.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f226ae05640 1 -- 172.21.15.145:0/4066129973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23700635e0 con 0x55915c2d7e10 2024-09-10T04:50:28.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.114+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915c3ceeb0 con 0x55915c2d7e10 2024-09-10T04:50:28.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f226ae05640 1 -- 172.21.15.145:0/4066129973 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2370055030 con 0x55915c2d7e10 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f226ae05640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f226403c730 0x7f226403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f226ae05640 1 -- 172.21.15.145:0/4066129973 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f237009a370 con 0x55915c2d7e10 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f237dad9640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f226403c730 0x7f226403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c2d9050 0x55915c3d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c3d5850 con 0x55915c2d9050 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.115+0000 7f237eadb640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c2d9050 0x55915c3d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f237dad9640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f226403c730 0x7f226403ebf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2374001eb0 tx=0x7f2374001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f237eadb640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c2d9050 0x55915c3d5310 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f237eadb640 1 -- 172.21.15.145:0/4066129973 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083e0 con 0x55915c2d9050 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c3d6100 0x55915c3d8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c3d8d00 con 0x55915c3d6100 2024-09-10T04:50:28.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.116+0000 7f237e2da640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c3d6100 0x55915c3d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f237e2da640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c3d6100 0x55915c3d8590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f237e2da640 1 -- 172.21.15.145:0/4066129973 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2370073020 con 0x55915c3d6100 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c3da5b0 con 0x55915c2d9050 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f237eadb640 1 -- 172.21.15.145:0/4066129973 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23780083e0 con 0x55915c2d9050 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c3d97e0 con 0x55915c3d6100 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f237e2da640 1 -- 172.21.15.145:0/4066129973 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2370073020 con 0x55915c3d6100 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.117+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55915c3db960 0x55915c3ddd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c3de290 con 0x55915c3db960 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f237dad9640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55915c3db960 0x55915c3ddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f237dad9640 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55915c3db960 0x55915c3ddd50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f237dad9640 1 -- 172.21.15.145:0/4066129973 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23740106a0 con 0x55915c3db960 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.118+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f238252c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f238252c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55915c1cfa00 con 0x55915c3f0250 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51544/0 (socket says 172.21.15.145:51544) 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f237e2da640 1 -- 172.21.15.145:0/624282476 learned_addr learned my addr 172.21.15.145:0/624282476 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f237e2da640 1 -- 172.21.15.145:0/624282476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c3f0cb0 con 0x55915c3f0250 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f237e2da640 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2370056fb0 tx=0x7f2370076e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f2263fff640 1 -- 172.21.15.145:0/624282476 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370083070 con 0x55915c3f0250 2024-09-10T04:50:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f2263fff640 1 -- 172.21.15.145:0/624282476 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23700603c0 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55915c3f14e0 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f2263fff640 1 -- 172.21.15.145:0/624282476 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370065d10 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.119+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915c3f14e0 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.120+0000 7f2263fff640 1 -- 172.21.15.145:0/624282476 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2370091020 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.120+0000 7f2263fff640 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 0x7f225803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.120+0000 7f2263fff640 1 -- 172.21.15.145:0/624282476 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2370088c60 con 0x55915c3f0250 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.120+0000 7f237dad9640 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 0x7f225803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237dad9640 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 0x7f225803ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55915c3d9b80 tx=0x7f2374006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f238252c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f238252c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55915c3c6c40 con 0x55915c3fc900 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51546/0 (socket says 172.21.15.145:51546) 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237e2da640 1 -- 172.21.15.145:0/1375820819 learned_addr learned my addr 172.21.15.145:0/1375820819 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237e2da640 1 -- 172.21.15.145:0/1375820819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c3fd2f0 con 0x55915c3fc900 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f237e2da640 1 --2- 172.21.15.145:0/1375820819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23700637a0 tx=0x7f2370065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164c980023ec4886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f2261ffb640 1 -- 172.21.15.145:0/1375820819 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237006c360 con 0x55915c3fc900 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.121+0000 7f2261ffb640 1 -- 172.21.15.145:0/1375820819 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2370005550 con 0x55915c3fc900 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f2261ffb640 1 -- 172.21.15.145:0/1375820819 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237006c980 con 0x55915c3fc900 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- 172.21.15.145:0/1375820819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 msgr2=0x55915c3fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 --2- 172.21.15.145:0/1375820819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f23700637a0 tx=0x7f2370065eb0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- 172.21.15.145:0/1375820819 shutdown_connections 2024-09-10T04:50:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 --2- 172.21.15.145:0/1375820819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c3fcd00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- 172.21.15.145:0/1375820819 >> 172.21.15.145:0/1375820819 conn(0x55915c3f8d00 msgr2=0x55915c3f6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- 172.21.15.145:0/1375820819 shutdown_connections 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- 172.21.15.145:0/1375820819 wait complete. 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 Processor -- start 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 -- start start 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.122+0000 7f238252c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f238252c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55915c3fd760 con 0x55915c3fc900 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f237e2da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51550/0 (socket says 172.21.15.145:51550) 2024-09-10T04:50:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 learned_addr learned my addr 172.21.15.145:0/1909219611 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55915c4042c0 con 0x55915c3fc900 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f237e2da640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2370005700 tx=0x7f2370089f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f224ffff640 1 -- 172.21.15.145:0/1909219611 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237006cc80 con 0x55915c3fc900 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f224ffff640 1 -- 172.21.15.145:0/1909219611 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2370091310 con 0x55915c3fc900 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f224ffff640 1 -- 172.21.15.145:0/1909219611 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23700759a0 con 0x55915c3fc900 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55915c4042c0 con 0x55915c3fc900 2024-09-10T04:50:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.123+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915c4042c0 con 0x55915c3fc900 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.124+0000 7f224ffff640 1 -- 172.21.15.145:0/1909219611 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2370075c00 con 0x55915c3fc900 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.124+0000 7f224ffff640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f224803c730 0x7f224803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.124+0000 7f224ffff640 1 -- 172.21.15.145:0/1909219611 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f23700a1070 con 0x55915c3fc900 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.124+0000 7f237dad9640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f224803c730 0x7f224803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f237dad9640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f224803c730 0x7f224803ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f237400c010 tx=0x7f2374011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c40f390 0x55915c411850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c411fa0 con 0x55915c40f390 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f237eadb640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c40f390 0x55915c411850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.125+0000 7f237eadb640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c40f390 0x55915c411850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083e0 con 0x55915c40f390 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 realm 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c40e6c0 con 0x55915c40f390 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083e0 con 0x55915c40f390 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c412a30 con 0x55915c40f390 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23780083e0 con 0x55915c40f390 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c413810 0x55915c415c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c416260 con 0x55915c413810 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.126+0000 7f237e2da640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c413810 0x55915c415c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f237e2da640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c413810 0x55915c415c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f23780083e0 con 0x55915c40f390 2024-09-10T04:50:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 20 searching for the correct realm 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55915c418820 0x55915c41ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c41b300 con 0x55915c418820 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.127+0000 7f237dad9640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55915c418820 0x55915c41ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237dad9640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55915c418820 0x55915c41ac30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c41b300 con 0x55915c413810 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237e2da640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f23700af040 0x7f2370065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c41b300 con 0x7f23700af040 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237eadb640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f23700af040 0x7f2370065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.128+0000 7f237eadb640 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f23700af040 0x7f2370065250 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23780083e0 con 0x7f23700af040 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23780083e0 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.129+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.130+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x7f23700af040 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x7f23700af040 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.131+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.132+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.133+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c40f390 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.134+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c418820 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55915c416ab0 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.135+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c417300 con 0x55915c40f390 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c4176f0 con 0x55915c413810 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c417b10 con 0x7f23700af040 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 zone default found 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 4 Realm: () 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 zonegroup default 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.136+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c41b780 con 0x7f23700af040 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c41d270 con 0x55915c418820 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c41d790 con 0x55915c418820 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 started sync module instance, tier type = 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.137+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41c610 con 0x55915c413810 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.138+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.138+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94082806434304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41c270 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.138+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41e6c0 con 0x55915c40f390 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.139+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.139+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94082806440944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41ee60 con 0x55915c40f390 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.139+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f980 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.139+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94082806434304] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.142+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94082806440944] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.142+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.142+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94082806445136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f940 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.142+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c420220 con 0x7f23700af040 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.143+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94082806445136] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.143+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.143+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94082806438896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f940 con 0x7f23700af040 2024-09-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.143+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c420930 con 0x55915c413810 2024-09-10T04:50:28.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.144+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94082806438896] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.144+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.144+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94082806449216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c420930 con 0x55915c413810 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.144+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c421370 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.145+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94082806449216] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.145+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.145+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94082806451904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c421710 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.145+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c422110 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.146+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94082806451904] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.149+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.149+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94082806446880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c422500 con 0x55915c418820 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.149+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c422f80 con 0x7f23700af040 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94082806458992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c422f40 con 0x7f23700af040 2024-09-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=0 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=1 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=2 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=3 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=4 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.152+0000 7f238252c800 20 add_watcher() i=5 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94082806446880] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f238252c800 20 add_watcher() i=6 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94082806458992] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f238252c800 20 add_watcher() i=7 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f238252c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.154+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c421c20 con 0x55915c40f390 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.155+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.155+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94082806455328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c423940 con 0x55915c40f390 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.156+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94082806455328] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.156+0000 7f2234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.156+0000 7f238252c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.156+0000 7f238252c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.156+0000 7f238252c800 5 note: GC not initialized 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f21af7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 Filter name: none 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f21ad7fa640 20 reqs_thread_entry: start 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c459470 con 0x7f23700af040 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c457b30 con 0x55915c40f390 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=7 2024-09-10T04:50:28.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.157+0000 7f238252c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55915c457f20 con 0x55915c40f390 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.158+0000 7f238252c800 20 get_user_info_from_index found 0 xattrs 2024-09-10T04:50:28.169 INFO:teuthology.orchestra.run.smithi145.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.159+0000 7f2234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.159+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94082806455328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c40b240 con 0x55915c40f390 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.160+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94082806455328] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.160+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94082806434304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c421c20 con 0x55915c413810 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.161+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94082806434304] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.161+0000 7f238252c800 20 remove_watcher() i=0 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.161+0000 7f238252c800 2 removed watcher, disabling cache 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.161+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94082806440944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41ca00 con 0x55915c40f390 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.162+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94082806440944] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x55915c40f390 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.162+0000 7f238252c800 20 remove_watcher() i=1 2024-09-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.162+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94082806445136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41ca00 con 0x55915c413810 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.163+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94082806445136] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.163+0000 7f238252c800 20 remove_watcher() i=2 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.163+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94082806438896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f450 con 0x7f23700af040 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.164+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94082806438896] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.164+0000 7f238252c800 20 remove_watcher() i=3 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.164+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94082806449216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41ca00 con 0x55915c413810 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.165+0000 7f237e2da640 1 -- 172.21.15.145:0/1909219611 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94082806449216] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23700be020 con 0x55915c413810 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.165+0000 7f238252c800 20 remove_watcher() i=4 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.165+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94082806451904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f450 con 0x55915c418820 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.166+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94082806451904] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.166+0000 7f238252c800 20 remove_watcher() i=5 2024-09-10T04:50:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.166+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94082806446880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41ca00 con 0x55915c418820 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.167+0000 7f237dad9640 1 -- 172.21.15.145:0/1909219611 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94082806446880] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2374036040 con 0x55915c418820 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.167+0000 7f238252c800 20 remove_watcher() i=6 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.167+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94082806458992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55915c41f450 con 0x7f23700af040 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94082806458992] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2378025040 con 0x7f23700af040 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 20 remove_watcher() i=7 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c413810 msgr2=0x55915c415c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c413810 0x55915c415c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c40f390 msgr2=0x55915c411850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c40f390 0x55915c411850 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f23700af040 msgr2=0x7f2370065250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f23700af040 0x7f2370065250 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55915c418820 msgr2=0x55915c41ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55915c418820 0x55915c41ac30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f224803c730 msgr2=0x7f224803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f224803c730 0x7f224803ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f237400c010 tx=0x7f2374011000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 msgr2=0x55915c403d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f237eadb640 1 -- 172.21.15.145:0/1909219611 reap_dead start 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2370005700 tx=0x7f2370089f70 comp rx=0 tx=0).stop 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 shutdown_connections 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 --2- 172.21.15.145:0/1909219611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3fc900 0x55915c403d60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 >> 172.21.15.145:0/1909219611 conn(0x55915c3f8d00 msgr2=0x55915c3f6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 shutdown_connections 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.168+0000 7f238252c800 1 -- 172.21.15.145:0/1909219611 wait complete. 2024-09-10T04:50:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 msgr2=0x7f225803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 0x7f225803ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55915c3d9b80 tx=0x7f2374006000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 msgr2=0x55915c3f0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2370056fb0 tx=0x7f2370076e90 comp rx=0 tx=0).stop 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 shutdown_connections 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f225803c780 0x7f225803ec40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/624282476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c3f0250 0x55915c3f0670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 >> 172.21.15.145:0/624282476 conn(0x55915c3e01f0 msgr2=0x55915c3e05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 shutdown_connections 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/624282476 wait complete. 2024-09-10T04:50:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c3d6100 msgr2=0x55915c3d8590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55915c3d6100 0x55915c3d8590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c2d9050 msgr2=0x55915c3d5310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55915c2d9050 0x55915c3d5310 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55915c3db960 msgr2=0x55915c3ddd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55915c3db960 0x55915c3ddd50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f226403c730 msgr2=0x7f226403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f226403c730 0x7f226403ebf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2374001eb0 tx=0x7f2374001430 comp rx=0 tx=0).stop 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 msgr2=0x55915c3cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 --2- 172.21.15.145:0/4066129973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55915c2d7e10 0x55915c3cdcc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23700281e0 tx=0x7f2370003330 comp rx=0 tx=0).stop 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f237eadb640 1 -- 172.21.15.145:0/4066129973 reap_dead start 2024-09-10T04:50:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 shutdown_connections 2024-09-10T04:50:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 >> 172.21.15.145:0/4066129973 conn(0x55915c2d31e0 msgr2=0x55915c3c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 shutdown_connections 2024-09-10T04:50:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.169+0000 7f238252c800 1 -- 172.21.15.145:0/4066129973 wait complete. 2024-09-10T04:50:28.180 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-10T04:50:28.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.181 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:28.226 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.226 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.224+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.224+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.224+0000 7f8e722b7800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bc1b4f1f0 0x559bc1b516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.224+0000 7f8e722b7800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559bc19f4e40 con 0x559bc1b4b6e0 2024-09-10T04:50:28.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.224+0000 7f8e722b7800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x559bc19bf680 con 0x559bc1b4f1f0 2024-09-10T04:50:28.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.225+0000 7f8e675a0640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bc1b4f1f0 0x559bc1b516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.225+0000 7f8e675a0640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bc1b4f1f0 0x559bc1b516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51566/0 (socket says 172.21.15.145:51566) 2024-09-10T04:50:28.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.225+0000 7f8e675a0640 1 -- 172.21.15.145:0/2177931319 learned_addr learned my addr 172.21.15.145:0/2177931319 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.225+0000 7f8e675a0640 1 -- 172.21.15.145:0/2177931319 >> v1:172.21.15.98:6789/0 conn(0x559bc1b4b6e0 legacy=0x559bc1b4dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.225+0000 7f8e675a0640 1 -- 172.21.15.145:0/2177931319 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc19db6b0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e675a0640 1 --2- 172.21.15.145:0/2177931319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4f1f0 0x559bc1b516b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800a520 tx=0x7f8e58045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0b9ad3c9979b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e6f5a0640 1 -- 172.21.15.145:0/2177931319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e58055070 con 0x559bc1b4f1f0 2024-09-10T04:50:28.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e6f5a0640 1 -- 172.21.15.145:0/2177931319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e580515b0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e6f5a0640 1 -- 172.21.15.145:0/2177931319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e580518d0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 -- 172.21.15.145:0/2177931319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4f1f0 msgr2=0x559bc1b516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2177931319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4f1f0 0x559bc1b516b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800a520 tx=0x7f8e58045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 -- 172.21.15.145:0/2177931319 shutdown_connections 2024-09-10T04:50:28.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2177931319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4f1f0 0x559bc1b516b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 -- 172.21.15.145:0/2177931319 >> 172.21.15.145:0/2177931319 conn(0x559bc1b451c0 msgr2=0x559bc1b47620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 -- 172.21.15.145:0/2177931319 shutdown_connections 2024-09-10T04:50:28.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.227+0000 7f8e722b7800 1 -- 172.21.15.145:0/2177931319 wait complete. 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.241+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.241+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.241+0000 7f8e722b7800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.241+0000 7f8e722b7800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bc19e3dd0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.242+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.242+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51568/0 (socket says 172.21.15.145:51568) 2024-09-10T04:50:28.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.242+0000 7f8e6fda1640 1 -- 172.21.15.145:0/508163891 learned_addr learned my addr 172.21.15.145:0/508163891 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.242+0000 7f8e6fda1640 1 -- 172.21.15.145:0/508163891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc19fce10 con 0x559bc1b4b6e0 2024-09-10T04:50:28.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.242+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/508163891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e60001da0 tx=0x7f8e6000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f561fadf91b6b0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8d5de0b640 1 -- 172.21.15.145:0/508163891 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6000f400 con 0x559bc1b4b6e0 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8d5de0b640 1 -- 172.21.15.145:0/508163891 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6000f5a0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8d5de0b640 1 -- 172.21.15.145:0/508163891 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6000f8c0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 -- 172.21.15.145:0/508163891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 msgr2=0x559bc1b4ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 --2- 172.21.15.145:0/508163891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e60001da0 tx=0x7f8e6000b5b0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 -- 172.21.15.145:0/508163891 shutdown_connections 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 --2- 172.21.15.145:0/508163891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1b4ae50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 -- 172.21.15.145:0/508163891 >> 172.21.15.145:0/508163891 conn(0x559bc1b451c0 msgr2=0x559bc1c36000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 -- 172.21.15.145:0/508163891 shutdown_connections 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.243+0000 7f8e722b7800 1 -- 172.21.15.145:0/508163891 wait complete. 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e722b7800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1c441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e722b7800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bc1b52030 con 0x559bc1b4b6e0 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1c441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1c441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51584/0 (socket says 172.21.15.145:51584) 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e6fda1640 1 -- 172.21.15.145:0/3788306245 learned_addr learned my addr 172.21.15.145:0/3788306245 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.244+0000 7f8e6fda1640 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc1c44710 con 0x559bc1b4b6e0 2024-09-10T04:50:28.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1c441b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x559bc1b4a980 tx=0x7f8e60000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8d57fff640 1 -- 172.21.15.145:0/3788306245 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6001a7c0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8d57fff640 1 -- 172.21.15.145:0/3788306245 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6001a960 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8d57fff640 1 -- 172.21.15.145:0/3788306245 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6001ac80 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bc1c449a0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.245+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc1c455b0 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8d57fff640 1 -- 172.21.15.145:0/3788306245 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e60017070 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8d57fff640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5803c730 0x7f8d5803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8d57fff640 1 -- 172.21.15.145:0/3788306245 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e60015020 con 0x559bc1b4b6e0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e675a0640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5803c730 0x7f8d5803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1b4f1f0 0x559bc1c4b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c4bd40 con 0x559bc1b4f1f0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e705a2640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1b4f1f0 0x559bc1c4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e675a0640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5803c730 0x7f8d5803ebf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e58057000 tx=0x7f8e58052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.246+0000 7f8e705a2640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1b4f1f0 0x559bc1c4b800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.247+0000 7f8e705a2640 1 -- 172.21.15.145:0/3788306245 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.247+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c4c640 0x559bc1c4ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.247+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c4f240 con 0x559bc1c4c640 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.247+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c4c640 0x559bc1c4ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.247+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c4c640 0x559bc1c4ead0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e6fda1640 1 -- 172.21.15.145:0/3788306245 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c4c640 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c50af0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e705a2640 1 -- 172.21.15.145:0/3788306245 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1b4f1f0 2024-09-10T04:50:28.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c4fd20 con 0x559bc1c4c640 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e6fda1640 1 -- 172.21.15.145:0/3788306245 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c4c640 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bc1c51ea0 0x559bc1c54290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c547d0 con 0x559bc1c51ea0 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.248+0000 7f8e675a0640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bc1c51ea0 0x559bc1c54290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e675a0640 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bc1c51ea0 0x559bc1c54290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e675a0640 1 -- 172.21.15.145:0/3788306245 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c51ea0 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e722b7800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.249+0000 7f8e722b7800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bc1a41a00 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51588/0 (socket says 172.21.15.145:51588) 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e6fda1640 1 -- 172.21.15.145:0/2680504070 learned_addr learned my addr 172.21.15.145:0/2680504070 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e6fda1640 1 -- 172.21.15.145:0/2680504070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc1c62dc0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e6b0 tx=0x7f8e6001cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8d557fa640 1 -- 172.21.15.145:0/2680504070 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e60017db0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8d557fa640 1 -- 172.21.15.145:0/2680504070 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6001b3d0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bc1c635f0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8d557fa640 1 -- 172.21.15.145:0/2680504070 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6001b6b0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.250+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc1c635f0 con 0x559bc1c62360 2024-09-10T04:50:28.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.251+0000 7f8d557fa640 1 -- 172.21.15.145:0/2680504070 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e6000e070 con 0x559bc1c62360 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.251+0000 7f8d557fa640 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 0x7f8d4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.251+0000 7f8d557fa640 1 -- 172.21.15.145:0/2680504070 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e6000abe0 con 0x559bc1c62360 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.251+0000 7f8e675a0640 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 0x7f8d4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e675a0640 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 0x7f8d4803ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559bc1c460f0 tx=0x7f8e58005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e722b7800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e722b7800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bc1b496f0 con 0x559bc1c6ea50 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51594/0 (socket says 172.21.15.145:51594) 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1935730340 learned_addr learned my addr 172.21.15.145:0/1935730340 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1935730340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc1c6f440 con 0x559bc1c6ea50 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.252+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/1935730340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e60052020 tx=0x7f8e60027430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b6a9f7adc9179d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8d4effd640 1 -- 172.21.15.145:0/1935730340 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e600279b0 con 0x559bc1c6ea50 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8d4effd640 1 -- 172.21.15.145:0/1935730340 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6001b850 con 0x559bc1c6ea50 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8d4effd640 1 -- 172.21.15.145:0/1935730340 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6004afc0 con 0x559bc1c6ea50 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- 172.21.15.145:0/1935730340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 msgr2=0x559bc1c6ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1935730340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e60052020 tx=0x7f8e60027430 comp rx=0 tx=0).stop 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- 172.21.15.145:0/1935730340 shutdown_connections 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1935730340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c6ee50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- 172.21.15.145:0/1935730340 >> 172.21.15.145:0/1935730340 conn(0x559bc1c6ae50 msgr2=0x559bc1c69090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- 172.21.15.145:0/1935730340 shutdown_connections 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- 172.21.15.145:0/1935730340 wait complete. 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 Processor -- start 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.253+0000 7f8e722b7800 1 -- start start 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e722b7800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e722b7800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bc1c6f8b0 con 0x559bc1c6ea50 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e6fda1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51600/0 (socket says 172.21.15.145:51600) 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 learned_addr learned my addr 172.21.15.145:0/1990164742 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc1c764d0 con 0x559bc1c6ea50 2024-09-10T04:50:28.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e6001ae40 tx=0x7f8e6000a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8d4d7fa640 1 -- 172.21.15.145:0/1990164742 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e6000ae30 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8d4d7fa640 1 -- 172.21.15.145:0/1990164742 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60068030 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8d4d7fa640 1 -- 172.21.15.145:0/1990164742 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e600317d0 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bc1c764d0 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.254+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc1c764d0 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.255+0000 7f8d4d7fa640 1 -- 172.21.15.145:0/1990164742 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e60031970 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.255+0000 7f8d4d7fa640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d3803c780 0x7f8d3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.255+0000 7f8d4d7fa640 1 -- 172.21.15.145:0/1990164742 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e60059030 con 0x559bc1c6ea50 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.255+0000 7f8e675a0640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d3803c780 0x7f8d3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1c81420 0x559bc1c838e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c84030 con 0x559bc1c81420 2024-09-10T04:50:28.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e705a2640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1c81420 0x559bc1c838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e675a0640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d3803c780 0x7f8d3803ec40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e58000c00 tx=0x7f8e5806d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e705a2640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1c81420 0x559bc1c838e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 20 realm 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c80750 con 0x559bc1c81420 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.256+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c84ac0 con 0x559bc1c81420 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c858a0 0x559bc1c87c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c882c0 con 0x559bc1c858a0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c858a0 0x559bc1c87c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c858a0 0x559bc1c87c90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.257+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c88b60 con 0x559bc1c81420 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 20 searching for the correct realm 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bc1c8a8d0 0x559bc1c8cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e675a0640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bc1c8a8d0 0x559bc1c8cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.258+0000 7f8e675a0640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bc1c8a8d0 0x559bc1c8cd00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e6fda1640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e6005db30 0x7f8e6004c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e705a2640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e6005db30 0x7f8e6004c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.259+0000 7f8e705a2640 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e6005db30 0x7f8e6004c8d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e6800a4d0 con 0x7f8e6005db30 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.260+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6800a4d0 con 0x559bc1c81420 2024-09-10T04:50:28.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.261+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x7f8e6005db30 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e68030040 con 0x7f8e6005db30 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.262+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.263+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x7f8e6005db30 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.264+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c81420 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x7f8e6005db30 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x7f8e6005db30 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e68030040 con 0x7f8e6005db30 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.265+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d3d0 con 0x559bc1c858a0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8e6008a040 con 0x559bc1c858a0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8e6008a040 con 0x559bc1c8a8d0 2024-09-10T04:50:28.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8e6008a040 con 0x559bc1c858a0 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.266+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8e6008a040 con 0x559bc1c858a0 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c894b0 con 0x559bc1c81420 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e68030040 con 0x559bc1c81420 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c89930 con 0x559bc1c858a0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c89dd0 con 0x7f8e6005db30 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 zone default found 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 4 Realm: () 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 zonegroup default 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.267+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8d8a0 con 0x7f8e6005db30 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8f3f0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8f890 con 0x559bc1c8a8d0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 started sync module instance, tier type = 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.268+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8e730 con 0x559bc1c858a0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.270+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.270+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94127459461920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c901a0 con 0x559bc1c858a0 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.270+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c909f0 con 0x559bc1c81420 2024-09-10T04:50:28.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.271+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.271+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94127459467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c90c30 con 0x559bc1c81420 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.271+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c91750 con 0x559bc1c858a0 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.271+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94127459461920] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.272+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94127459467680] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.272+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.272+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94127459471904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c90bf0 con 0x559bc1c858a0 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.272+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c92020 con 0x7f8e6005db30 2024-09-10T04:50:28.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.273+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94127459471904] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.273+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.273+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94127459466480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c90bf0 con 0x7f8e6005db30 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.273+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c926d0 con 0x559bc1c858a0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.274+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94127459466480] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.274+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.274+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94127459475904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c92690 con 0x559bc1c858a0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.274+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c92690 con 0x559bc1c8a8d0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.275+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94127459475904] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.275+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.275+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94127459478576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c93500 con 0x559bc1c8a8d0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.275+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c93ec0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.276+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94127459478576] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.276+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.276+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94127459479632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c94760 con 0x559bc1c8a8d0 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.277+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c95030 con 0x7f8e6005db30 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94127459479632] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94127459486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c95450 con 0x7f8e6005db30 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=0 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=1 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=2 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=3 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=4 2024-09-10T04:50:28.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=5 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.278+0000 7f8e722b7800 20 add_watcher() i=6 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94127459486464] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e722b7800 20 add_watcher() i=7 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e722b7800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c98880 con 0x559bc1c81420 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.279+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94127459484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c95dd0 con 0x559bc1c81420 2024-09-10T04:50:28.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.280+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94127459484336] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.280+0000 7f8d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.280+0000 7f8e722b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.280+0000 7f8e722b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.280+0000 7f8e722b7800 5 note: GC not initialized 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8d24fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e722b7800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e722b7800 20 Filter name: none 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8c9e7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e722b7800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bc1ccb430 con 0x559bc1c81420 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.281+0000 7f8e722b7800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.296 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.282+0000 7f8d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.282+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94127459484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1cca2c0 con 0x559bc1c81420 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.283+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94127459484336] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.283+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94127459461920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c942b0 con 0x559bc1c858a0 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.284+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94127459461920] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.284+0000 7f8e722b7800 20 remove_watcher() i=0 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.284+0000 7f8e722b7800 2 removed watcher, disabling cache 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.284+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94127459467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x559bc1c81420 2024-09-10T04:50:28.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.285+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94127459467680] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x559bc1c81420 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.285+0000 7f8e722b7800 20 remove_watcher() i=1 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.285+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94127459471904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x559bc1c858a0 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.286+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94127459471904] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.286+0000 7f8e722b7800 20 remove_watcher() i=2 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.286+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94127459466480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x7f8e6005db30 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.287+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94127459466480] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.287+0000 7f8e722b7800 20 remove_watcher() i=3 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.287+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94127459475904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x559bc1c858a0 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.288+0000 7f8e6fda1640 1 -- 172.21.15.145:0/1990164742 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94127459475904] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e6002e070 con 0x559bc1c858a0 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.288+0000 7f8e722b7800 20 remove_watcher() i=4 2024-09-10T04:50:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.288+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94127459478576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c921c0 con 0x559bc1c8a8d0 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.289+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94127459478576] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.289+0000 7f8e722b7800 20 remove_watcher() i=5 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.289+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94127459479632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x559bc1c8a8d0 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.290+0000 7f8e675a0640 1 -- 172.21.15.145:0/1990164742 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94127459479632] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e58057030 con 0x559bc1c8a8d0 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.290+0000 7f8e722b7800 20 remove_watcher() i=6 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.290+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94127459486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bc1c8eb20 con 0x7f8e6005db30 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94127459486464] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e68041040 con 0x7f8e6005db30 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 20 remove_watcher() i=7 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c858a0 msgr2=0x559bc1c87c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c858a0 0x559bc1c87c90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1c81420 msgr2=0x559bc1c838e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1c81420 0x559bc1c838e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e6005db30 msgr2=0x7f8e6004c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e6005db30 0x7f8e6004c8d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bc1c8a8d0 msgr2=0x559bc1c8cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bc1c8a8d0 0x559bc1c8cd00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d3803c780 msgr2=0x7f8d3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d3803c780 0x7f8d3803ec40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e58000c00 tx=0x7f8e5806d040 comp rx=0 tx=0).stop 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 msgr2=0x559bc1c75f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e705a2640 1 -- 172.21.15.145:0/1990164742 reap_dead start 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e6001ae40 tx=0x7f8e6000a880 comp rx=0 tx=0).stop 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 shutdown_connections 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 --2- 172.21.15.145:0/1990164742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c6ea50 0x559bc1c75f70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 >> 172.21.15.145:0/1990164742 conn(0x559bc1c6ae50 msgr2=0x559bc1c69060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 shutdown_connections 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.291+0000 7f8e722b7800 1 -- 172.21.15.145:0/1990164742 wait complete. 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 msgr2=0x7f8d4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 0x7f8d4803ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559bc1c460f0 tx=0x7f8e58005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 msgr2=0x559bc1c62780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e6b0 tx=0x7f8e6001cf90 comp rx=0 tx=0).stop 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 shutdown_connections 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d4803c780 0x7f8d4803ec40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/2680504070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1c62360 0x559bc1c62780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 >> 172.21.15.145:0/2680504070 conn(0x559bc1c56710 msgr2=0x559bc1c56af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 shutdown_connections 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/2680504070 wait complete. 2024-09-10T04:50:28.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c4c640 msgr2=0x559bc1c4ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bc1c4c640 0x559bc1c4ead0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1b4f1f0 msgr2=0x559bc1c4b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bc1b4f1f0 0x559bc1c4b800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bc1c51ea0 msgr2=0x559bc1c54290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bc1c51ea0 0x559bc1c54290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5803c730 msgr2=0x7f8d5803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5803c730 0x7f8d5803ebf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e58057000 tx=0x7f8e58052000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 msgr2=0x559bc1c441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 --2- 172.21.15.145:0/3788306245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bc1b4b6e0 0x559bc1c441b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x559bc1b4a980 tx=0x7f8e60000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e705a2640 1 -- 172.21.15.145:0/3788306245 reap_dead start 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 shutdown_connections 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 >> 172.21.15.145:0/3788306245 conn(0x559bc1b451c0 msgr2=0x559bc1c35b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 shutdown_connections 2024-09-10T04:50:28.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.292+0000 7f8e722b7800 1 -- 172.21.15.145:0/3788306245 wait complete. 2024-09-10T04:50:28.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T04:50:28.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T04:50:28.308 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T04:50:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.350+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.350+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.350+0000 7f2e3ad23800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b45bd61200 0x55b45bd636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.350+0000 7f2e3ad23800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b45bc06e40 con 0x55b45bd5d600 2024-09-10T04:50:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.350+0000 7f2e3ad23800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55b45bbd1680 con 0x55b45bd61200 2024-09-10T04:50:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.351+0000 7f2e36212640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b45bd61200 0x55b45bd636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.351+0000 7f2e36212640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b45bd61200 0x55b45bd636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51610/0 (socket says 172.21.15.145:51610) 2024-09-10T04:50:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.351+0000 7f2e36212640 1 -- 172.21.15.145:0/3045844125 learned_addr learned my addr 172.21.15.145:0/3045844125 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.351+0000 7f2e36212640 1 -- 172.21.15.145:0/3045844125 >> v1:172.21.15.98:6789/0 conn(0x55b45bd5d600 legacy=0x55b45bd5f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.351+0000 7f2e36212640 1 -- 172.21.15.145:0/3045844125 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45bbed6b0 con 0x55b45bd61200 2024-09-10T04:50:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.353+0000 7f2e36212640 1 --2- 172.21.15.145:0/3045844125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd61200 0x55b45bd636c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00a520 tx=0x7f2e2c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66741fce09d94ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.353+0000 7f2e35a11640 1 -- 172.21.15.145:0/3045844125 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e2c055070 con 0x55b45bd61200 2024-09-10T04:50:28.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.353+0000 7f2e35a11640 1 -- 172.21.15.145:0/3045844125 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c0515b0 con 0x55b45bd61200 2024-09-10T04:50:28.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.353+0000 7f2e35a11640 1 -- 172.21.15.145:0/3045844125 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e2c0518d0 con 0x55b45bd61200 2024-09-10T04:50:28.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3045844125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd61200 msgr2=0x55b45bd636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3045844125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd61200 0x55b45bd636c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00a520 tx=0x7f2e2c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3045844125 shutdown_connections 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3045844125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd61200 0x55b45bd636c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3045844125 >> 172.21.15.145:0/3045844125 conn(0x55b45bd571c0 msgr2=0x55b45bd59620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3045844125 shutdown_connections 2024-09-10T04:50:28.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.354+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3045844125 wait complete. 2024-09-10T04:50:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.367+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.367+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e3ad23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e3ad23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b45bbf5dd0 con 0x55b45bd5d600 2024-09-10T04:50:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51622/0 (socket says 172.21.15.145:51622) 2024-09-10T04:50:28.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e36a13640 1 -- 172.21.15.145:0/2345898747 learned_addr learned my addr 172.21.15.145:0/2345898747 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e36a13640 1 -- 172.21.15.145:0/2345898747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45bc0ee10 con 0x55b45bd5d600 2024-09-10T04:50:28.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2e36a13640 1 --2- 172.21.15.145:0/2345898747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001670 tx=0x7f2e28001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b65e0a92d6a1baa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.368+0000 7f2d24e09640 1 -- 172.21.15.145:0/2345898747 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28016070 con 0x55b45bd5d600 2024-09-10T04:50:28.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2d24e09640 1 -- 172.21.15.145:0/2345898747 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2800f660 con 0x55b45bd5d600 2024-09-10T04:50:28.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2d24e09640 1 -- 172.21.15.145:0/2345898747 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e2800f980 con 0x55b45bd5d600 2024-09-10T04:50:28.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2345898747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 msgr2=0x55b45be4c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2345898747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001670 tx=0x7f2e28001b30 comp rx=0 tx=0).stop 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2345898747 shutdown_connections 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2345898747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be4c680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2345898747 >> 172.21.15.145:0/2345898747 conn(0x55b45bd571c0 msgr2=0x55b45be48000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2345898747 shutdown_connections 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.369+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2345898747 wait complete. 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e3ad23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be53fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e3ad23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b45bd64040 con 0x55b45bd5d600 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be53fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be53fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51632/0 (socket says 172.21.15.145:51632) 2024-09-10T04:50:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e36a13640 1 -- 172.21.15.145:0/16764370 learned_addr learned my addr 172.21.15.145:0/16764370 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e36a13640 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45be54510 con 0x55b45bd5d600 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.370+0000 7f2e36a13640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be53fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b45be4d610 tx=0x7f2e28000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2d23606640 1 -- 172.21.15.145:0/16764370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28021020 con 0x55b45bd5d600 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2d23606640 1 -- 172.21.15.145:0/16764370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e280117c0 con 0x55b45bd5d600 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45be547a0 con 0x55b45bd5d600 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2d23606640 1 -- 172.21.15.145:0/16764370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28016040 con 0x55b45bd5d600 2024-09-10T04:50:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b45be551a0 con 0x55b45bd5d600 2024-09-10T04:50:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.371+0000 7f2d23606640 1 -- 172.21.15.145:0/16764370 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e28024020 con 0x55b45bd5d600 2024-09-10T04:50:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2d23606640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1c03c730 0x7f2d1c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2d23606640 1 -- 172.21.15.145:0/16764370 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e28053390 con 0x55b45bd5d600 2024-09-10T04:50:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e36212640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1c03c730 0x7f2d1c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45bd61200 0x55b45be5b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be5bb40 con 0x55b45bd61200 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e37214640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45bd61200 0x55b45be5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e36212640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1c03c730 0x7f2d1c03ebf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c057000 tx=0x7f2e2c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.372+0000 7f2e37214640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45bd61200 0x55b45be5b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e37214640 1 -- 172.21.15.145:0/16764370 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45bd61200 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be5c3f0 0x55b45be5e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be5f020 con 0x55b45be5c3f0 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e36a13640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be5c3f0 0x55b45be5e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e36a13640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be5c3f0 0x55b45be5e8b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e36a13640 1 -- 172.21.15.145:0/16764370 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e2800f070 con 0x55b45be5c3f0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.373+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be608d0 con 0x55b45bd61200 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e37214640 1 -- 172.21.15.145:0/16764370 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45bd61200 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be5fb00 con 0x55b45be5c3f0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e36a13640 1 -- 172.21.15.145:0/16764370 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e2800f070 con 0x55b45be5c3f0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b45be61c80 0x55b45be64070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be645b0 con 0x55b45be61c80 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e36212640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b45be61c80 0x55b45be64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.374+0000 7f2e36212640 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b45be61c80 0x55b45be64070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e36212640 1 -- 172.21.15.145:0/16764370 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be61c80 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e3ad23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e3ad23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b45bc53a00 con 0x55b45be72100 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51640/0 (socket says 172.21.15.145:51640) 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.375+0000 7f2e36a13640 1 -- 172.21.15.145:0/2298795235 learned_addr learned my addr 172.21.15.145:0/2298795235 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2e36a13640 1 -- 172.21.15.145:0/2298795235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45be72b60 con 0x55b45be72100 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2e36a13640 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e280069d0 tx=0x7f2e28011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2d20e01640 1 -- 172.21.15.145:0/2298795235 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28047020 con 0x55b45be72100 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2d20e01640 1 -- 172.21.15.145:0/2298795235 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e28051c20 con 0x55b45be72100 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45be73390 con 0x55b45be72100 2024-09-10T04:50:28.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2d20e01640 1 -- 172.21.15.145:0/2298795235 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28043990 con 0x55b45be72100 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.376+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b45be73930 con 0x55b45be72100 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2d20e01640 1 -- 172.21.15.145:0/2298795235 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e28043b30 con 0x55b45be72100 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2d20e01640 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 0x7f2d1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2d20e01640 1 -- 172.21.15.145:0/2298795235 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e28050050 con 0x55b45be72100 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e36212640 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 0x7f2d1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e36212640 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 0x7f2d1003ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55b45be55ee0 tx=0x7f2e2c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e3ad23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.377+0000 7f2e3ad23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b45be4ced0 con 0x55b45be7ea20 2024-09-10T04:50:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51652/0 (socket says 172.21.15.145:51652) 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e36a13640 1 -- 172.21.15.145:0/4157026177 learned_addr learned my addr 172.21.15.145:0/4157026177 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e36a13640 1 -- 172.21.15.145:0/4157026177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45be7f3f0 con 0x55b45be7ea20 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e36a13640 1 --2- 172.21.15.145:0/4157026177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2e280517c0 tx=0x7f2e2804bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65e17697d311cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2d1a7fc640 1 -- 172.21.15.145:0/4157026177 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28043e20 con 0x55b45be7ea20 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2d1a7fc640 1 -- 172.21.15.145:0/4157026177 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2804a310 con 0x55b45be7ea20 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2d1a7fc640 1 -- 172.21.15.145:0/4157026177 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e28043750 con 0x55b45be7ea20 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e3ad23800 1 -- 172.21.15.145:0/4157026177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 msgr2=0x55b45be7ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/4157026177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2e280517c0 tx=0x7f2e2804bf20 comp rx=0 tx=0).stop 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e3ad23800 1 -- 172.21.15.145:0/4157026177 shutdown_connections 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.378+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/4157026177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be7ee00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 -- 172.21.15.145:0/4157026177 >> 172.21.15.145:0/4157026177 conn(0x55b45be7ae20 msgr2=0x55b45be79060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 -- 172.21.15.145:0/4157026177 shutdown_connections 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 -- 172.21.15.145:0/4157026177 wait complete. 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 Processor -- start 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 -- start start 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e3ad23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b45be7f880 con 0x55b45be7ea20 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e36a13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51654/0 (socket says 172.21.15.145:51654) 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 learned_addr learned my addr 172.21.15.145:0/3293410307 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.379+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45be86380 con 0x55b45be7ea20 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2e36a13640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2e28039300 tx=0x7f2e2803a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2d18ff9640 1 -- 172.21.15.145:0/3293410307 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e2806a070 con 0x55b45be7ea20 2024-09-10T04:50:28.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2d18ff9640 1 -- 172.21.15.145:0/3293410307 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e28027410 con 0x55b45be7ea20 2024-09-10T04:50:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45be86380 con 0x55b45be7ea20 2024-09-10T04:50:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2d18ff9640 1 -- 172.21.15.145:0/3293410307 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e2802e390 con 0x55b45be7ea20 2024-09-10T04:50:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b45be86380 con 0x55b45be7ea20 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.380+0000 7f2d18ff9640 1 -- 172.21.15.145:0/3293410307 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e2806d070 con 0x55b45be7ea20 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2d18ff9640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d0003c780 0x7f2d0003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2d18ff9640 1 -- 172.21.15.145:0/3293410307 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e28070ca0 con 0x55b45be7ea20 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2e36212640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d0003c780 0x7f2d0003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2e36212640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d0003c780 0x7f2d0003ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c051fd0 tx=0x7f2e2c06d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45be91400 0x55b45be938c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.381+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be94010 con 0x55b45be91400 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e37214640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45be91400 0x55b45be938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e37214640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45be91400 0x55b45be938c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45be91400 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 20 realm 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be90730 con 0x55b45be91400 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45be91400 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.382+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be94aa0 con 0x55b45be91400 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45be91400 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be95880 0x55b45be97c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be982d0 con 0x55b45be95880 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e36a13640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be95880 0x55b45be97c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e36a13640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be95880 0x55b45be97c70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.383+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45be91400 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e3ad23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e3ad23800 20 searching for the correct realm 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b45be9a890 0x55b45be9ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9d390 con 0x55b45be9a890 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e36212640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b45be9a890 0x55b45be9ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e36212640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b45be9a890 0x55b45be9ccc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9d390 con 0x55b45be95880 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.384+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e36a13640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2e2806f060 0x7f2e280536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9d390 con 0x7f2e2806f060 2024-09-10T04:50:28.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2e2806f060 0x7f2e280536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2e2806f060 0x7f2e280536f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e300083e0 con 0x7f2e2806f060 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e300083e0 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.385+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.386+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x7f2e2806f060 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x7f2e2806f060 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.387+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.388+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.389+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x7f2e2806f060 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x7f2e2806f060 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.390+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x7f2e2806f060 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be9a890 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.391+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b45be98b20 con 0x55b45be95880 2024-09-10T04:50:28.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be99370 con 0x55b45be91400 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be99760 con 0x55b45be95880 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.392+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be99b80 con 0x7f2e2806f060 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 zone default found 2024-09-10T04:50:28.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 4 Realm: () 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 zonegroup default 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9d810 con 0x7f2e2806f060 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9f300 con 0x55b45be9a890 2024-09-10T04:50:28.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9f760 con 0x55b45be9a890 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 started sync module instance, tier type = 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.393+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45be9e6a0 con 0x55b45be95880 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.395+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.395+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233124530832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea0070 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.395+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea08c0 con 0x55b45be91400 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.396+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233124530832] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.396+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.396+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233124535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea0920 con 0x55b45be91400 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.396+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea1430 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.397+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233124535232] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.397+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.397+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233124540128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea13f0 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.397+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea1ec0 con 0x7f2e2806f060 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.398+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233124540128] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.398+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.398+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233124542960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea1ec0 con 0x7f2e2806f060 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.398+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea28f0 con 0x55b45be95880 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.399+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.399+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233124545536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea2860 con 0x55b45be95880 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.399+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea3880 con 0x55b45be9a890 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.399+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233124542960] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.400+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233124545536] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.400+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.400+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233124547856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea3360 con 0x55b45be9a890 2024-09-10T04:50:28.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.400+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea4120 con 0x55b45be9a890 2024-09-10T04:50:28.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.401+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233124547856] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.402+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.402+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233124537360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea4970 con 0x55b45be9a890 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.402+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea5330 con 0x7f2e2806f060 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233124537360] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233124556416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea5750 con 0x7f2e2806f060 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=0 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=1 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=2 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=3 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=4 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=5 2024-09-10T04:50:28.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.404+0000 7f2e3ad23800 20 add_watcher() i=6 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233124556416] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e3ad23800 20 add_watcher() i=7 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e3ad23800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea8a60 con 0x55b45be91400 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.405+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233124557840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bea5ce0 con 0x55b45be91400 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.406+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233124557840] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.406+0000 7f2ced7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 5 note: GC not initialized 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2c67fff640 20 reqs_thread_entry: start 2024-09-10T04:50:28.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 20 Filter name: none 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2c65ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.407+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45bedbb80 con 0x55b45be91400 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45bede4b0 con 0x7f2e2806f060 2024-09-10T04:50:28.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.408+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bee1be0 con 0x55b45be91400 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e3ad23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e3ad23800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e3ad23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94233124804112 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45bedd4a0 con 0x55b45be95880 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94233124545536 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b45be73390 con 0x55b45be95880 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2d1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94233124545536 notifier 4314 bl.length()=567 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2d1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2d1a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 94233124804112 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.409+0000 7f2d1a7fc640 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2cfc003ea0 con 0x55b45be95880 2024-09-10T04:50:28.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.410+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.410+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94233124804112 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b45be72b60 con 0x55b45be95880 2024-09-10T04:50:28.426 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.410+0000 7f2ced7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.411+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233124557840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be91400 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.412+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94233124557840] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.412+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233124530832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be95880 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.413+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94233124530832] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.413+0000 7f2e3ad23800 20 remove_watcher() i=0 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.413+0000 7f2e3ad23800 2 removed watcher, disabling cache 2024-09-10T04:50:28.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.413+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233124535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be91400 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.414+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94233124535232] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x55b45be91400 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.414+0000 7f2e3ad23800 20 remove_watcher() i=1 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.414+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233124540128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be95880 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.415+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94233124540128] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.415+0000 7f2e3ad23800 20 remove_watcher() i=2 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.415+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233124542960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x7f2e2806f060 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.416+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94233124542960] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.416+0000 7f2e3ad23800 20 remove_watcher() i=3 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.416+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233124545536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be95880 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.417+0000 7f2e36a13640 1 -- 172.21.15.145:0/3293410307 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94233124545536] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2806c030 con 0x55b45be95880 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.417+0000 7f2e3ad23800 20 remove_watcher() i=4 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.417+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233124547856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be9a890 2024-09-10T04:50:28.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.418+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94233124547856] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.418+0000 7f2e3ad23800 20 remove_watcher() i=5 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.418+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233124537360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x55b45be9a890 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.419+0000 7f2e36212640 1 -- 172.21.15.145:0/3293410307 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94233124537360] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2c057030 con 0x55b45be9a890 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.419+0000 7f2e3ad23800 20 remove_watcher() i=6 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.419+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233124556416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45bed9a40 con 0x7f2e2806f060 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94233124556416] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e30025040 con 0x7f2e2806f060 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 20 remove_watcher() i=7 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be95880 msgr2=0x55b45be97c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be95880 0x55b45be97c70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45be91400 msgr2=0x55b45be938c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45be91400 0x55b45be938c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2e2806f060 msgr2=0x7f2e280536f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2e2806f060 0x7f2e280536f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b45be9a890 msgr2=0x55b45be9ccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b45be9a890 0x55b45be9ccc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d0003c780 msgr2=0x7f2d0003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d0003c780 0x7f2d0003ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c051fd0 tx=0x7f2e2c06d040 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e37214640 1 -- 172.21.15.145:0/3293410307 reap_dead start 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 msgr2=0x55b45be85e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2e28039300 tx=0x7f2e2803a300 comp rx=0 tx=0).stop 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 shutdown_connections 2024-09-10T04:50:28.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/3293410307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be7ea20 0x55b45be85e20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 >> 172.21.15.145:0/3293410307 conn(0x55b45be7ae20 msgr2=0x55b45be79030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 shutdown_connections 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/3293410307 wait complete. 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 msgr2=0x7f2d1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 0x7f2d1003ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55b45be55ee0 tx=0x7f2e2c005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 msgr2=0x55b45be72520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e280069d0 tx=0x7f2e28011bb0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 shutdown_connections 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.422+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1003c780 0x7f2d1003ec40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/2298795235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45be72100 0x55b45be72520 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 >> 172.21.15.145:0/2298795235 conn(0x55b45be664b0 msgr2=0x55b45be66890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 shutdown_connections 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/2298795235 wait complete. 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be5c3f0 msgr2=0x55b45be5e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b45be5c3f0 0x55b45be5e8b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45bd61200 msgr2=0x55b45be5b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b45bd61200 0x55b45be5b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b45be61c80 msgr2=0x55b45be64070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b45be61c80 0x55b45be64070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1c03c730 msgr2=0x7f2d1c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2d1c03c730 0x7f2d1c03ebf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c057000 tx=0x7f2e2c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 msgr2=0x55b45be53fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 --2- 172.21.15.145:0/16764370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b45bd5d600 0x55b45be53fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b45be4d610 tx=0x7f2e28000f40 comp rx=0 tx=0).stop 2024-09-10T04:50:28.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e37214640 1 -- 172.21.15.145:0/16764370 reap_dead start 2024-09-10T04:50:28.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 shutdown_connections 2024-09-10T04:50:28.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 >> 172.21.15.145:0/16764370 conn(0x55b45bd571c0 msgr2=0x55b45be4d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 shutdown_connections 2024-09-10T04:50:28.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.423+0000 7f2e3ad23800 1 -- 172.21.15.145:0/16764370 wait complete. 2024-09-10T04:50:28.438 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.438 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.438 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:28.482 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.482 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.480+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6128f19800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fc5f370200 0x55fc5f375da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6128f19800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc5f219e40 con 0x55fc5f36edf0 2024-09-10T04:50:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6128f19800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55fc5f1e4680 con 0x55fc5f370200 2024-09-10T04:50:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6126202640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fc5f370200 0x55fc5f375da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6126202640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fc5f370200 0x55fc5f375da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51666/0 (socket says 172.21.15.145:51666) 2024-09-10T04:50:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6126202640 1 -- 172.21.15.145:0/518792295 learned_addr learned my addr 172.21.15.145:0/518792295 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6126202640 1 -- 172.21.15.145:0/518792295 >> v1:172.21.15.98:6789/0 conn(0x55fc5f36edf0 legacy=0x55fc5f36faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.481+0000 7f6126202640 1 -- 172.21.15.145:0/518792295 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f2006b0 con 0x55fc5f370200 2024-09-10T04:50:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.483+0000 7f6126202640 1 --2- 172.21.15.145:0/518792295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f370200 0x55fc5f375da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a6b0 tx=0x7f611c047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff8771ac2c8e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.483+0000 7f6125a01640 1 -- 172.21.15.145:0/518792295 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611c00a200 con 0x55fc5f370200 2024-09-10T04:50:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.483+0000 7f6125a01640 1 -- 172.21.15.145:0/518792295 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c00a3a0 con 0x55fc5f370200 2024-09-10T04:50:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.483+0000 7f6125a01640 1 -- 172.21.15.145:0/518792295 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611c008700 con 0x55fc5f370200 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 -- 172.21.15.145:0/518792295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f370200 msgr2=0x55fc5f375da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 --2- 172.21.15.145:0/518792295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f370200 0x55fc5f375da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a6b0 tx=0x7f611c047e30 comp rx=0 tx=0).stop 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 -- 172.21.15.145:0/518792295 shutdown_connections 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 --2- 172.21.15.145:0/518792295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f370200 0x55fc5f375da0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 -- 172.21.15.145:0/518792295 >> 172.21.15.145:0/518792295 conn(0x55fc5f36a1c0 msgr2=0x55fc5f36c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 -- 172.21.15.145:0/518792295 shutdown_connections 2024-09-10T04:50:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.484+0000 7f6128f19800 1 -- 172.21.15.145:0/518792295 wait complete. 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6128f19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6128f19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fc5f208dd0 con 0x55fc5f36edf0 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51668/0 (socket says 172.21.15.145:51668) 2024-09-10T04:50:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.498+0000 7f6126a03640 1 -- 172.21.15.145:0/2125806794 learned_addr learned my addr 172.21.15.145:0/2125806794 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.499+0000 7f6126a03640 1 -- 172.21.15.145:0/2125806794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f221e10 con 0x55fc5f36edf0 2024-09-10T04:50:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.499+0000 7f6126a03640 1 --2- 172.21.15.145:0/2125806794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6118001da0 tx=0x7f611800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31934c42b4d5826 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.499+0000 7f6014e09640 1 -- 172.21.15.145:0/2125806794 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611800f400 con 0x55fc5f36edf0 2024-09-10T04:50:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.499+0000 7f6014e09640 1 -- 172.21.15.145:0/2125806794 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611800f5a0 con 0x55fc5f36edf0 2024-09-10T04:50:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.499+0000 7f6014e09640 1 -- 172.21.15.145:0/2125806794 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611800f8c0 con 0x55fc5f36edf0 2024-09-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- 172.21.15.145:0/2125806794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 msgr2=0x55fc5f45d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 --2- 172.21.15.145:0/2125806794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6118001da0 tx=0x7f611800b5b0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- 172.21.15.145:0/2125806794 shutdown_connections 2024-09-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 --2- 172.21.15.145:0/2125806794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f45d3e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- 172.21.15.145:0/2125806794 >> 172.21.15.145:0/2125806794 conn(0x55fc5f36a1c0 msgr2=0x55fc5f458d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- 172.21.15.145:0/2125806794 shutdown_connections 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- 172.21.15.145:0/2125806794 wait complete. 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f464d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6128f19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fc5f3708f0 con 0x55fc5f36edf0 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f464d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f464d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51684/0 (socket says 172.21.15.145:51684) 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.500+0000 7f6126a03640 1 -- 172.21.15.145:0/2562167216 learned_addr learned my addr 172.21.15.145:0/2562167216 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6126a03640 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f4652f0 con 0x55fc5f36edf0 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6126a03640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f464d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55fc5f45e370 tx=0x7f6118000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6013606640 1 -- 172.21.15.145:0/2562167216 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611801a690 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6013606640 1 -- 172.21.15.145:0/2562167216 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611801a830 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc5f465580 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6013606640 1 -- 172.21.15.145:0/2562167216 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611801ab50 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.501+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5f465f00 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6013606640 1 -- 172.21.15.145:0/2562167216 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6118017070 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6013606640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600c03c730 0x7f600c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6013606640 1 -- 172.21.15.145:0/2562167216 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6118015020 con 0x55fc5f36edf0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6126202640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600c03c730 0x7f600c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f370200 0x55fc5f46c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f466b70 con 0x55fc5f370200 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.502+0000 7f6127204640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f370200 0x55fc5f46c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6126202640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600c03c730 0x7f600c03ebf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f611c058000 tx=0x7f611c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6127204640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f370200 0x55fc5f46c3e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6127204640 1 -- 172.21.15.145:0/2562167216 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f370200 2024-09-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f46d370 0x55fc5f46f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f46fda0 con 0x55fc5f46d370 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.503+0000 7f6126a03640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f46d370 0x55fc5f46f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6126a03640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f46d370 0x55fc5f46f760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6126a03640 1 -- 172.21.15.145:0/2562167216 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f611802e070 con 0x55fc5f46d370 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f471650 con 0x55fc5f370200 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6127204640 1 -- 172.21.15.145:0/2562167216 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f370200 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f470880 con 0x55fc5f46d370 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6126a03640 1 -- 172.21.15.145:0/2562167216 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f611802e070 con 0x55fc5f46d370 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fc5f472a00 0x55fc5f474df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.504+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f475330 con 0x55fc5f472a00 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.505+0000 7f6126202640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fc5f472a00 0x55fc5f474df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.505+0000 7f6126202640 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fc5f472a00 0x55fc5f474df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.505+0000 7f6126202640 1 -- 172.21.15.145:0/2562167216 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f472a00 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.505+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6128f19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6128f19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fc5f266a00 con 0x55fc5f482e80 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51700/0 (socket says 172.21.15.145:51700) 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6126a03640 1 -- 172.21.15.145:0/3213527452 learned_addr learned my addr 172.21.15.145:0/3213527452 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6126a03640 1 -- 172.21.15.145:0/3213527452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f4838e0 con 0x55fc5f482e80 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6126a03640 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f611800e4d0 tx=0x7f611804b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.506+0000 7f6010e01640 1 -- 172.21.15.145:0/3213527452 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611804a030 con 0x55fc5f482e80 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6010e01640 1 -- 172.21.15.145:0/3213527452 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6118035020 con 0x55fc5f482e80 2024-09-10T04:50:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc5f484110 con 0x55fc5f482e80 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6010e01640 1 -- 172.21.15.145:0/3213527452 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611800ed40 con 0x55fc5f482e80 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5f484110 con 0x55fc5f482e80 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6010e01640 1 -- 172.21.15.145:0/3213527452 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6118038030 con 0x55fc5f482e80 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6010e01640 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 0x7f600003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6010e01640 1 -- 172.21.15.145:0/3213527452 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6118036070 con 0x55fc5f482e80 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.507+0000 7f6126202640 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 0x7f600003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6126202640 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 0x7f600003ec40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55fc5f466350 tx=0x7f611c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6128f19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6128f19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fc5f45dc30 con 0x55fc5f48f5a0 2024-09-10T04:50:28.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51704/0 (socket says 172.21.15.145:51704) 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6126a03640 1 -- 172.21.15.145:0/1336883428 learned_addr learned my addr 172.21.15.145:0/1336883428 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.508+0000 7f6126a03640 1 -- 172.21.15.145:0/1336883428 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f48ff90 con 0x55fc5f48f5a0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6126a03640 1 --2- 172.21.15.145:0/1336883428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61180457d0 tx=0x7f61180455e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229cb31fb0f58c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f600a7fc640 1 -- 172.21.15.145:0/1336883428 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118031e40 con 0x55fc5f48f5a0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f600a7fc640 1 -- 172.21.15.145:0/1336883428 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6118027430 con 0x55fc5f48f5a0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f600a7fc640 1 -- 172.21.15.145:0/1336883428 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118052b70 con 0x55fc5f48f5a0 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 -- 172.21.15.145:0/1336883428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 msgr2=0x55fc5f48f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 --2- 172.21.15.145:0/1336883428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61180457d0 tx=0x7f61180455e0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 -- 172.21.15.145:0/1336883428 shutdown_connections 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 --2- 172.21.15.145:0/1336883428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f48f9a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 -- 172.21.15.145:0/1336883428 >> 172.21.15.145:0/1336883428 conn(0x55fc5f48b9a0 msgr2=0x55fc5f489be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 -- 172.21.15.145:0/1336883428 shutdown_connections 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 -- 172.21.15.145:0/1336883428 wait complete. 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.509+0000 7f6128f19800 1 Processor -- start 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6128f19800 1 -- start start 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6128f19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f49ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6128f19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fc5f490400 con 0x55fc5f48f5a0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f49ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6126a03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f49ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51708/0 (socket says 172.21.15.145:51708) 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 learned_addr learned my addr 172.21.15.145:0/2280419871 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5f49b370 con 0x55fc5f48f5a0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6126a03640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f49ae10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f611801b6e0 tx=0x7f6118020f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6008ff9640 1 -- 172.21.15.145:0/2280419871 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611806c020 con 0x55fc5f48f5a0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6008ff9640 1 -- 172.21.15.145:0/2280419871 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180277b0 con 0x55fc5f48f5a0 2024-09-10T04:50:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6008ff9640 1 -- 172.21.15.145:0/2280419871 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118063040 con 0x55fc5f48f5a0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.510+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc5f49b370 con 0x55fc5f48f5a0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.511+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5f49b370 con 0x55fc5f48f5a0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.511+0000 7f6008ff9640 1 -- 172.21.15.145:0/2280419871 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f611806f020 con 0x55fc5f48f5a0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6008ff9640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ff003c780 0x7f5ff003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6008ff9640 1 -- 172.21.15.145:0/2280419871 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f611805a070 con 0x55fc5f48f5a0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6126202640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ff003c780 0x7f5ff003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f4a6370 0x55fc5f4a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4a8f80 con 0x55fc5f4a6370 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6127204640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f4a6370 0x55fc5f4a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6126202640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ff003c780 0x7f5ff003ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a370 tx=0x7f611c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.512+0000 7f6127204640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f4a6370 0x55fc5f4a8830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 realm 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4a56f0 con 0x55fc5f4a6370 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4a9a10 con 0x55fc5f4a6370 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f4aa7f0 0x55fc5f4acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ad210 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6126a03640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f4aa7f0 0x55fc5f4acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.513+0000 7f6126a03640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f4aa7f0 0x55fc5f4acbe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4adab0 con 0x55fc5f4a6370 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 20 searching for the correct realm 2024-09-10T04:50:28.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fc5f4af820 0x55fc5f4b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6126202640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fc5f4af820 0x55fc5f4b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.514+0000 7f6126202640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fc5f4af820 0x55fc5f4b1c50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6126a03640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f611807c040 0x7f611804c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6127204640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f611807c040 0x7f611804c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.515+0000 7f6127204640 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f611807c040 0x7f611804c8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f612000a4d0 con 0x7f611807c040 2024-09-10T04:50:28.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.516+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612000a4d0 con 0x55fc5f4a6370 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.517+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x7f611807c040 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6120030040 con 0x7f611807c040 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.518+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.519+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4a6370 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.520+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6120030040 con 0x7f611807c040 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.521+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4af820 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b2320 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.522+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ae400 con 0x55fc5f4a6370 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6120030040 con 0x55fc5f4a6370 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ae880 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4aed20 con 0x7f611807c040 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 zone default found 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 4 Realm: () 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 zonegroup default 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b27f0 con 0x7f611807c040 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.523+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b4340 con 0x55fc5f4af820 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b47f0 con 0x55fc5f4af820 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 20 started sync module instance, tier type = 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.524+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b3680 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.525+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.526+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542418885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b3680 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.526+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b5370 con 0x55fc5f4a6370 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.526+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542418885536] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.527+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.527+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542418890304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b3680 con 0x55fc5f4a6370 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.527+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b5e20 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.528+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542418890304] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.528+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.528+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542418893056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b3680 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.528+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b68b0 con 0x7f611807c040 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.529+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542418893056] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.530+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.530+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542418895744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b3680 con 0x7f611807c040 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.530+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b7300 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.530+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.531+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542418898448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b7780 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.531+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b82a0 con 0x55fc5f4af820 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.532+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542418895744] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.532+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.532+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542418902384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b8690 con 0x55fc5f4af820 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.532+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b9090 con 0x55fc5f4af820 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.535+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542418902384] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.535+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542418898448] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.538+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.538+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542418883024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b9480 con 0x55fc5f4af820 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.538+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b9cd0 con 0x7f611807c040 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542418909728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ba570 con 0x7f611807c040 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=0 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=1 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=2 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=3 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=4 2024-09-10T04:50:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.541+0000 7f6128f19800 20 add_watcher() i=5 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.543+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542418883024] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.543+0000 7f6128f19800 20 add_watcher() i=6 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542418909728] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6128f19800 20 add_watcher() i=7 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6128f19800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ba570 con 0x55fc5f4a6370 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.546+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542418911344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ba4c0 con 0x55fc5f4a6370 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542418911344] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f5fdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f6128f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f6128f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f6128f19800 5 note: GC not initialized 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.547+0000 7f5f57fff640 20 reqs_thread_entry: start 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6128f19800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6128f19800 20 Filter name: none 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f5f55ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6128f19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4f00e0 con 0x55fc5f4a6370 2024-09-10T04:50:28.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.548+0000 7f6128f19800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.553 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.549+0000 7f5fdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.549+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542418911344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4eef50 con 0x55fc5f4a6370 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.550+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94542418911344] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.550+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542418885536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ba070 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.552+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94542418885536] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.552+0000 7f6128f19800 20 remove_watcher() i=0 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.552+0000 7f6128f19800 2 removed watcher, disabling cache 2024-09-10T04:50:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.552+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542418890304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4ba070 con 0x55fc5f4a6370 2024-09-10T04:50:28.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.553+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94542418890304] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x55fc5f4a6370 2024-09-10T04:50:28.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.553+0000 7f6128f19800 20 remove_watcher() i=1 2024-09-10T04:50:28.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.553+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542418893056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b4e40 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.554+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94542418893056] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.554+0000 7f6128f19800 20 remove_watcher() i=2 2024-09-10T04:50:28.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.554+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542418895744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b5900 con 0x7f611807c040 2024-09-10T04:50:28.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.555+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94542418895744] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.555+0000 7f6128f19800 20 remove_watcher() i=3 2024-09-10T04:50:28.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.555+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542418898448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b4e40 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.556+0000 7f6126a03640 1 -- 172.21.15.145:0/2280419871 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94542418898448] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118066040 con 0x55fc5f4aa7f0 2024-09-10T04:50:28.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.556+0000 7f6128f19800 20 remove_watcher() i=4 2024-09-10T04:50:28.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.556+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542418902384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b5900 con 0x55fc5f4af820 2024-09-10T04:50:28.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.557+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94542418902384] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.557+0000 7f6128f19800 20 remove_watcher() i=5 2024-09-10T04:50:28.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.557+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542418883024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b6e10 con 0x55fc5f4af820 2024-09-10T04:50:28.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.558+0000 7f6126202640 1 -- 172.21.15.145:0/2280419871 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94542418883024] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f611c008930 con 0x55fc5f4af820 2024-09-10T04:50:28.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.558+0000 7f6128f19800 20 remove_watcher() i=6 2024-09-10T04:50:28.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.558+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542418909728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fc5f4b5900 con 0x7f611807c040 2024-09-10T04:50:28.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94542418909728] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6120041040 con 0x7f611807c040 2024-09-10T04:50:28.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 20 remove_watcher() i=7 2024-09-10T04:50:28.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f4aa7f0 msgr2=0x55fc5f4acbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f4aa7f0 0x55fc5f4acbe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f4a6370 msgr2=0x55fc5f4a8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f4a6370 0x55fc5f4a8830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f611807c040 msgr2=0x7f611804c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f611807c040 0x7f611804c8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fc5f4af820 msgr2=0x55fc5f4b1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fc5f4af820 0x55fc5f4b1c50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ff003c780 msgr2=0x7f5ff003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ff003c780 0x7f5ff003ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f611c00a370 tx=0x7f611c00a000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 msgr2=0x55fc5f49ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 --2- 172.21.15.145:0/2280419871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f48f5a0 0x55fc5f49ae10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f611801b6e0 tx=0x7f6118020f20 comp rx=0 tx=0).stop 2024-09-10T04:50:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 reap_dead start 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6127204640 1 -- 172.21.15.145:0/2280419871 reap_dead start 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 shutdown_connections 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 >> 172.21.15.145:0/2280419871 conn(0x55fc5f48b9a0 msgr2=0x55fc5f489bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 shutdown_connections 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.561+0000 7f6128f19800 1 -- 172.21.15.145:0/2280419871 wait complete. 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 msgr2=0x7f600003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 0x7f600003ec40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55fc5f466350 tx=0x7f611c005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 msgr2=0x55fc5f4832a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f611800e4d0 tx=0x7f611804b390 comp rx=0 tx=0).stop 2024-09-10T04:50:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 shutdown_connections 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600003c780 0x7f600003ec40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/3213527452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f482e80 0x55fc5f4832a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 >> 172.21.15.145:0/3213527452 conn(0x55fc5f477230 msgr2=0x55fc5f477610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 shutdown_connections 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/3213527452 wait complete. 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f46d370 msgr2=0x55fc5f46f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fc5f46d370 0x55fc5f46f760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f370200 msgr2=0x55fc5f46c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fc5f370200 0x55fc5f46c3e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fc5f472a00 msgr2=0x55fc5f474df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fc5f472a00 0x55fc5f474df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600c03c730 msgr2=0x7f600c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f600c03c730 0x7f600c03ebf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f611c058000 tx=0x7f611c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 msgr2=0x55fc5f464d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 --2- 172.21.15.145:0/2562167216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fc5f36edf0 0x55fc5f464d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55fc5f45e370 tx=0x7f6118000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6127204640 1 -- 172.21.15.145:0/2562167216 reap_dead start 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 shutdown_connections 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 >> 172.21.15.145:0/2562167216 conn(0x55fc5f36a1c0 msgr2=0x55fc5f45e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 shutdown_connections 2024-09-10T04:50:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.562+0000 7f6128f19800 1 -- 172.21.15.145:0/2562167216 wait complete. 2024-09-10T04:50:28.573 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.574 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T04:50:28.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T04:50:28.574 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T04:50:28.618 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.618 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.616+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.616+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb70b534800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5561f0e8fff0 0x5561f0e90bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb70b534800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561f0d39e40 con 0x5561f0e910f0 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb70b534800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5561f0d04680 con 0x5561f0e8fff0 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb7072b7640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5561f0e8fff0 0x5561f0e90bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb7072b7640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5561f0e8fff0 0x5561f0e90bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51714/0 (socket says 172.21.15.145:51714) 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb7072b7640 1 -- 172.21.15.145:0/326427080 learned_addr learned my addr 172.21.15.145:0/326427080 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb7072b7640 1 -- 172.21.15.145:0/326427080 >> v1:172.21.15.98:6789/0 conn(0x5561f0e910f0 legacy=0x5561f0e95e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.617+0000 7fb7072b7640 1 -- 172.21.15.145:0/326427080 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0d206b0 con 0x5561f0e8fff0 2024-09-10T04:50:28.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.619+0000 7fb7072b7640 1 --2- 172.21.15.145:0/326427080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e90bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800a520 tx=0x7fb6f8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8160d959f539f09f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.619+0000 7fb7062b5640 1 -- 172.21.15.145:0/326427080 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8055070 con 0x5561f0e8fff0 2024-09-10T04:50:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.619+0000 7fb7062b5640 1 -- 172.21.15.145:0/326427080 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f80515b0 con 0x5561f0e8fff0 2024-09-10T04:50:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.619+0000 7fb7062b5640 1 -- 172.21.15.145:0/326427080 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f80518d0 con 0x5561f0e8fff0 2024-09-10T04:50:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 -- 172.21.15.145:0/326427080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 msgr2=0x5561f0e90bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 --2- 172.21.15.145:0/326427080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e90bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800a520 tx=0x7fb6f8045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 -- 172.21.15.145:0/326427080 shutdown_connections 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 --2- 172.21.15.145:0/326427080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e90bb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 -- 172.21.15.145:0/326427080 >> 172.21.15.145:0/326427080 conn(0x5561f0e8b3c0 msgr2=0x5561f0e8d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 -- 172.21.15.145:0/326427080 shutdown_connections 2024-09-10T04:50:28.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.620+0000 7fb70b534800 1 -- 172.21.15.145:0/326427080 wait complete. 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb70b534800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb70b534800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561f0d28dd0 con 0x5561f0e8fff0 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51720/0 (socket says 172.21.15.145:51720) 2024-09-10T04:50:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb7072b7640 1 -- 172.21.15.145:0/3796067216 learned_addr learned my addr 172.21.15.145:0/3796067216 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb7072b7640 1 -- 172.21.15.145:0/3796067216 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0d41e10 con 0x5561f0e8fff0 2024-09-10T04:50:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.634+0000 7fb7072b7640 1 --2- 172.21.15.145:0/3796067216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80460d0 tx=0x7fb6f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d451fe0754bca21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb5f560a640 1 -- 172.21.15.145:0/3796067216 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f80519d0 con 0x5561f0e8fff0 2024-09-10T04:50:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb5f560a640 1 -- 172.21.15.145:0/3796067216 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8051b70 con 0x5561f0e8fff0 2024-09-10T04:50:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb5f560a640 1 -- 172.21.15.145:0/3796067216 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8051e50 con 0x5561f0e8fff0 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 -- 172.21.15.145:0/3796067216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 msgr2=0x5561f0e056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 --2- 172.21.15.145:0/3796067216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80460d0 tx=0x7fb6f8051000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 -- 172.21.15.145:0/3796067216 shutdown_connections 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 --2- 172.21.15.145:0/3796067216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0e056b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 -- 172.21.15.145:0/3796067216 >> 172.21.15.145:0/3796067216 conn(0x5561f0e8b3c0 msgr2=0x5561f0f7af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 -- 172.21.15.145:0/3796067216 shutdown_connections 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.635+0000 7fb70b534800 1 -- 172.21.15.145:0/3796067216 wait complete. 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb70b534800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0f88f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb70b534800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561f0e917e0 con 0x5561f0e8fff0 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0f88f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0f88f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51734/0 (socket says 172.21.15.145:51734) 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb7072b7640 1 -- 172.21.15.145:0/1521756929 learned_addr learned my addr 172.21.15.145:0/1521756929 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.636+0000 7fb7072b7640 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0f894f0 con 0x5561f0e8fff0 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb7072b7640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0f88f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80460d0 tx=0x7fb6f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb5f3e07640 1 -- 172.21.15.145:0/1521756929 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8073020 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb5f3e07640 1 -- 172.21.15.145:0/1521756929 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f806f580 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f0f89780 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb5f3e07640 1 -- 172.21.15.145:0/1521756929 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f806f8a0 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.637+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f0f8a390 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb5f3e07640 1 -- 172.21.15.145:0/1521756929 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb6f8076020 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb5f3e07640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5ec03c730 0x7fb5ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb5f3e07640 1 -- 172.21.15.145:0/1521756929 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb6f806b040 con 0x5561f0e8fff0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb706ab6640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5ec03c730 0x7fb5ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0e910f0 0x5561f0f905e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0f90b20 con 0x5561f0e910f0 2024-09-10T04:50:28.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb707ab8640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0e910f0 0x5561f0f905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.638+0000 7fb706ab6640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5ec03c730 0x7fb5ec03ebf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc001e50 tx=0x7fb6fc0013d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb707ab8640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0e910f0 0x5561f0f905e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb707ab8640 1 -- 172.21.15.145:0/1521756929 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0e910f0 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0f91420 0x5561f0f938c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0f94030 con 0x5561f0f91420 2024-09-10T04:50:28.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb7072b7640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0f91420 0x5561f0f938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.639+0000 7fb7072b7640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0f91420 0x5561f0f938c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb7072b7640 1 -- 172.21.15.145:0/1521756929 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6f8057030 con 0x5561f0f91420 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0f958e0 con 0x5561f0e910f0 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb707ab8640 1 -- 172.21.15.145:0/1521756929 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0e910f0 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0f94b10 con 0x5561f0f91420 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb7072b7640 1 -- 172.21.15.145:0/1521756929 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6f8057030 con 0x5561f0f91420 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561f0f96c90 0x5561f0f99080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0f995c0 con 0x5561f0f96c90 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.640+0000 7fb706ab6640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561f0f96c90 0x5561f0f99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb706ab6640 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561f0f96c90 0x5561f0f99080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb706ab6640 1 -- 172.21.15.145:0/1521756929 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6fc010600 con 0x5561f0f96c90 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb70b534800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.641+0000 7fb70b534800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561f0d86a00 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51740/0 (socket says 172.21.15.145:51740) 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb7072b7640 1 -- 172.21.15.145:0/656033643 learned_addr learned my addr 172.21.15.145:0/656033643 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb7072b7640 1 -- 172.21.15.145:0/656033643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0fa7bd0 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb7072b7640 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8095f60 tx=0x7fb6f8064470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb5f1602640 1 -- 172.21.15.145:0/656033643 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f808f1d0 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb5f1602640 1 -- 172.21.15.145:0/656033643 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f80507d0 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f0fa8400 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb5f1602640 1 -- 172.21.15.145:0/656033643 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f8050ab0 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.642+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f0fa89a0 con 0x5561f0fa7170 2024-09-10T04:50:28.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.643+0000 7fb5f1602640 1 -- 172.21.15.145:0/656033643 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb6f8058070 con 0x5561f0fa7170 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.643+0000 7fb5f1602640 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 0x7fb5e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.643+0000 7fb5f1602640 1 -- 172.21.15.145:0/656033643 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb6f8062070 con 0x5561f0fa7170 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.643+0000 7fb706ab6640 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 0x7fb5e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.643+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb706ab6640 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 0x7fb5e003ec40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5561f0f94eb0 tx=0x7fb6fc006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb70b534800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb70b534800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561f0e03f50 con 0x5561f0fb3a50 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51742/0 (socket says 172.21.15.145:51742) 2024-09-10T04:50:28.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb7072b7640 1 -- 172.21.15.145:0/1457251834 learned_addr learned my addr 172.21.15.145:0/1457251834 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb7072b7640 1 -- 172.21.15.145:0/1457251834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0fb4440 con 0x5561f0fb3a50 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.644+0000 7fb7072b7640 1 --2- 172.21.15.145:0/1457251834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806faa0 tx=0x7fb6f808c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7102968ffdccf1ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb5eaffd640 1 -- 172.21.15.145:0/1457251834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f80af020 con 0x5561f0fb3a50 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb5eaffd640 1 -- 172.21.15.145:0/1457251834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8077af0 con 0x5561f0fb3a50 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb5eaffd640 1 -- 172.21.15.145:0/1457251834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f806d350 con 0x5561f0fb3a50 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- 172.21.15.145:0/1457251834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 msgr2=0x5561f0fb3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 --2- 172.21.15.145:0/1457251834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806faa0 tx=0x7fb6f808c8c0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- 172.21.15.145:0/1457251834 shutdown_connections 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 --2- 172.21.15.145:0/1457251834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fb3e50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- 172.21.15.145:0/1457251834 >> 172.21.15.145:0/1457251834 conn(0x5561f0fafe50 msgr2=0x5561f0fae090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- 172.21.15.145:0/1457251834 shutdown_connections 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- 172.21.15.145:0/1457251834 wait complete. 2024-09-10T04:50:28.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 Processor -- start 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.645+0000 7fb70b534800 1 -- start start 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb70b534800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fbaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb70b534800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561f0fb48b0 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fbaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb7072b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fbaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51758/0 (socket says 172.21.15.145:51758) 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 learned_addr learned my addr 172.21.15.145:0/4195232575 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f0fbb410 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb7072b7640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fbaeb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8051e30 tx=0x7fb6f80a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb5e97fa640 1 -- 172.21.15.145:0/4195232575 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f80c3070 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb5e97fa640 1 -- 172.21.15.145:0/4195232575 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f806d6b0 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f0fbb410 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb5e97fa640 1 -- 172.21.15.145:0/4195232575 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f806d990 con 0x5561f0fb3a50 2024-09-10T04:50:28.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.646+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f0fbb410 con 0x5561f0fb3a50 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.647+0000 7fb5e97fa640 1 -- 172.21.15.145:0/4195232575 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb6f80c6070 con 0x5561f0fb3a50 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.647+0000 7fb5e97fa640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5d003c6e0 0x7fb5d003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.647+0000 7fb5e97fa640 1 -- 172.21.15.145:0/4195232575 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb6f80bb050 con 0x5561f0fb3a50 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.647+0000 7fb706ab6640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5d003c6e0 0x7fb5d003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb706ab6640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5d003c6e0 0x7fb5d003eba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc010fd0 tx=0x7fb6fc011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0fc62c0 0x5561f0fc8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fc8ed0 con 0x5561f0fc62c0 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb707ab8640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0fc62c0 0x5561f0fc8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.648+0000 7fb707ab8640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0fc62c0 0x5561f0fc8780 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 realm 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fc55f0 con 0x5561f0fc62c0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fc9960 con 0x5561f0fc62c0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0fca740 0x5561f0fccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fcd190 con 0x5561f0fca740 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb7072b7640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0fca740 0x5561f0fccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.649+0000 7fb7072b7640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0fca740 0x5561f0fccb30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fcd9e0 con 0x5561f0fc62c0 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 20 searching for the correct realm 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561f0fcf750 0x5561f0fd1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb706ab6640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561f0fcf750 0x5561f0fd1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.650+0000 7fb706ab6640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561f0fcf750 0x5561f0fd1b40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb7072b7640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb6f80c8060 0x7fb6f8053590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb707ab8640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb6f80c8060 0x7fb6f8053590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.651+0000 7fb707ab8640 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb6f80c8060 0x7fb6f8053590 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb70000a4d0 con 0x7fb6f80c8060 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.652+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.653+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70000a4d0 con 0x5561f0fc62c0 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x7fb6f80c8060 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb700030040 con 0x7fb6f80c8060 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.654+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.655+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.656+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x7fb6f80c8060 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x7fb6f80c8060 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x7fb6f80c8060 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb700030040 con 0x7fb6f80c8060 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.657+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fcf750 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.658+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd2210 con 0x5561f0fca740 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fce390 con 0x5561f0fc62c0 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb700030040 con 0x5561f0fc62c0 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fcec30 con 0x5561f0fca740 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fcdfd0 con 0x7fb6f80c8060 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.659+0000 7fb70b534800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 zone default found 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 4 Realm: () 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 zonegroup default 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd26f0 con 0x7fb6f80c8060 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd4550 con 0x5561f0fcf750 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd4a90 con 0x5561f0fcf750 2024-09-10T04:50:28.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 started sync module instance, tier type = 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.660+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd39c0 con 0x5561f0fca740 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.662+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.662+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879143316912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd53a0 con 0x5561f0fca740 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.662+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd5bf0 con 0x5561f0fc62c0 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.663+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.663+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879143323456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd6150 con 0x5561f0fc62c0 2024-09-10T04:50:28.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.663+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd6c70 con 0x5561f0fca740 2024-09-10T04:50:28.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.666+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879143323456] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.666+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879143316912] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.667+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.667+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879143321328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd6c30 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.667+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd7510 con 0x7fb6f80c8060 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.668+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879143321328] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.669+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.669+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879143327552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd6c30 con 0x7fb6f80c8060 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.669+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd7c20 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.670+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879143327552] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.672+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.672+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879143331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd8040 con 0x5561f0fca740 2024-09-10T04:50:28.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.672+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd8890 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.673+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879143331632] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.673+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.673+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879143329296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd8c30 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.673+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd9480 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.674+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.674+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879143338416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd9c60 con 0x5561f0fcf750 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.674+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fda780 con 0x7fb6f80c8060 2024-09-10T04:50:28.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.675+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879143329296] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879143338416] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879143342672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fda740 con 0x7fb6f80c8060 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=0 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=1 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=2 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=3 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=4 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=5 2024-09-10T04:50:28.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.680+0000 7fb70b534800 20 add_watcher() i=6 2024-09-10T04:50:28.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879143342672] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb70b534800 20 add_watcher() i=7 2024-09-10T04:50:28.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb70b534800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd8070 con 0x5561f0fc62c0 2024-09-10T04:50:28.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.683+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879143339696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f0fd8070 con 0x5561f0fc62c0 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.684+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879143339696] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.684+0000 7fb5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.684+0000 7fb70b534800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.684+0000 7fb70b534800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.684+0000 7fb70b534800 5 note: GC not initialized 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb5bcfe1640 20 reqs_thread_entry: start 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 20 Filter name: none 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb5367fc640 20 reqs_thread_entry: start 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f1010700 con 0x5561f0fc62c0 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.685+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f1013030 con 0x7fb6f80c8060 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.686+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.686+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f1016760 con 0x5561f0fc62c0 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb70b534800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb70b534800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb70b534800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93879143588160 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f1012020 con 0x5561f0fca740 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93879143331632 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5561f0fa8400 con 0x5561f0fca740 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb5ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93879143331632 notifier 4328 bl.length()=567 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 93879143588160 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb5ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb5ea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.687+0000 7fb5ea7fc640 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb53c003430 con 0x5561f0fca740 2024-09-10T04:50:28.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.688+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.688+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93879143588160 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561f0fa7bd0 con 0x5561f0fca740 2024-09-10T04:50:28.692 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.688+0000 7fb5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.688+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879143339696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fc62c0 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.690+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93879143339696] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.690+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879143316912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fca740 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.690+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93879143316912] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.690+0000 7fb70b534800 20 remove_watcher() i=0 2024-09-10T04:50:28.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.691+0000 7fb70b534800 2 removed watcher, disabling cache 2024-09-10T04:50:28.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.691+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879143323456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fc62c0 2024-09-10T04:50:28.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.691+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93879143323456] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x5561f0fc62c0 2024-09-10T04:50:28.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.691+0000 7fb70b534800 20 remove_watcher() i=1 2024-09-10T04:50:28.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.691+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879143321328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fca740 2024-09-10T04:50:28.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.693+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93879143321328] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.693+0000 7fb70b534800 20 remove_watcher() i=2 2024-09-10T04:50:28.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.693+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879143327552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x7fb6f80c8060 2024-09-10T04:50:28.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.694+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93879143327552] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.694+0000 7fb70b534800 20 remove_watcher() i=3 2024-09-10T04:50:28.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.694+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879143331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fca740 2024-09-10T04:50:28.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.695+0000 7fb7072b7640 1 -- 172.21.15.145:0/4195232575 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93879143331632] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f80c5030 con 0x5561f0fca740 2024-09-10T04:50:28.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.695+0000 7fb70b534800 20 remove_watcher() i=4 2024-09-10T04:50:28.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.695+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879143329296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fcf750 2024-09-10T04:50:28.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.696+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93879143329296] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.696+0000 7fb70b534800 20 remove_watcher() i=5 2024-09-10T04:50:28.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.696+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879143338416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x5561f0fcf750 2024-09-10T04:50:28.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.701+0000 7fb706ab6640 1 -- 172.21.15.145:0/4195232575 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93879143338416] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6fc036040 con 0x5561f0fcf750 2024-09-10T04:50:28.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.701+0000 7fb70b534800 20 remove_watcher() i=6 2024-09-10T04:50:28.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.701+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879143342672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f100e560 con 0x7fb6f80c8060 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93879143342672] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb700041040 con 0x7fb6f80c8060 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 20 remove_watcher() i=7 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0fca740 msgr2=0x5561f0fccb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0fca740 0x5561f0fccb30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0fc62c0 msgr2=0x5561f0fc8780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0fc62c0 0x5561f0fc8780 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb6f80c8060 msgr2=0x7fb6f8053590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb6f80c8060 0x7fb6f8053590 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561f0fcf750 msgr2=0x5561f0fd1b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561f0fcf750 0x5561f0fd1b40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5d003c6e0 msgr2=0x7fb5d003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5d003c6e0 0x7fb5d003eba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc010fd0 tx=0x7fb6fc011000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 msgr2=0x5561f0fbaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/4195232575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fb3a50 0x5561f0fbaeb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8051e30 tx=0x7fb6f80a9000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 reap_dead start 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb707ab8640 1 -- 172.21.15.145:0/4195232575 reap_dead start 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 shutdown_connections 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 >> 172.21.15.145:0/4195232575 conn(0x5561f0fafe50 msgr2=0x5561f0fae060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 shutdown_connections 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/4195232575 wait complete. 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 msgr2=0x7fb5e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 0x7fb5e003ec40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5561f0f94eb0 tx=0x7fb6fc006000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 msgr2=0x5561f0fa7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8095f60 tx=0x7fb6f8064470 comp rx=0 tx=0).stop 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 shutdown_connections 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5e003c780 0x7fb5e003ec40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 --2- 172.21.15.145:0/656033643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0fa7170 0x5561f0fa7590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.702+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 >> 172.21.15.145:0/656033643 conn(0x5561f0f9b520 msgr2=0x5561f0f9b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 shutdown_connections 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/656033643 wait complete. 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0f91420 msgr2=0x5561f0f938c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5561f0f91420 0x5561f0f938c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0e910f0 msgr2=0x5561f0f905e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5561f0e910f0 0x5561f0f905e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561f0f96c90 msgr2=0x5561f0f99080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5561f0f96c90 0x5561f0f99080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5ec03c730 msgr2=0x7fb5ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb5ec03c730 0x7fb5ec03ebf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc001e50 tx=0x7fb6fc0013d0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 msgr2=0x5561f0f88f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 --2- 172.21.15.145:0/1521756929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561f0e8fff0 0x5561f0f88f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80460d0 tx=0x7fb6f8002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb707ab8640 1 -- 172.21.15.145:0/1521756929 reap_dead start 2024-09-10T04:50:28.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 shutdown_connections 2024-09-10T04:50:28.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 >> 172.21.15.145:0/1521756929 conn(0x5561f0e8b3c0 msgr2=0x5561f0f7aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 shutdown_connections 2024-09-10T04:50:28.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.703+0000 7fb70b534800 1 -- 172.21.15.145:0/1521756929 wait complete. 2024-09-10T04:50:28.714 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.714 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.715 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:28.759 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.759 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.757+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.757+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f224481d800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x560bff9bb4a0 0x560bff9bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f224481d800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560bff866e40 con 0x560bff9bbde0 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f224481d800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x560bff831680 con 0x560bff9bb4a0 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f223ffeb640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x560bff9bb4a0 0x560bff9bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f22377ea640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x560bff9bbde0 0x560bff9bc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60400/0 (socket says 172.21.15.145:60400) 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f22377ea640 1 -- 172.21.15.145:0/2098282343 learned_addr learned my addr 172.21.15.145:0/2098282343 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f223ffeb640 1 -- 172.21.15.145:0/2098282343 >> v1:172.21.15.98:6789/0 conn(0x560bff9bbde0 legacy=0x560bff9bc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.758+0000 7f223ffeb640 1 -- 172.21.15.145:0/2098282343 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bff84d6b0 con 0x560bff9bb4a0 2024-09-10T04:50:28.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.760+0000 7f223ffeb640 1 --2- 172.21.15.145:0/2098282343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bff9bb8a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f2230045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517e4f82b1341d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.760+0000 7f223f7ea640 1 -- 172.21.15.145:0/2098282343 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230059070 con 0x560bff9bb4a0 2024-09-10T04:50:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.760+0000 7f223f7ea640 1 -- 172.21.15.145:0/2098282343 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230054570 con 0x560bff9bb4a0 2024-09-10T04:50:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.760+0000 7f223f7ea640 1 -- 172.21.15.145:0/2098282343 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230054870 con 0x560bff9bb4a0 2024-09-10T04:50:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 -- 172.21.15.145:0/2098282343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 msgr2=0x560bff9bb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 --2- 172.21.15.145:0/2098282343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bff9bb8a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f2230045880 comp rx=0 tx=0).stop 2024-09-10T04:50:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 -- 172.21.15.145:0/2098282343 shutdown_connections 2024-09-10T04:50:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 --2- 172.21.15.145:0/2098282343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bff9bb8a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 -- 172.21.15.145:0/2098282343 >> 172.21.15.145:0/2098282343 conn(0x560bff9b71f0 msgr2=0x560bff9b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 -- 172.21.15.145:0/2098282343 shutdown_connections 2024-09-10T04:50:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.761+0000 7f224481d800 1 -- 172.21.15.145:0/2098282343 wait complete. 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f224481d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f224481d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bff855dd0 con 0x560bff9bb4a0 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51780/0 (socket says 172.21.15.145:51780) 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f223ffeb640 1 -- 172.21.15.145:0/2754386162 learned_addr learned my addr 172.21.15.145:0/2754386162 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.775+0000 7f223ffeb640 1 -- 172.21.15.145:0/2754386162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bff86ee10 con 0x560bff9bb4a0 2024-09-10T04:50:28.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f223ffeb640 1 --2- 172.21.15.145:0/2754386162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f223004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2757f31e60d54c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f212de0b640 1 -- 172.21.15.145:0/2754386162 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230064070 con 0x560bff9bb4a0 2024-09-10T04:50:28.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f212de0b640 1 -- 172.21.15.145:0/2754386162 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230054850 con 0x560bff9bb4a0 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f212de0b640 1 -- 172.21.15.145:0/2754386162 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230059040 con 0x560bff9bb4a0 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f224481d800 1 -- 172.21.15.145:0/2754386162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 msgr2=0x560bffaae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f224481d800 1 --2- 172.21.15.145:0/2754386162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f223004e000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f224481d800 1 -- 172.21.15.145:0/2754386162 shutdown_connections 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.776+0000 7f224481d800 1 --2- 172.21.15.145:0/2754386162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffaae870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 -- 172.21.15.145:0/2754386162 >> 172.21.15.145:0/2754386162 conn(0x560bff9b71f0 msgr2=0x560bffaaa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 -- 172.21.15.145:0/2754386162 shutdown_connections 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 -- 172.21.15.145:0/2754386162 wait complete. 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffab60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f224481d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bff9bcd60 con 0x560bff9bb4a0 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffab60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffab60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51786/0 (socket says 172.21.15.145:51786) 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.777+0000 7f223ffeb640 1 -- 172.21.15.145:0/687811358 learned_addr learned my addr 172.21.15.145:0/687811358 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f223ffeb640 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bffab6640 con 0x560bff9bb4a0 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f223ffeb640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffab60e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f2230002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f2127fff640 1 -- 172.21.15.145:0/687811358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223006d070 con 0x560bff9bb4a0 2024-09-10T04:50:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f2127fff640 1 -- 172.21.15.145:0/687811358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300695b0 con 0x560bff9bb4a0 2024-09-10T04:50:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bffab68d0 con 0x560bff9bb4a0 2024-09-10T04:50:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f2127fff640 1 -- 172.21.15.145:0/687811358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230064050 con 0x560bff9bb4a0 2024-09-10T04:50:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.778+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bffab74e0 con 0x560bff9bb4a0 2024-09-10T04:50:28.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f2127fff640 1 -- 172.21.15.145:0/687811358 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2230069890 con 0x560bff9bb4a0 2024-09-10T04:50:28.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f2127fff640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f212803c730 0x7f212803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f2127fff640 1 -- 172.21.15.145:0/687811358 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2230096fa0 con 0x560bff9bb4a0 2024-09-10T04:50:28.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f22377ea640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f212803c730 0x7f212803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bff9bbde0 0x560bffabd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.779+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffabdc70 con 0x560bff9bbde0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f22407ec640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bff9bbde0 0x560bffabd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f22377ea640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f212803c730 0x7f212803ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f222800b3b0 tx=0x7f2228001560 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f22407ec640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bff9bbde0 0x560bffabd730 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f22407ec640 1 -- 172.21.15.145:0/687811358 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f223800a4d0 con 0x560bff9bbde0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffabe570 0x560bffac0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffac1170 con 0x560bffabe570 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.780+0000 7f223ffeb640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffabe570 0x560bffac0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f223ffeb640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffabe570 0x560bffac0a00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f223ffeb640 1 -- 172.21.15.145:0/687811358 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2230078070 con 0x560bffabe570 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffac2a20 con 0x560bff9bbde0 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f22407ec640 1 -- 172.21.15.145:0/687811358 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f223800a4d0 con 0x560bff9bbde0 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffac1c50 con 0x560bffabe570 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f223ffeb640 1 -- 172.21.15.145:0/687811358 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2230078070 con 0x560bffabe570 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.781+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x560bffac3dd0 0x560bffac61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.782+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffac6700 con 0x560bffac3dd0 2024-09-10T04:50:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.782+0000 7f22377ea640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x560bffac3dd0 0x560bffac61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.782+0000 7f22377ea640 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x560bffac3dd0 0x560bffac61c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.782+0000 7f22377ea640 1 -- 172.21.15.145:0/687811358 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f222800f870 con 0x560bffac3dd0 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.782+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f224481d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f224481d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bff8b3a00 con 0x560bffad41f0 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51792/0 (socket says 172.21.15.145:51792) 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f223ffeb640 1 -- 172.21.15.145:0/509729760 learned_addr learned my addr 172.21.15.145:0/509729760 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f223ffeb640 1 -- 172.21.15.145:0/509729760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bffad4c50 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.783+0000 7f223ffeb640 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2230006e20 tx=0x7f2230069e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f21257fa640 1 -- 172.21.15.145:0/509729760 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230076040 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f21257fa640 1 -- 172.21.15.145:0/509729760 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223008f9d0 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bffad5480 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f21257fa640 1 -- 172.21.15.145:0/509729760 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230059040 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bffad5480 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f21257fa640 1 -- 172.21.15.145:0/509729760 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f223008fcb0 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.784+0000 7f21257fa640 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 0x7f211803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f21257fa640 1 -- 172.21.15.145:0/509729760 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2230081070 con 0x560bffad41f0 2024-09-10T04:50:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f22377ea640 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 0x7f211803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f22377ea640 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 0x7f211803ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x560bffab8040 tx=0x7f2228006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f224481d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f224481d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bffaaf000 con 0x560bffae08f0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51796/0 (socket says 172.21.15.145:51796) 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f223ffeb640 1 -- 172.21.15.145:0/2106990139 learned_addr learned my addr 172.21.15.145:0/2106990139 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.785+0000 7f223ffeb640 1 -- 172.21.15.145:0/2106990139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bffae12e0 con 0x560bffae08f0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f223ffeb640 1 --2- 172.21.15.145:0/2106990139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2230006a00 tx=0x7f223007bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aca7deedcfc1e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f211effd640 1 -- 172.21.15.145:0/2106990139 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230052c10 con 0x560bffae08f0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f211effd640 1 -- 172.21.15.145:0/2106990139 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230084410 con 0x560bffae08f0 2024-09-10T04:50:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f211effd640 1 -- 172.21.15.145:0/2106990139 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230052340 con 0x560bffae08f0 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 -- 172.21.15.145:0/2106990139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 msgr2=0x560bffae0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 --2- 172.21.15.145:0/2106990139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2230006a00 tx=0x7f223007bf20 comp rx=0 tx=0).stop 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 -- 172.21.15.145:0/2106990139 shutdown_connections 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 --2- 172.21.15.145:0/2106990139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae0cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 -- 172.21.15.145:0/2106990139 >> 172.21.15.145:0/2106990139 conn(0x560bffadccf0 msgr2=0x560bffadaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 -- 172.21.15.145:0/2106990139 shutdown_connections 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.786+0000 7f224481d800 1 -- 172.21.15.145:0/2106990139 wait complete. 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f224481d800 1 Processor -- start 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f224481d800 1 -- start start 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f224481d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f224481d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bffae1750 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f223ffeb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51810/0 (socket says 172.21.15.145:51810) 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 learned_addr learned my addr 172.21.15.145:0/887144831 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bffae81d0 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f223ffeb640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2230006dd0 tx=0x7f223008cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f211d7fa640 1 -- 172.21.15.145:0/887144831 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230052a30 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f211d7fa640 1 -- 172.21.15.145:0/887144831 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230079870 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bffae81d0 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.787+0000 7f211d7fa640 1 -- 172.21.15.145:0/887144831 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230055b80 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.788+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bffae81d0 con 0x560bffae08f0 2024-09-10T04:50:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.788+0000 7f211d7fa640 1 -- 172.21.15.145:0/887144831 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f22300959b0 con 0x560bffae08f0 2024-09-10T04:50:28.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.788+0000 7f211d7fa640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f210803c780 0x7f210803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.788+0000 7f211d7fa640 1 -- 172.21.15.145:0/887144831 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f22300ad070 con 0x560bffae08f0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f22377ea640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f210803c780 0x7f210803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bffaf32a0 0x560bffaf5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffaf5eb0 con 0x560bffaf32a0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f22407ec640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bffaf32a0 0x560bffaf5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f22377ea640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f210803c780 0x7f210803ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x560bffac2970 tx=0x7f2228010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f22407ec640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bffaf32a0 0x560bffaf5760 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 20 realm 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.789+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffaf2620 con 0x560bffaf32a0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffaf6940 con 0x560bffaf32a0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffaf7720 0x560bffaf9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffafa140 con 0x560bffaf7720 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f223ffeb640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffaf7720 0x560bffaf9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.790+0000 7f223ffeb640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffaf7720 0x560bffaf9b10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffafa9e0 con 0x560bffaf32a0 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 20 searching for the correct realm 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x560bffafc750 0x560bffafeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f22377ea640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x560bffafc750 0x560bffafeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.791+0000 7f22377ea640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x560bffafc750 0x560bffafeb60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f223ffeb640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f22300b0030 0x7f223008b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f22407ec640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f22300b0030 0x7f223008b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.792+0000 7f22407ec640 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f22300b0030 0x7f223008b2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f223800a4d0 con 0x7f22300b0030 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.793+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f223800a4d0 con 0x560bffaf32a0 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.794+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x7f22300b0030 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2238030040 con 0x7f22300b0030 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.795+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.796+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.797+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x7f22300b0030 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x7f22300b0030 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.798+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x7f22300b0030 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2238030040 con 0x7f22300b0030 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffafc750 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.799+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff230 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffafb390 con 0x560bffaf32a0 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2238030040 con 0x560bffaf32a0 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffafb810 con 0x560bffaf7720 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.800+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffafbcb0 con 0x7f22300b0030 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 zone default found 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 4 Realm: () 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 zonegroup default 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffaff700 con 0x7f22300b0030 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffb015a0 con 0x560bffafc750 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.801+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffb01940 con 0x560bffafc750 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.802+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.802+0000 7f224481d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.802+0000 7f224481d800 20 started sync module instance, tier type = 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.802+0000 7f224481d800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.802+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb00a30 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.803+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.803+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609534357376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb00a30 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.803+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02340 con 0x560bffaf32a0 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.806+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.806+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609534361168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02310 con 0x560bffaf32a0 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.806+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb03330 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.806+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609534357376] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.807+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.807+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609534365184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb032f0 con 0x560bffaf7720 2024-09-10T04:50:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.807+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb03db0 con 0x7f22300b0030 2024-09-10T04:50:28.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.808+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609534365184] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.808+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.809+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609534361168] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.809+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609534367936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb03db0 con 0x7f22300b0030 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.809+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02730 con 0x560bffaf7720 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.810+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.810+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609534370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02730 con 0x560bffaf7720 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.810+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb051e0 con 0x560bffafc750 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.810+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609534370544] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.811+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609534367936] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.814+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.814+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609534354816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb04710 con 0x560bffafc750 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.814+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb05bf0 con 0x560bffafc750 2024-09-10T04:50:28.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.816+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609534354816] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.816+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.816+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609534373168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb06440 con 0x560bffafc750 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.817+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb06c90 con 0x7f22300b0030 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609534373168] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609534378352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb06b40 con 0x7f22300b0030 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=0 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=1 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=2 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=3 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=4 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=5 2024-09-10T04:50:28.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.819+0000 7f224481d800 20 add_watcher() i=6 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609534378352] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f224481d800 20 add_watcher() i=7 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f224481d800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffb0a110 con 0x560bffaf32a0 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.820+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609534379472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb07630 con 0x560bffaf32a0 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.821+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609534379472] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f20f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 5 note: GC not initialized 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f20f4fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 20 Filter name: none 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f206e7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.822+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bffb3ccd0 con 0x560bffaf32a0 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.823+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.823+0000 7f224481d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.830 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.824+0000 7f20f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.824+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609534379472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb09230 con 0x560bffaf32a0 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.825+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94609534379472] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.825+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609534357376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb06590 con 0x560bffaf7720 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.825+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94609534357376] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.826+0000 7f224481d800 20 remove_watcher() i=0 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.826+0000 7f224481d800 2 removed watcher, disabling cache 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.826+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609534361168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb00f80 con 0x560bffaf32a0 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.827+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94609534361168] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x560bffaf32a0 2024-09-10T04:50:28.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.827+0000 7f224481d800 20 remove_watcher() i=1 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.827+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609534365184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb00f80 con 0x560bffaf7720 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.828+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94609534365184] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.828+0000 7f224481d800 20 remove_watcher() i=2 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.828+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609534367936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02e00 con 0x7f22300b0030 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.829+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94609534367936] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.829+0000 7f224481d800 20 remove_watcher() i=3 2024-09-10T04:50:28.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.829+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609534370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb00f80 con 0x560bffaf7720 2024-09-10T04:50:28.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.830+0000 7f223ffeb640 1 -- 172.21.15.145:0/887144831 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94609534370544] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22300b6020 con 0x560bffaf7720 2024-09-10T04:50:28.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.830+0000 7f224481d800 20 remove_watcher() i=4 2024-09-10T04:50:28.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.830+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609534354816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb038c0 con 0x560bffafc750 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.831+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94609534354816] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.831+0000 7f224481d800 20 remove_watcher() i=5 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.831+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609534373168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb02e00 con 0x560bffafc750 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.833+0000 7f22377ea640 1 -- 172.21.15.145:0/887144831 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94609534373168] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2228037040 con 0x560bffafc750 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.833+0000 7f224481d800 20 remove_watcher() i=6 2024-09-10T04:50:28.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.833+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609534378352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bffb042f0 con 0x7f22300b0030 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94609534378352] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2238041040 con 0x7f22300b0030 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 20 remove_watcher() i=7 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffaf7720 msgr2=0x560bffaf9b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffaf7720 0x560bffaf9b10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bffaf32a0 msgr2=0x560bffaf5760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bffaf32a0 0x560bffaf5760 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f22300b0030 msgr2=0x7f223008b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f22300b0030 0x7f223008b2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x560bffafc750 msgr2=0x560bffafeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x560bffafc750 0x560bffafeb60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f210803c780 msgr2=0x7f210803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f210803c780 0x7f210803ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x560bffac2970 tx=0x7f2228010000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 msgr2=0x560bffae7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f22407ec640 1 -- 172.21.15.145:0/887144831 reap_dead start 2024-09-10T04:50:28.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2230006dd0 tx=0x7f223008cfc0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 shutdown_connections 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 --2- 172.21.15.145:0/887144831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffae08f0 0x560bffae7c70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 >> 172.21.15.145:0/887144831 conn(0x560bffadccf0 msgr2=0x560bffadaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 shutdown_connections 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.834+0000 7f224481d800 1 -- 172.21.15.145:0/887144831 wait complete. 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 msgr2=0x7f211803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 0x7f211803ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x560bffab8040 tx=0x7f2228006000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 msgr2=0x560bffad4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2230006e20 tx=0x7f2230069e70 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 shutdown_connections 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f211803c780 0x7f211803ec40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/509729760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bffad41f0 0x560bffad4610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 >> 172.21.15.145:0/509729760 conn(0x560bffac85a0 msgr2=0x560bffac8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 shutdown_connections 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/509729760 wait complete. 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffabe570 msgr2=0x560bffac0a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x560bffabe570 0x560bffac0a00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bff9bbde0 msgr2=0x560bffabd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560bff9bbde0 0x560bffabd730 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x560bffac3dd0 msgr2=0x560bffac61c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x560bffac3dd0 0x560bffac61c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f212803c730 msgr2=0x7f212803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f212803c730 0x7f212803ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f222800b3b0 tx=0x7f2228001560 comp rx=0 tx=0).stop 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 msgr2=0x560bffab60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 --2- 172.21.15.145:0/687811358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bff9bb4a0 0x560bffab60e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f223000a470 tx=0x7f2230002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f22407ec640 1 -- 172.21.15.145:0/687811358 reap_dead start 2024-09-10T04:50:28.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 shutdown_connections 2024-09-10T04:50:28.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 >> 172.21.15.145:0/687811358 conn(0x560bff9b71f0 msgr2=0x560bffaa89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 shutdown_connections 2024-09-10T04:50:28.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.835+0000 7f224481d800 1 -- 172.21.15.145:0/687811358 wait complete. 2024-09-10T04:50:28.846 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.846 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T04:50:28.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T04:50:28.846 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-10T04:50:28.894 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:28.895 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:28.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.893+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.893+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f300bd19800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557980bd5000 0x557980bddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f300bd19800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557980a7ee40 con 0x557980bd34e0 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f300bd19800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x557980a49680 con 0x557980bd5000 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f3001002640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557980bd5000 0x557980bddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f3001002640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557980bd5000 0x557980bddb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51812/0 (socket says 172.21.15.145:51812) 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f3001002640 1 -- 172.21.15.145:0/824295475 learned_addr learned my addr 172.21.15.145:0/824295475 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f3001002640 1 -- 172.21.15.145:0/824295475 >> v1:172.21.15.98:6789/0 conn(0x557980bd34e0 legacy=0x557980bd38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.894+0000 7f3001002640 1 -- 172.21.15.145:0/824295475 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980a656b0 con 0x557980bd5000 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.896+0000 7f3001002640 1 --2- 172.21.15.145:0/824295475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd5000 0x557980bddb20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400a520 tx=0x7f2ff4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d0e39208d93b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.896+0000 7f3009002640 1 -- 172.21.15.145:0/824295475 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff4055070 con 0x557980bd5000 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.896+0000 7f3009002640 1 -- 172.21.15.145:0/824295475 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff40515b0 con 0x557980bd5000 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.896+0000 7f3009002640 1 -- 172.21.15.145:0/824295475 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff40518d0 con 0x557980bd5000 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 -- 172.21.15.145:0/824295475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd5000 msgr2=0x557980bddb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 --2- 172.21.15.145:0/824295475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd5000 0x557980bddb20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400a520 tx=0x7f2ff4045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 -- 172.21.15.145:0/824295475 shutdown_connections 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 --2- 172.21.15.145:0/824295475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd5000 0x557980bddb20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 -- 172.21.15.145:0/824295475 >> 172.21.15.145:0/824295475 conn(0x557980bcf210 msgr2=0x557980bd1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 -- 172.21.15.145:0/824295475 shutdown_connections 2024-09-10T04:50:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.897+0000 7f300bd19800 1 -- 172.21.15.145:0/824295475 wait complete. 2024-09-10T04:50:28.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f300bd19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f300bd19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557980a6ddd0 con 0x557980bd34e0 2024-09-10T04:50:28.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51814/0 (socket says 172.21.15.145:51814) 2024-09-10T04:50:28.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f3009803640 1 -- 172.21.15.145:0/3612165651 learned_addr learned my addr 172.21.15.145:0/3612165651 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.911+0000 7f3009803640 1 -- 172.21.15.145:0/3612165651 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980a86e10 con 0x557980bd34e0 2024-09-10T04:50:28.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.912+0000 7f3009803640 1 --2- 172.21.15.145:0/3612165651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc001d40 tx=0x7f2ffc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afb3867fa7c3573 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.912+0000 7f2ef7e07640 1 -- 172.21.15.145:0/3612165651 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc00f400 con 0x557980bd34e0 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.912+0000 7f2ef7e07640 1 -- 172.21.15.145:0/3612165651 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00f5a0 con 0x557980bd34e0 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.912+0000 7f2ef7e07640 1 -- 172.21.15.145:0/3612165651 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc00f900 con 0x557980bd34e0 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- 172.21.15.145:0/3612165651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 msgr2=0x557980cc6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 --2- 172.21.15.145:0/3612165651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc001d40 tx=0x7f2ffc00b5b0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- 172.21.15.145:0/3612165651 shutdown_connections 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 --2- 172.21.15.145:0/3612165651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cc6910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- 172.21.15.145:0/3612165651 >> 172.21.15.145:0/3612165651 conn(0x557980bcf210 msgr2=0x557980cc2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- 172.21.15.145:0/3612165651 shutdown_connections 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- 172.21.15.145:0/3612165651 wait complete. 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f300bd19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557980bde360 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51816/0 (socket says 172.21.15.145:51816) 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.913+0000 7f3009803640 1 -- 172.21.15.145:0/3220492030 learned_addr learned my addr 172.21.15.145:0/3220492030 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f3009803640 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980cce820 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f3009803640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cce2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x557980cc78a0 tx=0x7f2ffc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f2ef6604640 1 -- 172.21.15.145:0/3220492030 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc01a690 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f2ef6604640 1 -- 172.21.15.145:0/3220492030 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc01a830 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557980cceab0 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f2ef6604640 1 -- 172.21.15.145:0/3220492030 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc01ab50 con 0x557980bd34e0 2024-09-10T04:50:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.914+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557980ccf6c0 con 0x557980bd34e0 2024-09-10T04:50:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f2ef6604640 1 -- 172.21.15.145:0/3220492030 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2ffc017070 con 0x557980bd34e0 2024-09-10T04:50:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f2ef6604640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ef003c730 0x7f2ef003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f2ef6604640 1 -- 172.21.15.145:0/3220492030 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ffc015020 con 0x557980bd34e0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f3001002640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ef003c730 0x7f2ef003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980bd5000 0x557980cd5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980cd5e50 con 0x557980bd5000 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.915+0000 7f300a004640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980bd5000 0x557980cd5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f3001002640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ef003c730 0x7f2ef003ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4057000 tx=0x7f2ff4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f300a004640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980bd5000 0x557980cd5910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f300a004640 1 -- 172.21.15.145:0/3220492030 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f300400a4d0 con 0x557980bd5000 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980cd6700 0x557980cd8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980cd92e0 con 0x557980cd6700 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.916+0000 7f3009803640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980cd6700 0x557980cd8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.917+0000 7f3009803640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980cd6700 0x557980cd8b70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.917+0000 7f3009803640 1 -- 172.21.15.145:0/3220492030 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ffc02e070 con 0x557980cd6700 2024-09-10T04:50:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.917+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980cdab90 con 0x557980bd5000 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.917+0000 7f300a004640 1 -- 172.21.15.145:0/3220492030 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f300400a4d0 con 0x557980bd5000 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.917+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980cd9dc0 con 0x557980cd6700 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f3009803640 1 -- 172.21.15.145:0/3220492030 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ffc02e070 con 0x557980cd6700 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557980cdbf40 0x557980cde330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980cde870 con 0x557980cdbf40 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f3001002640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557980cdbf40 0x557980cde330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f3001002640 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557980cdbf40 0x557980cde330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.918+0000 7f3001002640 1 -- 172.21.15.145:0/3220492030 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ff4057030 con 0x557980cdbf40 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f300bd19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f300bd19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557980acba00 con 0x557980cec3f0 2024-09-10T04:50:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51830/0 (socket says 172.21.15.145:51830) 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f3009803640 1 -- 172.21.15.145:0/3099841051 learned_addr learned my addr 172.21.15.145:0/3099841051 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.919+0000 7f3009803640 1 -- 172.21.15.145:0/3099841051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980cece50 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f3009803640 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0524a0 tx=0x7f2ffc017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f2eef7fe640 1 -- 172.21.15.145:0/3099841051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc017980 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f2eef7fe640 1 -- 172.21.15.145:0/3099841051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc035020 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557980ced680 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f2eef7fe640 1 -- 172.21.15.145:0/3099841051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc00ed00 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557980ced680 con 0x557980cec3f0 2024-09-10T04:50:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f2eef7fe640 1 -- 172.21.15.145:0/3099841051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2ffc00e070 con 0x557980cec3f0 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.920+0000 7f2eef7fe640 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 0x7f2ee403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f2eef7fe640 1 -- 172.21.15.145:0/3099841051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ffc036030 con 0x557980cec3f0 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3001002640 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 0x7f2ee403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3001002640 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 0x7f2ee403ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557980cd01c0 tx=0x7f2ff4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f300bd19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f300bd19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557980cc7160 con 0x557980cf8ac0 2024-09-10T04:50:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51842/0 (socket says 172.21.15.145:51842) 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3009803640 1 -- 172.21.15.145:0/57942460 learned_addr learned my addr 172.21.15.145:0/57942460 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.921+0000 7f3009803640 1 -- 172.21.15.145:0/57942460 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980cf94b0 con 0x557980cf8ac0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f3009803640 1 --2- 172.21.15.145:0/57942460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0520e0 tx=0x7f2ffc044770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1978d0726af87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f2eed7fa640 1 -- 172.21.15.145:0/57942460 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc0393c0 con 0x557980cf8ac0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f2eed7fa640 1 -- 172.21.15.145:0/57942460 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc01b7d0 con 0x557980cf8ac0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f2eed7fa640 1 -- 172.21.15.145:0/57942460 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc03be60 con 0x557980cf8ac0 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 -- 172.21.15.145:0/57942460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 msgr2=0x557980cf8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 --2- 172.21.15.145:0/57942460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0520e0 tx=0x7f2ffc044770 comp rx=0 tx=0).stop 2024-09-10T04:50:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 -- 172.21.15.145:0/57942460 shutdown_connections 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 --2- 172.21.15.145:0/57942460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cf8ec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 -- 172.21.15.145:0/57942460 >> 172.21.15.145:0/57942460 conn(0x557980cf4ec0 msgr2=0x557980cf3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 -- 172.21.15.145:0/57942460 shutdown_connections 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.922+0000 7f300bd19800 1 -- 172.21.15.145:0/57942460 wait complete. 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f300bd19800 1 Processor -- start 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f300bd19800 1 -- start start 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f300bd19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cfff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f300bd19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557980cf9920 con 0x557980cf8ac0 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cfff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f3009803640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cfff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51854/0 (socket says 172.21.15.145:51854) 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 learned_addr learned my addr 172.21.15.145:0/3534462125 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557980d00480 con 0x557980cf8ac0 2024-09-10T04:50:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f3009803640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cfff20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0520e0 tx=0x7f2ffc04bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f2edb7fe640 1 -- 172.21.15.145:0/3534462125 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc070070 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.923+0000 7f2edb7fe640 1 -- 172.21.15.145:0/3534462125 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc0393c0 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.924+0000 7f2edb7fe640 1 -- 172.21.15.145:0/3534462125 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc044870 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.924+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557980d00480 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.924+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557980d00480 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.924+0000 7f2edb7fe640 1 -- 172.21.15.145:0/3534462125 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2ffc073070 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.924+0000 7f2edb7fe640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ed403c730 0x7f2ed403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f2edb7fe640 1 -- 172.21.15.145:0/3534462125 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ffc05b070 con 0x557980cf8ac0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f3001002640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ed403c730 0x7f2ed403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f3001002640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ed403c730 0x7f2ed403ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4051580 tx=0x7f2ff406d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980d0b490 0x557980d0d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d0e0a0 con 0x557980d0b490 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.925+0000 7f300a004640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980d0b490 0x557980d0d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300a004640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980d0b490 0x557980d0d950 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 realm 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d0a7c0 con 0x557980d0b490 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d0eb30 con 0x557980d0b490 2024-09-10T04:50:28.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980d0f910 0x557980d11d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.926+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d12360 con 0x557980d0f910 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f3009803640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980d0f910 0x557980d11d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f3009803640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980d0f910 0x557980d11d00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d12bb0 con 0x557980d0b490 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 20 searching for the correct realm 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557980d14920 0x557980d16d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.927+0000 7f3001002640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557980d14920 0x557980d16d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3001002640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557980d14920 0x557980d16d10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3009803640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2ffc075060 0x7f2ffc02e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.928+0000 7f300a004640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2ffc075060 0x7f2ffc02e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2ffc075060 0x7f2ffc02e520 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f300400a4d0 con 0x7f2ffc075060 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.929+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.930+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300400a4d0 con 0x557980d0b490 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x7f2ffc075060 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3004030040 con 0x7f2ffc075060 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.931+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.932+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.933+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x7f2ffc075060 2024-09-10T04:50:28.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0b490 2024-09-10T04:50:28.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x7f2ffc075060 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.934+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x7f2ffc075060 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3004030040 con 0x7f2ffc075060 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d14920 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.935+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557980d173e0 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d13530 con 0x557980d0b490 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3004030040 con 0x557980d0b490 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d13dd0 con 0x557980d0f910 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.936+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d13170 con 0x7f2ffc075060 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 zone default found 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 4 Realm: () 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 zonegroup default 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d178c0 con 0x7f2ffc075060 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.937+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d19740 con 0x557980d14920 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d19c20 con 0x557980d14920 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 20 started sync module instance, tier type = 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.938+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d18b90 con 0x557980d0f910 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.939+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.939+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93980340621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d187f0 con 0x557980d0f910 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.939+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1aa20 con 0x557980d0b490 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.940+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.940+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93980340626736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1b2f0 con 0x557980d0b490 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.940+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1bdc0 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.940+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93980340621184] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.941+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93980340626736] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.941+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.941+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93980340631728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1ae40 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.941+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1c690 con 0x7f2ffc075060 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.942+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93980340631728] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.943+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.943+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93980340625536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1ae40 con 0x7f2ffc075060 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.943+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1cd30 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.944+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93980340625536] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.944+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.944+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93980340635648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1ae40 con 0x557980d0f910 2024-09-10T04:50:28.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.944+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1d740 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.945+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93980340635648] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.945+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.945+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93980340638352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1dae0 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.945+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1e4e0 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.946+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.946+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93980340644048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1f1a0 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.946+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1fbc0 con 0x7f2ffc075060 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.947+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93980340638352] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93980340644048] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93980340645104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d1c150 con 0x7f2ffc075060 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=0 2024-09-10T04:50:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=1 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=2 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=3 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=4 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=5 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.948+0000 7f300bd19800 20 add_watcher() i=6 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93980340645104] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300bd19800 20 add_watcher() i=7 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300bd19800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d22fe0 con 0x557980d0b490 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.949+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93980340647600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d20410 con 0x557980d0b490 2024-09-10T04:50:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.950+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93980340647600] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.950+0000 7f2ebb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.950+0000 7f300bd19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.950+0000 7f300bd19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.950+0000 7f300bd19800 5 note: GC not initialized 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f2eba7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 Filter name: none 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f2e2bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d55fe0 con 0x557980d0b490 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d568f0 con 0x557980d14920 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.951+0000 7f300bd19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.952+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d5c280 con 0x557980d0b490 2024-09-10T04:50:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f300bd19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f300bd19800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f300bd19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93980340894848 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d57940 con 0x557980d0f910 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93980340635648 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x557980cece50 con 0x557980d0f910 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f2eed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93980340635648 notifier 4342 bl.length()=678 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 93980340894848 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f2eed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f2eed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f2eed7fa640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2ecc003ea0 con 0x557980d0f910 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.953+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.954+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93980340894848 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557980ccf6c0 con 0x557980d0f910 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.954+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d5bc80 con 0x557980d14920 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f300bd19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f300bd19800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f300bd19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93980340894848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557980d54640 con 0x557980d0f910 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 93980340631728 notify 137438953476 ret 0) ==== 219+0+0 (crc 0 0 0) 0x557980ccf6c0 con 0x557980d0f910 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f2eed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93980340631728 notifier 4342 bl.length()=177 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f2eed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:28.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f2eed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:28.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(68 notify.2 [notify cookie 93980340894848 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f2eed7fa640 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2ecc003ea0 con 0x557980d0f910 2024-09-10T04:50:28.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.955+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 93980340894848 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557980cceab0 con 0x557980d0f910 2024-09-10T04:50:28.971 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T04:50:28.953844Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:28.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.956+0000 7f2ebb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.956+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93980340647600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d5bc80 con 0x557980d0b490 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.957+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93980340647600] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.957+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93980340621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d0f910 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.958+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93980340621184] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.958+0000 7f300bd19800 20 remove_watcher() i=0 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.958+0000 7f300bd19800 2 removed watcher, disabling cache 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.958+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93980340626736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d0b490 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.959+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93980340626736] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x557980d0b490 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.959+0000 7f300bd19800 20 remove_watcher() i=1 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.959+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93980340631728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d0f910 2024-09-10T04:50:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.960+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93980340631728] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.961+0000 7f300bd19800 20 remove_watcher() i=2 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.961+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93980340625536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x7f2ffc075060 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.963+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93980340625536] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.963+0000 7f300bd19800 20 remove_watcher() i=3 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.963+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93980340635648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d0f910 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.964+0000 7f3009803640 1 -- 172.21.15.145:0/3534462125 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93980340635648] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc072030 con 0x557980d0f910 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.964+0000 7f300bd19800 20 remove_watcher() i=4 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.964+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93980340638352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d14920 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.967+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93980340638352] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.967+0000 7f300bd19800 20 remove_watcher() i=5 2024-09-10T04:50:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.967+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93980340644048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x557980d14920 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.968+0000 7f3001002640 1 -- 172.21.15.145:0/3534462125 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93980340644048] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff4057030 con 0x557980d14920 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.968+0000 7f300bd19800 20 remove_watcher() i=6 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.968+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93980340645104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557980d53df0 con 0x7f2ffc075060 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93980340645104] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3004041040 con 0x7f2ffc075060 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 20 remove_watcher() i=7 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980d0f910 msgr2=0x557980d11d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980d0f910 0x557980d11d00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980d0b490 msgr2=0x557980d0d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980d0b490 0x557980d0d950 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2ffc075060 msgr2=0x7f2ffc02e520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2ffc075060 0x7f2ffc02e520 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557980d14920 msgr2=0x557980d16d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557980d14920 0x557980d16d10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ed403c730 msgr2=0x7f2ed403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ed403c730 0x7f2ed403ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4051580 tx=0x7f2ff406d040 comp rx=0 tx=0).stop 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 msgr2=0x557980cfff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 --2- 172.21.15.145:0/3534462125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cf8ac0 0x557980cfff20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0520e0 tx=0x7f2ffc04bf10 comp rx=0 tx=0).stop 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300a004640 1 -- 172.21.15.145:0/3534462125 reap_dead start 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 shutdown_connections 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 >> 172.21.15.145:0/3534462125 conn(0x557980cf4ec0 msgr2=0x557980cf30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 shutdown_connections 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.971+0000 7f300bd19800 1 -- 172.21.15.145:0/3534462125 wait complete. 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 msgr2=0x7f2ee403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 0x7f2ee403ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557980cd01c0 tx=0x7f2ff4005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 msgr2=0x557980cec810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0524a0 tx=0x7f2ffc017730 comp rx=0 tx=0).stop 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 shutdown_connections 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ee403c780 0x7f2ee403ec40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3099841051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980cec3f0 0x557980cec810 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 >> 172.21.15.145:0/3099841051 conn(0x557980ce07a0 msgr2=0x557980ce0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 shutdown_connections 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3099841051 wait complete. 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980cd6700 msgr2=0x557980cd8b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557980cd6700 0x557980cd8b70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980bd5000 msgr2=0x557980cd5910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557980bd5000 0x557980cd5910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557980cdbf40 msgr2=0x557980cde330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557980cdbf40 0x557980cde330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ef003c730 msgr2=0x7f2ef003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ef003c730 0x7f2ef003ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4057000 tx=0x7f2ff4052000 comp rx=0 tx=0).stop 2024-09-10T04:50:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 msgr2=0x557980cce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 --2- 172.21.15.145:0/3220492030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557980bd34e0 0x557980cce2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x557980cc78a0 tx=0x7f2ffc000bc0 comp rx=0 tx=0).stop 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300a004640 1 -- 172.21.15.145:0/3220492030 reap_dead start 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 shutdown_connections 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 >> 172.21.15.145:0/3220492030 conn(0x557980bcf210 msgr2=0x557980cc7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 shutdown_connections 2024-09-10T04:50:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:28.972+0000 7f300bd19800 1 -- 172.21.15.145:0/3220492030 wait complete. 2024-09-10T04:50:28.983 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T04:50:28.953844Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:28.984 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:28.984 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:29.028 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.028 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f055332c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563a040e1690 0x563a040e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f055332c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a03f8ae40 con 0x563a040e4020 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f055332c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x563a03f55680 con 0x563a040e1690 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054f056640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563a040e1690 0x563a040e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054f056640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563a040e1690 0x563a040e3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51856/0 (socket says 172.21.15.145:51856) 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054f056640 1 -- 172.21.15.145:0/25089835 learned_addr learned my addr 172.21.15.145:0/25089835 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054e855640 1 --1- 172.21.15.145:0/25089835 >> v1:172.21.15.98:6789/0 conn(0x563a040e4020 0x563a040e64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60418/0 (socket says 172.21.15.145:60418) 2024-09-10T04:50:29.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054f056640 1 -- 172.21.15.145:0/25089835 >> v1:172.21.15.98:6789/0 conn(0x563a040e4020 legacy=0x563a040e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.027+0000 7f054f056640 1 -- 172.21.15.145:0/25089835 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a03f716b0 con 0x563a040e1690 2024-09-10T04:50:29.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.029+0000 7f054f056640 1 --2- 172.21.15.145:0/25089835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a040e3a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f054000a520 tx=0x7f0540045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a43e78e3720f26a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.029+0000 7f054e054640 1 -- 172.21.15.145:0/25089835 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540055070 con 0x563a040e1690 2024-09-10T04:50:29.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.029+0000 7f054e054640 1 -- 172.21.15.145:0/25089835 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05400515b0 con 0x563a040e1690 2024-09-10T04:50:29.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.029+0000 7f054e054640 1 -- 172.21.15.145:0/25089835 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05400518d0 con 0x563a040e1690 2024-09-10T04:50:29.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 -- 172.21.15.145:0/25089835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 msgr2=0x563a040e3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 --2- 172.21.15.145:0/25089835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a040e3a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f054000a520 tx=0x7f0540045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 -- 172.21.15.145:0/25089835 shutdown_connections 2024-09-10T04:50:29.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 --2- 172.21.15.145:0/25089835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a040e3a80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 -- 172.21.15.145:0/25089835 >> 172.21.15.145:0/25089835 conn(0x563a040db1f0 msgr2=0x563a040dd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 -- 172.21.15.145:0/25089835 shutdown_connections 2024-09-10T04:50:29.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.030+0000 7f055332c800 1 -- 172.21.15.145:0/25089835 wait complete. 2024-09-10T04:50:29.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f055332c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f055332c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a03f79dd0 con 0x563a040e1690 2024-09-10T04:50:29.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51864/0 (socket says 172.21.15.145:51864) 2024-09-10T04:50:29.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.044+0000 7f054f056640 1 -- 172.21.15.145:0/698712355 learned_addr learned my addr 172.21.15.145:0/698712355 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.045+0000 7f054f056640 1 -- 172.21.15.145:0/698712355 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a03f92e10 con 0x563a040e1690 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.045+0000 7f054f056640 1 --2- 172.21.15.145:0/698712355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0540025da0 tx=0x7f0540051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee12d5da7543cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.045+0000 7f043d60a640 1 -- 172.21.15.145:0/698712355 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540051ac0 con 0x563a040e1690 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.045+0000 7f043d60a640 1 -- 172.21.15.145:0/698712355 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540051c60 con 0x563a040e1690 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.045+0000 7f043d60a640 1 -- 172.21.15.145:0/698712355 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f054005a450 con 0x563a040e1690 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- 172.21.15.145:0/698712355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 msgr2=0x563a041d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 --2- 172.21.15.145:0/698712355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0540025da0 tx=0x7f0540051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- 172.21.15.145:0/698712355 shutdown_connections 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 --2- 172.21.15.145:0/698712355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d0640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- 172.21.15.145:0/698712355 >> 172.21.15.145:0/698712355 conn(0x563a040db1f0 msgr2=0x563a041cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- 172.21.15.145:0/698712355 shutdown_connections 2024-09-10T04:50:29.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- 172.21.15.145:0/698712355 wait complete. 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f055332c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a040e8040 con 0x563a040e1690 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51878/0 (socket says 172.21.15.145:51878) 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.046+0000 7f054f056640 1 -- 172.21.15.145:0/3313461886 learned_addr learned my addr 172.21.15.145:0/3313461886 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f054f056640 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a041d82f0 con 0x563a040e1690 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f054f056640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d7d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0540025da0 tx=0x7f0540002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f043be07640 1 -- 172.21.15.145:0/3313461886 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540073070 con 0x563a040e1690 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f043be07640 1 -- 172.21.15.145:0/3313461886 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054005a640 con 0x563a040e1690 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f043be07640 1 -- 172.21.15.145:0/3313461886 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f054005a920 con 0x563a040e1690 2024-09-10T04:50:29.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a041d8580 con 0x563a040e1690 2024-09-10T04:50:29.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.047+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a041d9190 con 0x563a040e1690 2024-09-10T04:50:29.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f043be07640 1 -- 172.21.15.145:0/3313461886 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0540076070 con 0x563a040e1690 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f043be07640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f043403c730 0x7f043403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f043be07640 1 -- 172.21.15.145:0/3313461886 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0540062070 con 0x563a040e1690 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f054e855640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f043403c730 0x7f043403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a040e4020 0x563a041df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a041df920 con 0x563a040e4020 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f054f857640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a040e4020 0x563a041df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.048+0000 7f054e855640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f043403c730 0x7f043403ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0544001e30 tx=0x7f0544001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f054f857640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a040e4020 0x563a041df3e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f054f857640 1 -- 172.21.15.145:0/3313461886 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054800a4d0 con 0x563a040e4020 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a041e0260 0x563a041e2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a041e2e90 con 0x563a041e0260 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f054f056640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a041e0260 0x563a041e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.049+0000 7f054f056640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a041e0260 0x563a041e2720 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f054f056640 1 -- 172.21.15.145:0/3313461886 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f054007f070 con 0x563a041e0260 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a041e4740 con 0x563a040e4020 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f054f857640 1 -- 172.21.15.145:0/3313461886 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f054800a4d0 con 0x563a040e4020 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a041e3970 con 0x563a041e0260 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f054f056640 1 -- 172.21.15.145:0/3313461886 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f054007f070 con 0x563a041e0260 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563a041e5af0 0x563a041e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a041e8420 con 0x563a041e5af0 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.050+0000 7f054e855640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563a041e5af0 0x563a041e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.051+0000 7f054e855640 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563a041e5af0 0x563a041e7ee0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.051+0000 7f054e855640 1 -- 172.21.15.145:0/3313461886 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f054400bd50 con 0x563a041e5af0 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.051+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.051+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f055332c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f055332c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a03fd7a00 con 0x563a041f5fa0 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51890/0 (socket says 172.21.15.145:51890) 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f054f056640 1 -- 172.21.15.145:0/3570739620 learned_addr learned my addr 172.21.15.145:0/3570739620 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.052+0000 7f054f056640 1 -- 172.21.15.145:0/3570739620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a041f6a00 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f054f056640 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0540050d80 tx=0x7f0540050b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f0439602640 1 -- 172.21.15.145:0/3570739620 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540076bc0 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f0439602640 1 -- 172.21.15.145:0/3570739620 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540092070 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f0439602640 1 -- 172.21.15.145:0/3570739620 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540096720 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a041f7230 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.053+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a041f77d0 con 0x563a041f5fa0 2024-09-10T04:50:29.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f0439602640 1 -- 172.21.15.145:0/3570739620 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0540094030 con 0x563a041f5fa0 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f0439602640 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 0x7f042803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f0439602640 1 -- 172.21.15.145:0/3570739620 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f05400a0c90 con 0x563a041f5fa0 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f054e855640 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 0x7f042803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f054e855640 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 0x7f042803ec40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x563a041e46b0 tx=0x7f054400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f055332c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f055332c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a041d0dd0 con 0x563a04202890 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51904/0 (socket says 172.21.15.145:51904) 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.054+0000 7f054f056640 1 -- 172.21.15.145:0/2050815439 learned_addr learned my addr 172.21.15.145:0/2050815439 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f054f056640 1 -- 172.21.15.145:0/2050815439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a04203280 con 0x563a04202890 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f054f056640 1 --2- 172.21.15.145:0/2050815439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0540064fb0 tx=0x7f054006e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad92a85038a0f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f0432ffd640 1 -- 172.21.15.145:0/2050815439 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05400b3070 con 0x563a04202890 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f0432ffd640 1 -- 172.21.15.145:0/2050815439 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540082cf0 con 0x563a04202890 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f0432ffd640 1 -- 172.21.15.145:0/2050815439 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05400aa040 con 0x563a04202890 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f055332c800 1 -- 172.21.15.145:0/2050815439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 msgr2=0x563a04202c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f055332c800 1 --2- 172.21.15.145:0/2050815439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0540064fb0 tx=0x7f054006e580 comp rx=0 tx=0).stop 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f055332c800 1 -- 172.21.15.145:0/2050815439 shutdown_connections 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f055332c800 1 --2- 172.21.15.145:0/2050815439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04202c90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.055+0000 7f055332c800 1 -- 172.21.15.145:0/2050815439 >> 172.21.15.145:0/2050815439 conn(0x563a041fec90 msgr2=0x563a041fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 -- 172.21.15.145:0/2050815439 shutdown_connections 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 -- 172.21.15.145:0/2050815439 wait complete. 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 Processor -- start 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 -- start start 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f055332c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a042036f0 con 0x563a04202890 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f054f056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51908/0 (socket says 172.21.15.145:51908) 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.056+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 learned_addr learned my addr 172.21.15.145:0/2751629960 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a0420a270 con 0x563a04202890 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f054f056640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05400a0f80 tx=0x7f054007ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f04317fa640 1 -- 172.21.15.145:0/2751629960 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05400bd020 con 0x563a04202890 2024-09-10T04:50:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f04317fa640 1 -- 172.21.15.145:0/2751629960 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054008e960 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a0420a270 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f04317fa640 1 -- 172.21.15.145:0/2751629960 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05400b3040 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.057+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a0420a270 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.058+0000 7f04317fa640 1 -- 172.21.15.145:0/2751629960 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f05400c0020 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.058+0000 7f04317fa640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f041803c6e0 0x7f041803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.058+0000 7f04317fa640 1 -- 172.21.15.145:0/2751629960 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f05400c3c60 con 0x563a04202890 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.058+0000 7f054e855640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f041803c6e0 0x7f041803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a04215320 0x563a042177e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a04217f30 con 0x563a04215320 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f054f857640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a04215320 0x563a042177e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f054e855640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f041803c6e0 0x7f041803eba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f054400fe70 tx=0x7f0544010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f054f857640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a04215320 0x563a042177e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 20 realm 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.059+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a04214650 con 0x563a04215320 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a042189c0 con 0x563a04215320 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a042197a0 0x563a0421bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421c1c0 con 0x563a042197a0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f054f056640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a042197a0 0x563a0421bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.060+0000 7f054f056640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a042197a0 0x563a0421bb90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421ca60 con 0x563a04215320 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 20 searching for the correct realm 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563a0421e7d0 0x563a04220bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f054e855640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563a0421e7d0 0x563a04220bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f054e855640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563a0421e7d0 0x563a04220bc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.061+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f056640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f05400c2020 0x7f054004e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f857640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f05400c2020 0x7f054004e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f857640 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f05400c2020 0x7f054004e2c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f054800a4d0 con 0x7f05400c2020 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.062+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.063+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054800a4d0 con 0x563a04215320 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x7f05400c2020 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.064+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0548030040 con 0x7f05400c2020 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.065+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.066+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a04215320 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.067+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0548030040 con 0x7f05400c2020 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.068+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a0421e7d0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a04221290 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.069+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421d410 con 0x563a04215320 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0548030040 con 0x563a04215320 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421d020 con 0x563a042197a0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421dd00 con 0x7f05400c2020 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 zone default found 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 4 Realm: () 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 zonegroup default 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.070+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0421dd00 con 0x7f05400c2020 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a04223100 con 0x563a0421e7d0 2024-09-10T04:50:29.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a042234a0 con 0x563a0421e7d0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 started sync module instance, tier type = 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.071+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042225a0 con 0x563a042197a0 2024-09-10T04:50:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.073+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.073+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807177439904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042225a0 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.073+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04223f90 con 0x563a04215320 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.074+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.074+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807177444000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04223f40 con 0x563a04215320 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.074+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04224f60 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.074+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94807177439904] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.076+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94807177444000] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.076+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.076+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807177446272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04224f20 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.076+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04225800 con 0x7f05400c2020 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.077+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94807177446272] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.077+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.078+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807177448016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04224f20 con 0x7f05400c2020 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.078+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04225f50 con 0x563a042197a0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.078+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94807177448016] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.079+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.079+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807177452064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04225f10 con 0x563a042197a0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.079+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04226960 con 0x563a0421e7d0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.080+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.080+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94807177452064] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.080+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807177454768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04227200 con 0x563a0421e7d0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.080+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04225320 con 0x563a0421e7d0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.081+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94807177454768] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.081+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.081+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807177459696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042280c0 con 0x563a0421e7d0 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.081+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04228950 con 0x7f05400c2020 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94807177459696] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807177460752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042284e0 con 0x7f05400c2020 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=0 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=1 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=2 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=3 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=4 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=5 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.082+0000 7f055332c800 20 add_watcher() i=6 2024-09-10T04:50:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.083+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94807177460752] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.083+0000 7f055332c800 20 add_watcher() i=7 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.083+0000 7f055332c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.083+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0422bdd0 con 0x563a04215320 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.084+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.084+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807177462272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042292f0 con 0x563a04215320 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94807177462272] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f0405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f055332c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f055332c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f055332c800 5 note: GC not initialized 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f0404fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:29.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f055332c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.085+0000 7f055332c800 20 Filter name: none 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.086+0000 7f037e7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.086+0000 7f055332c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.086+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a0425e9a0 con 0x563a04215320 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.086+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.086+0000 7f055332c800 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T04:50:29.097 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T04:50:28.953844Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.087+0000 7f0405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.087+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807177462272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a0425d470 con 0x563a04215320 2024-09-10T04:50:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.088+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94807177462272] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.088+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807177439904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a042281d0 con 0x563a042197a0 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.089+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94807177439904] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.089+0000 7f055332c800 20 remove_watcher() i=0 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.089+0000 7f055332c800 2 removed watcher, disabling cache 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.089+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807177444000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04222aa0 con 0x563a04215320 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.090+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94807177444000] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x563a04215320 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.090+0000 7f055332c800 20 remove_watcher() i=1 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.090+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807177446272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04222aa0 con 0x563a042197a0 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.091+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94807177446272] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.091+0000 7f055332c800 20 remove_watcher() i=2 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.091+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807177448016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04222aa0 con 0x7f05400c2020 2024-09-10T04:50:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.092+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94807177448016] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.092+0000 7f055332c800 20 remove_watcher() i=3 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.092+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807177452064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04224a50 con 0x563a042197a0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.093+0000 7f054f056640 1 -- 172.21.15.145:0/2751629960 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94807177452064] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05400b6040 con 0x563a042197a0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.093+0000 7f055332c800 20 remove_watcher() i=4 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.093+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807177454768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04222aa0 con 0x563a0421e7d0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.094+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94807177454768] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.094+0000 7f055332c800 20 remove_watcher() i=5 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.094+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807177459696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04225a20 con 0x563a0421e7d0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.095+0000 7f054e855640 1 -- 172.21.15.145:0/2751629960 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94807177459696] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0544037040 con 0x563a0421e7d0 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.095+0000 7f055332c800 20 remove_watcher() i=6 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.095+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807177460752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a04222aa0 con 0x7f05400c2020 2024-09-10T04:50:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94807177460752] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0548041040 con 0x7f05400c2020 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 20 remove_watcher() i=7 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a042197a0 msgr2=0x563a0421bb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a042197a0 0x563a0421bb90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a04215320 msgr2=0x563a042177e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a04215320 0x563a042177e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f05400c2020 msgr2=0x7f054004e2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f05400c2020 0x7f054004e2c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563a0421e7d0 msgr2=0x563a04220bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563a0421e7d0 0x563a04220bc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f041803c6e0 msgr2=0x7f041803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f041803c6e0 0x7f041803eba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f054400fe70 tx=0x7f0544010000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 msgr2=0x563a04209d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f054f857640 1 -- 172.21.15.145:0/2751629960 reap_dead start 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05400a0f80 tx=0x7f054007ff70 comp rx=0 tx=0).stop 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.096+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 shutdown_connections 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/2751629960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a04202890 0x563a04209d10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 >> 172.21.15.145:0/2751629960 conn(0x563a041fec90 msgr2=0x563a041fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 shutdown_connections 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/2751629960 wait complete. 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 msgr2=0x7f042803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 0x7f042803ec40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x563a041e46b0 tx=0x7f054400f000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 msgr2=0x563a041f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0540050d80 tx=0x7f0540050b30 comp rx=0 tx=0).stop 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 shutdown_connections 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f042803c780 0x7f042803ec40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3570739620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a041f5fa0 0x563a041f63c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 >> 172.21.15.145:0/3570739620 conn(0x563a041ea350 msgr2=0x563a041ea730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 shutdown_connections 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3570739620 wait complete. 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a041e0260 msgr2=0x563a041e2720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563a041e0260 0x563a041e2720 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a040e4020 msgr2=0x563a041df3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563a040e4020 0x563a041df3e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563a041e5af0 msgr2=0x563a041e7ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563a041e5af0 0x563a041e7ee0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f043403c730 msgr2=0x7f043403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f043403c730 0x7f043403ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0544001e30 tx=0x7f0544001390 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 msgr2=0x563a041d7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 --2- 172.21.15.145:0/3313461886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a040e1690 0x563a041d7d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0540025da0 tx=0x7f0540002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f054f857640 1 -- 172.21.15.145:0/3313461886 reap_dead start 2024-09-10T04:50:29.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.097+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 shutdown_connections 2024-09-10T04:50:29.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.098+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 >> 172.21.15.145:0/3313461886 conn(0x563a040db1f0 msgr2=0x563a041ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.098+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 shutdown_connections 2024-09-10T04:50:29.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.098+0000 7f055332c800 1 -- 172.21.15.145:0/3313461886 wait complete. 2024-09-10T04:50:29.109 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T04:50:28.953844Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T04:50:29.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T04:50:29.109 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-10T04:50:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.154+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.154+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.154+0000 7f36ac72e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556fa7e264c0 0x556fa7e268c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.154+0000 7f36ac72e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556fa7cd1e40 con 0x556fa7e26e00 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.154+0000 7f36ac72e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x556fa7c9c680 con 0x556fa7e264c0 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.155+0000 7f36a8364640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556fa7e264c0 0x556fa7e268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.155+0000 7f369fb63640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x556fa7e26e00 0x556fa7e272b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60430/0 (socket says 172.21.15.145:60430) 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.155+0000 7f369fb63640 1 -- 172.21.15.145:0/4063086626 learned_addr learned my addr 172.21.15.145:0/4063086626 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.155+0000 7f36a8364640 1 -- 172.21.15.145:0/4063086626 >> v1:172.21.15.98:6789/0 conn(0x556fa7e26e00 legacy=0x556fa7e272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.155+0000 7f36a8364640 1 -- 172.21.15.145:0/4063086626 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7cb86b0 con 0x556fa7e264c0 2024-09-10T04:50:29.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36a8364640 1 --2- 172.21.15.145:0/4063086626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7e268c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f369800a470 tx=0x7f3698045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a8aa4dbc24756 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36a7b63640 1 -- 172.21.15.145:0/4063086626 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698053570 con 0x556fa7e264c0 2024-09-10T04:50:29.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36a7b63640 1 -- 172.21.15.145:0/4063086626 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698058070 con 0x556fa7e264c0 2024-09-10T04:50:29.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36a7b63640 1 -- 172.21.15.145:0/4063086626 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698053880 con 0x556fa7e264c0 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 -- 172.21.15.145:0/4063086626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 msgr2=0x556fa7e268c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4063086626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7e268c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f369800a470 tx=0x7f3698045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 -- 172.21.15.145:0/4063086626 shutdown_connections 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4063086626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7e268c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 -- 172.21.15.145:0/4063086626 >> 172.21.15.145:0/4063086626 conn(0x556fa7e221d0 msgr2=0x556fa7e24630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 -- 172.21.15.145:0/4063086626 shutdown_connections 2024-09-10T04:50:29.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.157+0000 7f36ac72e800 1 -- 172.21.15.145:0/4063086626 wait complete. 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.171+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.171+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.171+0000 7f36ac72e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.171+0000 7f36ac72e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fa7cc0dd0 con 0x556fa7e264c0 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51938/0 (socket says 172.21.15.145:51938) 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f36a8364640 1 -- 172.21.15.145:0/4033499358 learned_addr learned my addr 172.21.15.145:0/4033499358 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f36a8364640 1 -- 172.21.15.145:0/4033499358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7cd9e10 con 0x556fa7e264c0 2024-09-10T04:50:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f36a8364640 1 --2- 172.21.15.145:0/4033499358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698025c20 tx=0x7f3698051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7147d9e8834b43b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f359660c640 1 -- 172.21.15.145:0/4033499358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698053a20 con 0x556fa7e264c0 2024-09-10T04:50:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f359660c640 1 -- 172.21.15.145:0/4033499358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698063070 con 0x556fa7e264c0 2024-09-10T04:50:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.172+0000 7f359660c640 1 -- 172.21.15.145:0/4033499358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698053cf0 con 0x556fa7e264c0 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 -- 172.21.15.145:0/4033499358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 msgr2=0x556fa7f198e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4033499358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698025c20 tx=0x7f3698051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 -- 172.21.15.145:0/4033499358 shutdown_connections 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4033499358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f198e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 -- 172.21.15.145:0/4033499358 >> 172.21.15.145:0/4033499358 conn(0x556fa7e221d0 msgr2=0x556fa7f15260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 -- 172.21.15.145:0/4033499358 shutdown_connections 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 -- 172.21.15.145:0/4033499358 wait complete. 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.173+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36ac72e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f21100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36ac72e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fa7e27d20 con 0x556fa7e264c0 2024-09-10T04:50:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f21100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f21100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51954/0 (socket says 172.21.15.145:51954) 2024-09-10T04:50:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36a8364640 1 -- 172.21.15.145:0/4193237539 learned_addr learned my addr 172.21.15.145:0/4193237539 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36a8364640 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7f21660 con 0x556fa7e264c0 2024-09-10T04:50:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36a8364640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f21100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3698025c20 tx=0x7f3698002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f3594e09640 1 -- 172.21.15.145:0/4193237539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369806c030 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f3594e09640 1 -- 172.21.15.145:0/4193237539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698068660 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fa7f218f0 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.174+0000 7f3594e09640 1 -- 172.21.15.145:0/4193237539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698068940 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.175+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa7f222f0 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.175+0000 7f3594e09640 1 -- 172.21.15.145:0/4193237539 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3698068ae0 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.175+0000 7f3594e09640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f359003c780 0x7f359003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f3594e09640 1 -- 172.21.15.145:0/4193237539 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3698097fc0 con 0x556fa7e264c0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f369fb63640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f359003c780 0x7f359003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7e26e00 0x556fa7f28750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f22ed0 con 0x556fa7e26e00 2024-09-10T04:50:29.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36a8b65640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7e26e00 0x556fa7f28750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f369fb63640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f359003c780 0x7f359003ec40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3690001d70 tx=0x7f36900012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36a8b65640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7e26e00 0x556fa7f28750 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36a8b65640 1 -- 172.21.15.145:0/4193237539 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7e26e00 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f296e0 0x556fa7f2bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.176+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f2c130 con 0x556fa7f296e0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.177+0000 7f36a8364640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f296e0 0x556fa7f2bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.177+0000 7f36a8364640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f296e0 0x556fa7f2bad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.177+0000 7f36a8364640 1 -- 172.21.15.145:0/4193237539 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3698051070 con 0x556fa7f296e0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.177+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f2d9e0 con 0x556fa7e26e00 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f36a8b65640 1 -- 172.21.15.145:0/4193237539 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7e26e00 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f2cc10 con 0x556fa7f296e0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f36a8364640 1 -- 172.21.15.145:0/4193237539 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3698051070 con 0x556fa7f296e0 2024-09-10T04:50:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556fa7f2ed90 0x556fa7f31180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f316c0 con 0x556fa7f2ed90 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f369fb63640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556fa7f2ed90 0x556fa7f31180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.178+0000 7f369fb63640 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556fa7f2ed90 0x556fa7f31180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f369fb63640 1 -- 172.21.15.145:0/4193237539 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f2ed90 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36ac72e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36ac72e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fa7d1ea00 con 0x556fa7f3f240 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51958/0 (socket says 172.21.15.145:51958) 2024-09-10T04:50:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.179+0000 7f36a8364640 1 -- 172.21.15.145:0/1302917098 learned_addr learned my addr 172.21.15.145:0/1302917098 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f36a8364640 1 -- 172.21.15.145:0/1302917098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7f3fca0 con 0x556fa7f3f240 2024-09-10T04:50:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f36a8364640 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3698096350 tx=0x7f3698052690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f358dffb640 1 -- 172.21.15.145:0/1302917098 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369808c070 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f358dffb640 1 -- 172.21.15.145:0/1302917098 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369805c660 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fa7f404d0 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f358dffb640 1 -- 172.21.15.145:0/1302917098 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698083040 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.180+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa7f40a70 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f358dffb640 1 -- 172.21.15.145:0/1302917098 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f369808f070 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f358dffb640 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 0x7f358003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f358dffb640 1 -- 172.21.15.145:0/1302917098 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f369809dc80 con 0x556fa7f3f240 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f369fb63640 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 0x7f358003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f369fb63640 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 0x7f358003ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f369000bf40 tx=0x7f369000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f36ac72e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.181+0000 7f36ac72e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fa7f1a0d0 con 0x556fa7f4bb20 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51974/0 (socket says 172.21.15.145:51974) 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f36a8364640 1 -- 172.21.15.145:0/2397659142 learned_addr learned my addr 172.21.15.145:0/2397659142 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f36a8364640 1 -- 172.21.15.145:0/2397659142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7f4c4f0 con 0x556fa7f4bb20 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f36a8364640 1 --2- 172.21.15.145:0/2397659142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3698052720 tx=0x7f369805f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f069bc959c56d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f35877fe640 1 -- 172.21.15.145:0/2397659142 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36980aa020 con 0x556fa7f4bb20 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f35877fe640 1 -- 172.21.15.145:0/2397659142 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369808f360 con 0x556fa7f4bb20 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.182+0000 7f35877fe640 1 -- 172.21.15.145:0/2397659142 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369807be10 con 0x556fa7f4bb20 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- 172.21.15.145:0/2397659142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 msgr2=0x556fa7f4bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 --2- 172.21.15.145:0/2397659142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3698052720 tx=0x7f369805f520 comp rx=0 tx=0).stop 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- 172.21.15.145:0/2397659142 shutdown_connections 2024-09-10T04:50:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 --2- 172.21.15.145:0/2397659142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f4bf00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- 172.21.15.145:0/2397659142 >> 172.21.15.145:0/2397659142 conn(0x556fa7f47f20 msgr2=0x556fa7f46160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- 172.21.15.145:0/2397659142 shutdown_connections 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- 172.21.15.145:0/2397659142 wait complete. 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 Processor -- start 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- start start 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36ac72e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fa7f4c980 con 0x556fa7f4bb20 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36a8364640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51982/0 (socket says 172.21.15.145:51982) 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.183+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 learned_addr learned my addr 172.21.15.145:0/1028499374 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa7f53450 con 0x556fa7f4bb20 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f36a8364640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3698095c60 tx=0x7f36980a3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f3585ffb640 1 -- 172.21.15.145:0/1028499374 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36980be070 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f3585ffb640 1 -- 172.21.15.145:0/1028499374 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369805e990 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fa7f53450 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f3585ffb640 1 -- 172.21.15.145:0/1028499374 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3698095d30 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.184+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa7f53450 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f3585ffb640 1 -- 172.21.15.145:0/1028499374 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f36980c1070 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f3585ffb640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f357803c780 0x7f357803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f3585ffb640 1 -- 172.21.15.145:0/1028499374 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f36980b6050 con 0x556fa7f4bb20 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f369fb63640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f357803c780 0x7f357803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f369fb63640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f357803c780 0x7f357803ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f369000c010 tx=0x7f3690010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.185+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7f5e4c0 0x556fa7f60980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f610d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36a8b65640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7f5e4c0 0x556fa7f60980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36a8b65640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7f5e4c0 0x556fa7f60980 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 20 realm 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f5d7f0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.186+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f61b60 con 0x556fa7f5e4c0 2024-09-10T04:50:29.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f62940 0x556fa7f64d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f65390 con 0x556fa7f62940 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36a8364640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f62940 0x556fa7f64d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36a8364640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f62940 0x556fa7f64d30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.187+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f65be0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f36ac72e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f36ac72e800 20 searching for the correct realm 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556fa7f67950 0x556fa7f69d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f369fb63640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556fa7f67950 0x556fa7f69d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f369fb63640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556fa7f67950 0x556fa7f69d80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.188+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8364640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f36980c3060 0x7f3698096870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f36980c3060 0x7f3698096870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f36980c3060 0x7f3698096870 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36a000a4d0 con 0x7f36980c3060 2024-09-10T04:50:29.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.189+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.190+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a000a4d0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x7f36980c3060 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.191+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f36a0030040 con 0x7f36980c3060 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.192+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.193+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.193+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.193+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.193+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.193+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.194+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f5e4c0 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36a0030040 con 0x7f36980c3060 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.195+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f67950 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a450 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.196+0000 7f36ac72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f66590 con 0x556fa7f5e4c0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36a0030040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f66e30 con 0x556fa7f62940 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f661d0 con 0x7f36980c3060 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 zone default found 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 4 Realm: () 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 zonegroup default 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6a8d0 con 0x7f36980c3060 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.197+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6c730 con 0x556fa7f67950 2024-09-10T04:50:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6d020 con 0x556fa7f67950 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 started sync module instance, tier type = 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.198+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6bba0 con 0x556fa7f62940 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.199+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.199+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938047696784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6bba0 con 0x556fa7f62940 2024-09-10T04:50:29.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.199+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6d870 con 0x556fa7f5e4c0 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.200+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.200+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938047696784] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.200+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938047701952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6dc90 con 0x556fa7f5e4c0 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.200+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6b730 con 0x556fa7f62940 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.201+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938047701952] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.201+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.201+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938047703008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6dc00 con 0x556fa7f62940 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.201+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6ed60 con 0x7f36980c3060 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.202+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938047703008] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.203+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.203+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938047705680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6ed20 con 0x7f36980c3060 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.203+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6f790 con 0x556fa7f62940 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.203+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938047705680] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.204+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.204+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938047709888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f6ed20 con 0x556fa7f62940 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.204+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f701a0 con 0x556fa7f67950 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.205+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.205+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938047712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f709f0 con 0x556fa7f67950 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.205+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f714b0 con 0x556fa7f67950 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.205+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938047709888] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.207+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938047712496] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.207+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.208+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938047717248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f718a0 con 0x556fa7f67950 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.208+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f72130 con 0x7f36980c3060 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.208+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938047717248] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938047707248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f72520 con 0x7f36980c3060 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=0 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=1 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=2 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=3 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=4 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=5 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.209+0000 7f36ac72e800 20 add_watcher() i=6 2024-09-10T04:50:29.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938047707248] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36ac72e800 20 add_watcher() i=7 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36ac72e800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f75950 con 0x556fa7f5e4c0 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.210+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938047720512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7f72e10 con 0x556fa7f5e4c0 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.211+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938047720512] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.211+0000 7f355e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.211+0000 7f36ac72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.211+0000 7f36ac72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.211+0000 7f36ac72e800 5 note: GC not initialized 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f355d7e2640 20 reqs_thread_entry: start 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 20 Filter name: none 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f34ceffd640 20 reqs_thread_entry: start 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa8a60 con 0x556fa7f5e4c0 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.212+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7faef40 con 0x556fa7f5e4c0 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.213+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36ac72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36ac72e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36ac72e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93938047969664 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7faa640 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93938047709888 notify 137438953477 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556fa7f404d0 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f35877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93938047709888 notifier 4356 bl.length()=567 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f35877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f35877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93938047969664 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f35877fe640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f356c003ea0 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93938047969664 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fa7f3fca0 con 0x556fa7f62940 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.214+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fae980 con 0x556fa7f67950 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.215+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.215+0000 7f36ac72e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.215+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93938047969664 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fa7faa190 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 93938047703008 notify 137438953478 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556fa7f3fca0 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f3586ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93938047703008 notifier 4356 bl.length()=170 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(67 notify.2 [notify cookie 93938047969664 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f3586ffd640 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f34dc0032c0 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.216+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 93938047969664 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fa7f222f0 con 0x556fa7f62940 2024-09-10T04:50:29.230 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.217+0000 7f355e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.217+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938047720512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.218+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93938047720512] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.218+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938047696784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f62940 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.219+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93938047696784] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.219+0000 7f36ac72e800 20 remove_watcher() i=0 2024-09-10T04:50:29.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.219+0000 7f36ac72e800 2 removed watcher, disabling cache 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.219+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938047701952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f5e4c0 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.220+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93938047701952] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x556fa7f5e4c0 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.220+0000 7f36ac72e800 20 remove_watcher() i=1 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.220+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938047703008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f62940 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.221+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93938047703008] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.221+0000 7f36ac72e800 20 remove_watcher() i=2 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.221+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938047705680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x7f36980c3060 2024-09-10T04:50:29.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.222+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93938047705680] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.222+0000 7f36ac72e800 20 remove_watcher() i=3 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.222+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938047709888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f62940 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.223+0000 7f36a8364640 1 -- 172.21.15.145:0/1028499374 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93938047709888] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36980c0030 con 0x556fa7f62940 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.223+0000 7f36ac72e800 20 remove_watcher() i=4 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.223+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938047712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f67950 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.224+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93938047712496] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.224+0000 7f36ac72e800 20 remove_watcher() i=5 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.224+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938047717248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x556fa7f67950 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.225+0000 7f369fb63640 1 -- 172.21.15.145:0/1028499374 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93938047717248] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3690009050 con 0x556fa7f67950 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.225+0000 7f36ac72e800 20 remove_watcher() i=6 2024-09-10T04:50:29.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.225+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938047707248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fa7fa68b0 con 0x7f36980c3060 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.225+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93938047707248] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36a0041040 con 0x7f36980c3060 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.225+0000 7f36ac72e800 20 remove_watcher() i=7 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f62940 msgr2=0x556fa7f64d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f62940 0x556fa7f64d30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7f5e4c0 msgr2=0x556fa7f60980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7f5e4c0 0x556fa7f60980 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f36980c3060 msgr2=0x7f3698096870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f36980c3060 0x7f3698096870 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556fa7f67950 msgr2=0x556fa7f69d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556fa7f67950 0x556fa7f69d80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f357803c780 msgr2=0x7f357803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f357803c780 0x7f357803ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f369000c010 tx=0x7f3690010000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 msgr2=0x556fa7f52ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36a8b65640 1 -- 172.21.15.145:0/1028499374 reap_dead start 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3698095c60 tx=0x7f36980a3000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 shutdown_connections 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1028499374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f4bb20 0x556fa7f52ef0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 >> 172.21.15.145:0/1028499374 conn(0x556fa7f47f20 msgr2=0x556fa7f46130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 shutdown_connections 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1028499374 wait complete. 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 msgr2=0x7f358003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 0x7f358003ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f369000bf40 tx=0x7f369000f000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 msgr2=0x556fa7f3f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3698096350 tx=0x7f3698052690 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 shutdown_connections 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f358003c730 0x7f358003ebf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 --2- 172.21.15.145:0/1302917098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7f3f240 0x556fa7f3f660 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 >> 172.21.15.145:0/1302917098 conn(0x556fa7f335f0 msgr2=0x556fa7f339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 shutdown_connections 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.226+0000 7f36ac72e800 1 -- 172.21.15.145:0/1302917098 wait complete. 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f296e0 msgr2=0x556fa7f2bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556fa7f296e0 0x556fa7f2bad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7e26e00 msgr2=0x556fa7f28750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556fa7e26e00 0x556fa7f28750 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556fa7f2ed90 msgr2=0x556fa7f31180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556fa7f2ed90 0x556fa7f31180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f359003c780 msgr2=0x7f359003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f359003c780 0x7f359003ec40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3690001d70 tx=0x7f36900012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 msgr2=0x556fa7f21100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 --2- 172.21.15.145:0/4193237539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fa7e264c0 0x556fa7f21100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3698025c20 tx=0x7f3698002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36a8b65640 1 -- 172.21.15.145:0/4193237539 reap_dead start 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 shutdown_connections 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 >> 172.21.15.145:0/4193237539 conn(0x556fa7e221d0 msgr2=0x556fa7f13a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 shutdown_connections 2024-09-10T04:50:29.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.227+0000 7f36ac72e800 1 -- 172.21.15.145:0/4193237539 wait complete. 2024-09-10T04:50:29.242 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.242 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T04:50:29.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T04:50:29.242 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-10T04:50:29.288 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.288 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5dea42f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fcb3a82220 0x55fcb3a87dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5dea42f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcb392be40 con 0x55fcb3a80e10 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5dea42f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55fcb38f6680 con 0x55fcb3a82220 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5ddcf8a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fcb3a82220 0x55fcb3a87dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5de578b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55fcb3a80e10 0x55fcb3a81b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:60434/0 (socket says 172.21.15.145:60434) 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5de578b640 1 -- 172.21.15.145:0/734416502 learned_addr learned my addr 172.21.15.145:0/734416502 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.287+0000 7f5ddcf8a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fcb3a82220 0x55fcb3a87dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51988/0 (socket says 172.21.15.145:51988) 2024-09-10T04:50:29.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.288+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/734416502 >> v1:172.21.15.98:6789/0 conn(0x55fcb3a80e10 legacy=0x55fcb3a81b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.288+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/734416502 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb39126b0 con 0x55fcb3a82220 2024-09-10T04:50:29.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.289+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/734416502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a82220 0x55fcb3a87dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a600 tx=0x7f5dd0047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4226bc28f17c67a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.289+0000 7f5de4f8a640 1 -- 172.21.15.145:0/734416502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd0056070 con 0x55fcb3a82220 2024-09-10T04:50:29.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5de4f8a640 1 -- 172.21.15.145:0/734416502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd000a200 con 0x55fcb3a82220 2024-09-10T04:50:29.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5de4f8a640 1 -- 172.21.15.145:0/734416502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd0008590 con 0x55fcb3a82220 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 -- 172.21.15.145:0/734416502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a82220 msgr2=0x55fcb3a87dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 --2- 172.21.15.145:0/734416502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a82220 0x55fcb3a87dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a600 tx=0x7f5dd0047cb0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 -- 172.21.15.145:0/734416502 shutdown_connections 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 --2- 172.21.15.145:0/734416502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a82220 0x55fcb3a87dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 -- 172.21.15.145:0/734416502 >> 172.21.15.145:0/734416502 conn(0x55fcb3a7c200 msgr2=0x55fcb3a7e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 -- 172.21.15.145:0/734416502 shutdown_connections 2024-09-10T04:50:29.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.290+0000 7f5dea42f800 1 -- 172.21.15.145:0/734416502 wait complete. 2024-09-10T04:50:29.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5dea42f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5dea42f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb391add0 con 0x55fcb3a80e10 2024-09-10T04:50:29.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:51998/0 (socket says 172.21.15.145:51998) 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.304+0000 7f5de578b640 1 -- 172.21.15.145:0/2379086797 learned_addr learned my addr 172.21.15.145:0/2379086797 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.305+0000 7f5de578b640 1 -- 172.21.15.145:0/2379086797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb3933e10 con 0x55fcb3a80e10 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.305+0000 7f5de578b640 1 --2- 172.21.15.145:0/2379086797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001e40 tx=0x7f5dd8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b929a009d539e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.305+0000 7f5cd3606640 1 -- 172.21.15.145:0/2379086797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd8012020 con 0x55fcb3a80e10 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.305+0000 7f5cd3606640 1 -- 172.21.15.145:0/2379086797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd800e5a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.305+0000 7f5cd3606640 1 -- 172.21.15.145:0/2379086797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd800e8a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- 172.21.15.145:0/2379086797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 msgr2=0x55fcb3b6f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2379086797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001e40 tx=0x7f5dd8001e70 comp rx=0 tx=0).stop 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- 172.21.15.145:0/2379086797 shutdown_connections 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2379086797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b6f420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- 172.21.15.145:0/2379086797 >> 172.21.15.145:0/2379086797 conn(0x55fcb3a7c200 msgr2=0x55fcb3b6ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- 172.21.15.145:0/2379086797 shutdown_connections 2024-09-10T04:50:29.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- 172.21.15.145:0/2379086797 wait complete. 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b7b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.306+0000 7f5dea42f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb3a82910 con 0x55fcb3a80e10 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b7b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b7b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:52010/0 (socket says 172.21.15.145:52010) 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5de578b640 1 -- 172.21.15.145:0/2602163563 learned_addr learned my addr 172.21.15.145:0/2602163563 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5de578b640 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb3b7b710 con 0x55fcb3a80e10 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5de578b640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b7b1b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c010 tx=0x7f5dd8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5cd1e03640 1 -- 172.21.15.145:0/2602163563 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd8012030 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5cd1e03640 1 -- 172.21.15.145:0/2602163563 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd80014a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcb3b7b9a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5cd1e03640 1 -- 172.21.15.145:0/2602163563 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd801a7a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.307+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb3b7c3a0 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5cd1e03640 1 -- 172.21.15.145:0/2602163563 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5dd8015020 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5cd1e03640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ccc03c730 0x7f5ccc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5cd1e03640 1 -- 172.21.15.145:0/2602163563 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5dd8020030 con 0x55fcb3a80e10 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ccc03c730 0x7f5ccc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3a82220 0x55fcb3b82800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.308+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3b82d40 con 0x55fcb3a82220 2024-09-10T04:50:29.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3a82220 0x55fcb3b82800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ccc03c730 0x7f5ccc03ebf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0058000 tx=0x7f5dd000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3a82220 0x55fcb3b82800 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2602163563 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3a82220 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3b835f0 0x55fcb3b85a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3b86200 con 0x55fcb3b835f0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.309+0000 7f5de578b640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3b835f0 0x55fcb3b85a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.310+0000 7f5de578b640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3b835f0 0x55fcb3b85a90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.310+0000 7f5de578b640 1 -- 172.21.15.145:0/2602163563 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dd801ab20 con 0x55fcb3b835f0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.310+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3b87ab0 con 0x55fcb3a82220 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.310+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2602163563 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3a82220 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.310+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3b86ce0 con 0x55fcb3b835f0 2024-09-10T04:50:29.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5de578b640 1 -- 172.21.15.145:0/2602163563 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dd801ab20 con 0x55fcb3b835f0 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcb3b88e60 0x55fcb3b8b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3b8b790 con 0x55fcb3b88e60 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcb3b88e60 0x55fcb3b8b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcb3b88e60 0x55fcb3b8b250 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.311+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2602163563 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3b88e60 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5dea42f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5dea42f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb3978a00 con 0x55fcb3b992e0 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:52016/0 (socket says 172.21.15.145:52016) 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5de578b640 1 -- 172.21.15.145:0/242949346 learned_addr learned my addr 172.21.15.145:0/242949346 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5de578b640 1 -- 172.21.15.145:0/242949346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb3b99d40 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5de578b640 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8051f90 tx=0x7f5dd800d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5ccaffd640 1 -- 172.21.15.145:0/242949346 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd800c8c0 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5ccaffd640 1 -- 172.21.15.145:0/242949346 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8041040 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcb3b9a570 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.312+0000 7f5ccaffd640 1 -- 172.21.15.145:0/242949346 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd800cb90 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.313+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb3b9a570 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.313+0000 7f5ccaffd640 1 -- 172.21.15.145:0/242949346 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5dd80163b0 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.313+0000 7f5ccaffd640 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 0x7f5cbc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.313+0000 7f5ccaffd640 1 -- 172.21.15.145:0/242949346 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5dd803ca00 con 0x55fcb3b992e0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.313+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 0x7f5cbc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 0x7f5cbc03ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55fcb3b7d0c0 tx=0x7f5dd0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5dea42f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5dea42f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb3b6fc70 con 0x55fcb3ba5a20 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:52026/0 (socket says 172.21.15.145:52026) 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5de578b640 1 -- 172.21.15.145:0/82749888 learned_addr learned my addr 172.21.15.145:0/82749888 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5de578b640 1 -- 172.21.15.145:0/82749888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb3ba6410 con 0x55fcb3ba5a20 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.314+0000 7f5de578b640 1 --2- 172.21.15.145:0/82749888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8035ff0 tx=0x7f5dd800d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319496ed5e2fdf4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5cc8ff9640 1 -- 172.21.15.145:0/82749888 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd802d5d0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5cc8ff9640 1 -- 172.21.15.145:0/82749888 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8062070 con 0x55fcb3ba5a20 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5cc8ff9640 1 -- 172.21.15.145:0/82749888 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd8049420 con 0x55fcb3ba5a20 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- 172.21.15.145:0/82749888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 msgr2=0x55fcb3ba5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 --2- 172.21.15.145:0/82749888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8035ff0 tx=0x7f5dd800d6b0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- 172.21.15.145:0/82749888 shutdown_connections 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 --2- 172.21.15.145:0/82749888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3ba5e20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- 172.21.15.145:0/82749888 >> 172.21.15.145:0/82749888 conn(0x55fcb3ba1e20 msgr2=0x55fcb3ba0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- 172.21.15.145:0/82749888 shutdown_connections 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- 172.21.15.145:0/82749888 wait complete. 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 Processor -- start 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.315+0000 7f5dea42f800 1 -- start start 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5dea42f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5dea42f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb3ba6880 con 0x55fcb3ba5a20 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5de578b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:52038/0 (socket says 172.21.15.145:52038) 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 learned_addr learned my addr 172.21.15.145:0/2732956997 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb3bad3e0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5de578b640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802d960 tx=0x7f5dd8033ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5cbaffd640 1 -- 172.21.15.145:0/2732956997 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd8070070 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5cbaffd640 1 -- 172.21.15.145:0/2732956997 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd80169e0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcb3bad3e0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5cbaffd640 1 -- 172.21.15.145:0/2732956997 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dd8054b20 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.316+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb3bad3e0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.317+0000 7f5cbaffd640 1 -- 172.21.15.145:0/2732956997 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5dd8073070 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5cbaffd640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cb003c780 0x7f5cb003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5cbaffd640 1 -- 172.21.15.145:0/2732956997 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5dd8076cb0 con 0x55fcb3ba5a20 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cb003c780 0x7f5cb003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cb003c780 0x7f5cb003ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0074040 tx=0x7f5dd0054000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3bb82b0 0x55fcb3bba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bbaec0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.318+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3bb82b0 0x55fcb3bba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3bb82b0 0x55fcb3bba770 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 realm 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bb75e0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bbb950 con 0x55fcb3bb82b0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3bbc730 0x55fcb3bbeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.319+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bbf180 con 0x55fcb3bbc730 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5de578b640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3bbc730 0x55fcb3bbeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5de578b640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3bbc730 0x55fcb3bbeb20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5dea42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bbf9d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5dea42f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.320+0000 7f5dea42f800 20 searching for the correct realm 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcb3bc1740 0x55fcb3bc3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcb3bc1740 0x55fcb3bc3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5ddcf8a640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcb3bc1740 0x55fcb3bc3b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5de578b640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5dd8075070 0x7f5dd806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.321+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5dd8075070 0x7f5dd806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5dd8075070 0x7f5dd806c9b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5de000a4d0 con 0x7f5dd8075070 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.322+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.323+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de000a4d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x7f5dd8075070 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.324+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5de0030040 con 0x7f5dd8075070 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.325+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.326+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bb82b0 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.327+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0030040 con 0x7f5dd8075070 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.328+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bc1740 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc4240 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.329+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc0350 con 0x55fcb3bb82b0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de0030040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc0bf0 con 0x55fcb3bbc730 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bbff90 con 0x7f5dd8075070 2024-09-10T04:50:29.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 zone default found 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 4 Realm: () 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 zonegroup default 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.330+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc46e0 con 0x7f5dd8075070 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc6540 con 0x55fcb3bc1740 2024-09-10T04:50:29.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc6a00 con 0x55fcb3bc1740 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 started sync module instance, tier type = 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.331+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc59b0 con 0x55fcb3bbc730 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.332+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.332+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94543835586000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc5610 con 0x55fcb3bbc730 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.332+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc7930 con 0x55fcb3bb82b0 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.333+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.333+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94543835586000] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.333+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94543835591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc78a0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.333+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc8340 con 0x55fcb3bbc730 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.335+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94543835591808] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.336+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.336+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94543835590240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc8340 con 0x55fcb3bbc730 2024-09-10T04:50:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.336+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc8db0 con 0x7f5dd8075070 2024-09-10T04:50:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.337+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94543835590240] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.337+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.337+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94543835596960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc8340 con 0x7f5dd8075070 2024-09-10T04:50:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.337+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc9800 con 0x55fcb3bbc730 2024-09-10T04:50:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.338+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94543835596960] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.338+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.338+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94543835599632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bc8340 con 0x55fcb3bbc730 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.338+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bca240 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.339+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.339+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94543835599632] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.339+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94543835602320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcaa90 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.339+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcb050 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.340+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94543835602320] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.340+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.340+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94543835594384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcb6e0 con 0x55fcb3bc1740 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.340+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcbf30 con 0x7f5dd8075070 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.341+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94543835594384] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.341+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.341+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94543835608080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcbda0 con 0x7f5dd8075070 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=0 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=1 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=2 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=3 2024-09-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=4 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=5 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=6 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94543835608080] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 20 add_watcher() i=7 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.342+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcf2e0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.343+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.343+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94543835609136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3bcc800 con 0x55fcb3bb82b0 2024-09-10T04:50:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.344+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94543835609136] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.344+0000 7f5c9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.344+0000 7f5dea42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.344+0000 7f5dea42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.344+0000 7f5dea42f800 5 note: GC not initialized 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5c9afe5640 20 reqs_thread_entry: start 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 20 Filter name: none 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5c98fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c02350 con 0x55fcb3bb82b0 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.345+0000 7f5dea42f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c02c60 con 0x55fcb3bb82b0 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-10T04:50:29.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.346+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c085f0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.347+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.347+0000 7f5dea42f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.347+0000 7f5dea42f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.347+0000 7f5dea42f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.347+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94543835856880 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c03c70 con 0x55fcb3bbc730 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94543835599632 notify 137438953479 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55fcb3b99d40 con 0x55fcb3bbc730 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5cc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94543835599632 notifier 4363 bl.length()=732 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5cc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 94543835856880 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5cc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5cc8ff9640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ca8003ea0 con 0x55fcb3bbc730 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94543835856880 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5dd8032030 con 0x55fcb3bbc730 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.348+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c07ff0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5dea42f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5dea42f800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5dea42f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94543835856880 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c04930 con 0x55fcb3bbc730 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94543835586000 notify 137438953480 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f5dd8032030 con 0x55fcb3bbc730 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5cc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94543835586000 notifier 4363 bl.length()=166 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5cc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T04:50:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5cc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T04:50:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5cc8ff9640 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ca8003ea0 con 0x55fcb3bbc730 2024-09-10T04:50:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.349+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(68 notify.0 [notify cookie 94543835856880 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.350+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.350+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94543835856880 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fcb3b7c3a0 con 0x55fcb3bbc730 2024-09-10T04:50:29.365 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"68EbWAZ2AwYrisfiZv6WlAuBxhIeu5nShV26XWT2","active":true,"create_date":"2024-09-10T04:50:29.348135Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.351+0000 7f5c9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.351+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94543835609136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.352+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94543835609136] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.352+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94543835586000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bbc730 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94543835586000] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5dea42f800 20 remove_watcher() i=0 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5dea42f800 2 removed watcher, disabling cache 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94543835591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bb82b0 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94543835591808] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x55fcb3bb82b0 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5dea42f800 20 remove_watcher() i=1 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.353+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94543835590240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bbc730 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.354+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94543835590240] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.354+0000 7f5dea42f800 20 remove_watcher() i=2 2024-09-10T04:50:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.354+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94543835596960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x7f5dd8075070 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.355+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94543835596960] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.355+0000 7f5dea42f800 20 remove_watcher() i=3 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.355+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94543835599632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bbc730 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.356+0000 7f5de578b640 1 -- 172.21.15.145:0/2732956997 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94543835599632] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd807c070 con 0x55fcb3bbc730 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.356+0000 7f5dea42f800 20 remove_watcher() i=4 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.356+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94543835602320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bc1740 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.357+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94543835602320] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.357+0000 7f5dea42f800 20 remove_watcher() i=5 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.357+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94543835594384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x55fcb3bc1740 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.358+0000 7f5ddcf8a640 1 -- 172.21.15.145:0/2732956997 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94543835594384] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dd0058030 con 0x55fcb3bc1740 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.358+0000 7f5dea42f800 20 remove_watcher() i=6 2024-09-10T04:50:29.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.358+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94543835608080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcb3c001d0 con 0x7f5dd8075070 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94543835608080] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0041040 con 0x7f5dd8075070 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 20 remove_watcher() i=7 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3bbc730 msgr2=0x55fcb3bbeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3bbc730 0x55fcb3bbeb20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3bb82b0 msgr2=0x55fcb3bba770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3bb82b0 0x55fcb3bba770 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5dd8075070 msgr2=0x7f5dd806c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5dd8075070 0x7f5dd806c9b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcb3bc1740 msgr2=0x55fcb3bc3b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcb3bc1740 0x55fcb3bc3b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cb003c780 msgr2=0x7f5cb003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cb003c780 0x7f5cb003ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0074040 tx=0x7f5dd0054000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 msgr2=0x55fcb3bace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802d960 tx=0x7f5dd8033ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2732956997 reap_dead start 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 shutdown_connections 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2732956997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3ba5a20 0x55fcb3bace80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 >> 172.21.15.145:0/2732956997 conn(0x55fcb3ba1e20 msgr2=0x55fcb3ba0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 shutdown_connections 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/2732956997 wait complete. 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 msgr2=0x7f5cbc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 0x7f5cbc03ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55fcb3b7d0c0 tx=0x7f5dd0005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 msgr2=0x55fcb3b99700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8051f90 tx=0x7f5dd800d440 comp rx=0 tx=0).stop 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 shutdown_connections 2024-09-10T04:50:29.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cbc03c780 0x7f5cbc03ec40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 --2- 172.21.15.145:0/242949346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3b992e0 0x55fcb3b99700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.361+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 >> 172.21.15.145:0/242949346 conn(0x55fcb3b8d690 msgr2=0x55fcb3b8da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 shutdown_connections 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/242949346 wait complete. 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3b835f0 msgr2=0x55fcb3b85a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcb3b835f0 0x55fcb3b85a90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3a82220 msgr2=0x55fcb3b82800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcb3a82220 0x55fcb3b82800 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcb3b88e60 msgr2=0x55fcb3b8b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcb3b88e60 0x55fcb3b8b250 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ccc03c730 msgr2=0x7f5ccc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ccc03c730 0x7f5ccc03ebf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0058000 tx=0x7f5dd000a000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 msgr2=0x55fcb3b7b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 --2- 172.21.15.145:0/2602163563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb3a80e10 0x55fcb3b7b1b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c010 tx=0x7f5dd8000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5de5f8c640 1 -- 172.21.15.145:0/2602163563 reap_dead start 2024-09-10T04:50:29.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 shutdown_connections 2024-09-10T04:50:29.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 >> 172.21.15.145:0/2602163563 conn(0x55fcb3a7c200 msgr2=0x55fcb3b70700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 shutdown_connections 2024-09-10T04:50:29.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.362+0000 7f5dea42f800 1 -- 172.21.15.145:0/2602163563 wait complete. 2024-09-10T04:50:29.377 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': '68EbWAZ2AwYrisfiZv6WlAuBxhIeu5nShV26XWT2', 'active': True, 'create_date': '2024-09-10T04:50:29.348135Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.377 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T04:50:29.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T04:50:29.377 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-10T04:50:29.425 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.426 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.424+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.424+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.424+0000 7f57d0d1f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bb0ac7690 0x559bb0ac9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.424+0000 7f57d0d1f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559bb0970e40 con 0x559bb0aca020 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.424+0000 7f57d0d1f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x559bb093b680 con 0x559bb0ac7690 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57ccaa2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bb0ac7690 0x559bb0ac9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57cc2a1640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x559bb0aca020 0x559bb0acc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39042/0 (socket says 172.21.15.145:39042) 2024-09-10T04:50:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57cc2a1640 1 -- 172.21.15.145:0/614419130 learned_addr learned my addr 172.21.15.145:0/614419130 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57ccaa2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559bb0ac7690 0x559bb0ac9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54806/0 (socket says 172.21.15.145:54806) 2024-09-10T04:50:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57ccaa2640 1 -- 172.21.15.145:0/614419130 >> v1:172.21.15.98:6789/0 conn(0x559bb0aca020 legacy=0x559bb0acc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.425+0000 7f57ccaa2640 1 -- 172.21.15.145:0/614419130 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb09576b0 con 0x559bb0ac7690 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/614419130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0ac9a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d672388f6ff93470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57cbaa0640 1 -- 172.21.15.145:0/614419130 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc053570 con 0x559bb0ac7690 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57cbaa0640 1 -- 172.21.15.145:0/614419130 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc058070 con 0x559bb0ac7690 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57cbaa0640 1 -- 172.21.15.145:0/614419130 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc053880 con 0x559bb0ac7690 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 -- 172.21.15.145:0/614419130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 msgr2=0x559bb0ac9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/614419130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0ac9a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00a470 tx=0x7f57bc045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 -- 172.21.15.145:0/614419130 shutdown_connections 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/614419130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0ac9a80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 -- 172.21.15.145:0/614419130 >> 172.21.15.145:0/614419130 conn(0x559bb0ac11d0 msgr2=0x559bb0ac3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 -- 172.21.15.145:0/614419130 shutdown_connections 2024-09-10T04:50:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.427+0000 7f57d0d1f800 1 -- 172.21.15.145:0/614419130 wait complete. 2024-09-10T04:50:29.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.441+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.441+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.441+0000 7f57d0d1f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.441+0000 7f57d0d1f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bb095fdd0 con 0x559bb0ac7690 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54814/0 (socket says 172.21.15.145:54814) 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f57ccaa2640 1 -- 172.21.15.145:0/280007787 learned_addr learned my addr 172.21.15.145:0/280007787 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f57ccaa2640 1 -- 172.21.15.145:0/280007787 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb0978e10 con 0x559bb0ac7690 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/280007787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57bc025c20 tx=0x7f57bc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda2148a0160851 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f56bae0d640 1 -- 172.21.15.145:0/280007787 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc053570 con 0x559bb0ac7690 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f56bae0d640 1 -- 172.21.15.145:0/280007787 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc063070 con 0x559bb0ac7690 2024-09-10T04:50:29.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.442+0000 7f56bae0d640 1 -- 172.21.15.145:0/280007787 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc053840 con 0x559bb0ac7690 2024-09-10T04:50:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- 172.21.15.145:0/280007787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 msgr2=0x559bb0bb6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/280007787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57bc025c20 tx=0x7f57bc051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- 172.21.15.145:0/280007787 shutdown_connections 2024-09-10T04:50:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/280007787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bb6730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- 172.21.15.145:0/280007787 >> 172.21.15.145:0/280007787 conn(0x559bb0ac11d0 msgr2=0x559bb0bb20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- 172.21.15.145:0/280007787 shutdown_connections 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- 172.21.15.145:0/280007787 wait complete. 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.443+0000 7f57d0d1f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bbe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57d0d1f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bb0ace040 con 0x559bb0ac7690 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bbe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bbe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54824/0 (socket says 172.21.15.145:54824) 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57ccaa2640 1 -- 172.21.15.145:0/2012797095 learned_addr learned my addr 172.21.15.145:0/2012797095 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57ccaa2640 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb0bbe580 con 0x559bb0ac7690 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bbe020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f57bc025c20 tx=0x7f57bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f56b960a640 1 -- 172.21.15.145:0/2012797095 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc074480 con 0x559bb0ac7690 2024-09-10T04:50:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f56b960a640 1 -- 172.21.15.145:0/2012797095 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc074620 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f56b960a640 1 -- 172.21.15.145:0/2012797095 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc074900 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.444+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bb0bbe810 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.445+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb0bbf420 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.445+0000 7f56b960a640 1 -- 172.21.15.145:0/2012797095 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f57bc074aa0 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.445+0000 7f56b960a640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56b403c730 0x7f56b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f56b960a640 1 -- 172.21.15.145:0/2012797095 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f57bc0980e0 con 0x559bb0ac7690 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56b403c730 0x7f56b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0aca020 0x559bb0bc5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bc5bb0 con 0x559bb0aca020 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0aca020 0x559bb0bc5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56b403c730 0x7f56b403ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57c0001d70 tx=0x7f57c00012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0aca020 0x559bb0bc5670 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57cd2a3640 1 -- 172.21.15.145:0/2012797095 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0aca020 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bc6460 0x559bb0bc8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.446+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bc9070 con 0x559bb0bc6460 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.447+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bc6460 0x559bb0bc8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.447+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bc6460 0x559bb0bc8900 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.447+0000 7f57ccaa2640 1 -- 172.21.15.145:0/2012797095 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57bc051070 con 0x559bb0bc6460 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.447+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bca920 con 0x559bb0aca020 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.447+0000 7f57cd2a3640 1 -- 172.21.15.145:0/2012797095 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0aca020 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bc9a60 con 0x559bb0bc6460 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57ccaa2640 1 -- 172.21.15.145:0/2012797095 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57bc051070 con 0x559bb0bc6460 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bb0bca4d0 0x559bb0bcdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bce450 con 0x559bb0bca4d0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bb0bca4d0 0x559bb0bcdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.448+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bb0bca4d0 0x559bb0bcdce0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57cc2a1640 1 -- 172.21.15.145:0/2012797095 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0bca4d0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57d0d1f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57d0d1f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bb09bda00 con 0x559bb0bdc0d0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54832/0 (socket says 172.21.15.145:54832) 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.449+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4229450275 learned_addr learned my addr 172.21.15.145:0/4229450275 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4229450275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb0bdcb30 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f57bc096370 tx=0x7f57bc05d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f56b27fc640 1 -- 172.21.15.145:0/4229450275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc0525b0 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f56b27fc640 1 -- 172.21.15.145:0/4229450275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc05e420 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bb0bdd360 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f56b27fc640 1 -- 172.21.15.145:0/4229450275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc05dbb0 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.450+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb0bdd900 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f56b27fc640 1 -- 172.21.15.145:0/4229450275 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f57bc05c5d0 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f56b27fc640 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 0x7f56a403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f56b27fc640 1 -- 172.21.15.145:0/4229450275 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f57bc06b070 con 0x559bb0bdc0d0 2024-09-10T04:50:29.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 0x7f56a403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.451+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 0x7f56a403eba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57c00016b0 tx=0x7f57c000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57d0d1f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57d0d1f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bb0bb6f20 con 0x559bb0be8970 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54836/0 (socket says 172.21.15.145:54836) 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57ccaa2640 1 -- 172.21.15.145:0/3708329739 learned_addr learned my addr 172.21.15.145:0/3708329739 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57ccaa2640 1 -- 172.21.15.145:0/3708329739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb0be9340 con 0x559bb0be8970 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/3708329739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f57bc08f270 tx=0x7f57bc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4516e53eafee4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f56a3fff640 1 -- 172.21.15.145:0/3708329739 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc05dd50 con 0x559bb0be8970 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f56a3fff640 1 -- 172.21.15.145:0/3708329739 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc068800 con 0x559bb0be8970 2024-09-10T04:50:29.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.452+0000 7f56a3fff640 1 -- 172.21.15.145:0/3708329739 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc068470 con 0x559bb0be8970 2024-09-10T04:50:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- 172.21.15.145:0/3708329739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 msgr2=0x559bb0be8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/3708329739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f57bc08f270 tx=0x7f57bc009f30 comp rx=0 tx=0).stop 2024-09-10T04:50:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- 172.21.15.145:0/3708329739 shutdown_connections 2024-09-10T04:50:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/3708329739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0be8d50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- 172.21.15.145:0/3708329739 >> 172.21.15.145:0/3708329739 conn(0x559bb0be4d70 msgr2=0x559bb0be2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- 172.21.15.145:0/3708329739 shutdown_connections 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- 172.21.15.145:0/3708329739 wait complete. 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 Processor -- start 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- start start 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0befd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57d0d1f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559bb0be97d0 con 0x559bb0be8970 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0befd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57ccaa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0befd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54840/0 (socket says 172.21.15.145:54840) 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.453+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 learned_addr learned my addr 172.21.15.145:0/4194639490 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb0bf02d0 con 0x559bb0be8970 2024-09-10T04:50:29.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0befd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f57bc095240 tx=0x7f57bc051f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f56a27fc640 1 -- 172.21.15.145:0/4194639490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc0c4070 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f56a27fc640 1 -- 172.21.15.145:0/4194639490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc068470 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bb0bf02d0 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f56a27fc640 1 -- 172.21.15.145:0/4194639490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc089450 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.454+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb0bf02d0 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.455+0000 7f56a27fc640 1 -- 172.21.15.145:0/4194639490 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f57bc0c7070 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.455+0000 7f56a27fc640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f569803c780 0x7f569803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.455+0000 7f56a27fc640 1 -- 172.21.15.145:0/4194639490 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f57bc0c0c50 con 0x559bb0be8970 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.455+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f569803c780 0x7f569803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f569803c780 0x7f569803ec40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57c000efd0 tx=0x7f57c0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0bfb2f0 0x559bb0bfd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bfdf00 con 0x559bb0bfb2f0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0bfb2f0 0x559bb0bfd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0bfb2f0 0x559bb0bfd7b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 20 realm 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.456+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bfa620 con 0x559bb0bfb2f0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0bfe990 con 0x559bb0bfb2f0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bff770 0x559bb0c01b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c021c0 con 0x559bb0bff770 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bff770 0x559bb0c01b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bff770 0x559bb0c01b60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.457+0000 7f57d0d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c02a10 con 0x559bb0bfb2f0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 20 searching for the correct realm 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bb0c04780 0x559bb0c06bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bb0c04780 0x559bb0c06bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57cc2a1640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bb0c04780 0x559bb0c06bb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.458+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57ccaa2640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f57bc0c9060 0x7f57bc0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f57bc0c9060 0x7f57bc0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57cd2a3640 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f57bc0c9060 0x7f57bc0c98a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f57c400a4d0 con 0x7f57bc0c9060 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.459+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.460+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c400a4d0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x7f57bc0c9060 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.461+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f57c4030040 con 0x7f57bc0c9060 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.462+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.463+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bfb2f0 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.464+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c4030040 con 0x7f57bc0c9060 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.465+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0c04780 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07280 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c033c0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57c4030040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.466+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c03c60 con 0x559bb0bff770 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c03000 con 0x7f57bc0c9060 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 zone default found 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 4 Realm: () 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 zonegroup default 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c07760 con 0x7f57bc0c9060 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c095c0 con 0x559bb0c04780 2024-09-10T04:50:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.467+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c09a90 con 0x559bb0c04780 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.468+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.468+0000 7f57d0d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.468+0000 7f57d0d1f800 20 started sync module instance, tier type = 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.468+0000 7f57d0d1f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.468+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x559bb0bff770 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.469+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.469+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94127173701456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x559bb0bff770 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.469+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0a570 con 0x559bb0bfb2f0 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.470+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94127173701456] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.470+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.470+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94127173705824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x559bb0bfb2f0 2024-09-10T04:50:29.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.470+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0b030 con 0x559bb0bff770 2024-09-10T04:50:29.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.472+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94127173705824] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.472+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.472+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94127173708544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x559bb0bff770 2024-09-10T04:50:29.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.472+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0bb00 con 0x7f57bc0c9060 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.473+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94127173708544] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.473+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.473+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94127173711344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x7f57bc0c9060 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.473+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0c550 con 0x559bb0bff770 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.474+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94127173711344] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.474+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.474+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94127173714016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c08a30 con 0x559bb0bff770 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.474+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0cf90 con 0x559bb0c04780 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.475+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94127173714016] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.475+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.475+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94127173698944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c089a0 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.475+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0dcd0 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.476+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94127173698944] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.476+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.476+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94127173719312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0e570 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.476+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0ef30 con 0x7f57bc0c9060 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94127173719312] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94127173724800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0f350 con 0x7f57bc0c9060 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=0 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=1 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=2 2024-09-10T04:50:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=3 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=4 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=5 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.480+0000 7f57d0d1f800 20 add_watcher() i=6 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.482+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94127173724800] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.482+0000 7f57d0d1f800 20 add_watcher() i=7 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.482+0000 7f57d0d1f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.482+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c12660 con 0x559bb0bfb2f0 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.483+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.483+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94127173726224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c0f8e0 con 0x559bb0bfb2f0 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94127173726224] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f56837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57d0d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57d0d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57d0d1f800 5 note: GC not initialized 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f56827e4640 20 reqs_thread_entry: start 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57d0d1f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.484+0000 7f57d0d1f800 20 Filter name: none 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f567bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c45850 con 0x559bb0bfb2f0 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.485+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c4be20 con 0x559bb0bfb2f0 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.486+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.486+0000 7f57d0d1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.486+0000 7f57d0d1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.486+0000 7f57d0d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.486+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94127173974048 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c474e0 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94127173714016 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x559bb0bdd360 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f56a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94127173714016 notifier 4370 bl.length()=732 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f56a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f56a3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94127173974048 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f56a3fff640 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5690003ea0 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.487+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94127173974048 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559bb0bdcb30 con 0x559bb0bff770 2024-09-10T04:50:29.497 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.488+0000 7f56837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.488+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94127173726224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c47030 con 0x559bb0bfb2f0 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.489+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94127173726224] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.489+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94127173701456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0bff770 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.490+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94127173701456] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.490+0000 7f57d0d1f800 20 remove_watcher() i=0 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.490+0000 7f57d0d1f800 2 removed watcher, disabling cache 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.490+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94127173705824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0bfb2f0 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.492+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94127173705824] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x559bb0bfb2f0 2024-09-10T04:50:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.492+0000 7f57d0d1f800 20 remove_watcher() i=1 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.492+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94127173708544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0bff770 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.493+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94127173708544] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.493+0000 7f57d0d1f800 20 remove_watcher() i=2 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.493+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94127173711344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x7f57bc0c9060 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.494+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94127173711344] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.494+0000 7f57d0d1f800 20 remove_watcher() i=3 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.494+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94127173714016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0bff770 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.495+0000 7f57ccaa2640 1 -- 172.21.15.145:0/4194639490 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94127173714016] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57bc0c6030 con 0x559bb0bff770 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.495+0000 7f57d0d1f800 20 remove_watcher() i=4 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.495+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94127173698944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0c04780 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.496+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94127173698944] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.496+0000 7f57d0d1f800 20 remove_watcher() i=5 2024-09-10T04:50:29.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.496+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94127173719312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x559bb0c04780 2024-09-10T04:50:29.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.497+0000 7f57cc2a1640 1 -- 172.21.15.145:0/4194639490 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94127173719312] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c0009050 con 0x559bb0c04780 2024-09-10T04:50:29.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.497+0000 7f57d0d1f800 20 remove_watcher() i=6 2024-09-10T04:50:29.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.497+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94127173724800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bb0c43690 con 0x7f57bc0c9060 2024-09-10T04:50:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94127173724800] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57c4041040 con 0x7f57bc0c9060 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 20 remove_watcher() i=7 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bff770 msgr2=0x559bb0c01b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bff770 0x559bb0c01b60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0bfb2f0 msgr2=0x559bb0bfd7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0bfb2f0 0x559bb0bfd7b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f57bc0c9060 msgr2=0x7f57bc0c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f57bc0c9060 0x7f57bc0c98a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bb0c04780 msgr2=0x559bb0c06bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559bb0c04780 0x559bb0c06bb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f569803c780 msgr2=0x7f569803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f569803c780 0x7f569803ec40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57c000efd0 tx=0x7f57c0010000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 msgr2=0x559bb0befd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4194639490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0be8970 0x559bb0befd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f57bc095240 tx=0x7f57bc051f20 comp rx=0 tx=0).stop 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 reap_dead start 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.499+0000 7f57cd2a3640 1 -- 172.21.15.145:0/4194639490 reap_dead start 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 shutdown_connections 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 >> 172.21.15.145:0/4194639490 conn(0x559bb0be4d70 msgr2=0x559bb0be2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 shutdown_connections 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4194639490 wait complete. 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 msgr2=0x7f56a403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 0x7f56a403eba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57c00016b0 tx=0x7f57c000f000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 msgr2=0x559bb0bdc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f57bc096370 tx=0x7f57bc05d870 comp rx=0 tx=0).stop 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 shutdown_connections 2024-09-10T04:50:29.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56a403c6e0 0x7f56a403eba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/4229450275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0bdc0d0 0x559bb0bdc4f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 >> 172.21.15.145:0/4229450275 conn(0x559bb0bd0430 msgr2=0x559bb0bd0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 shutdown_connections 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/4229450275 wait complete. 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bc6460 msgr2=0x559bb0bc8900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559bb0bc6460 0x559bb0bc8900 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0aca020 msgr2=0x559bb0bc5670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559bb0aca020 0x559bb0bc5670 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bb0bca4d0 msgr2=0x559bb0bcdce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559bb0bca4d0 0x559bb0bcdce0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56b403c730 msgr2=0x7f56b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56b403c730 0x7f56b403ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57c0001d70 tx=0x7f57c00012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 msgr2=0x559bb0bbe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 --2- 172.21.15.145:0/2012797095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559bb0ac7690 0x559bb0bbe020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f57bc025c20 tx=0x7f57bc002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57cd2a3640 1 -- 172.21.15.145:0/2012797095 reap_dead start 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 shutdown_connections 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.500+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 >> 172.21.15.145:0/2012797095 conn(0x559bb0ac11d0 msgr2=0x559bb0bb08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.501+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 shutdown_connections 2024-09-10T04:50:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.501+0000 7f57d0d1f800 1 -- 172.21.15.145:0/2012797095 wait complete. 2024-09-10T04:50:29.512 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.512 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.512 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:29.556 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.556 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.554+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6dd746800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c229426210 0x55c22942bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6dd746800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2292cfe40 con 0x55c229424e00 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6dd746800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55c22929a680 con 0x55c229426210 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6daa36640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c229426210 0x55c22942bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6db237640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55c229424e00 0x55c229425b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39048/0 (socket says 172.21.15.145:39048) 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6daa36640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c229426210 0x55c22942bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54854/0 (socket says 172.21.15.145:54854) 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6db237640 1 -- 172.21.15.145:0/3052361597 learned_addr learned my addr 172.21.15.145:0/3052361597 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6daa36640 1 -- 172.21.15.145:0/3052361597 >> v1:172.21.15.98:6789/0 conn(0x55c229424e00 legacy=0x55c229425b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.555+0000 7fc6daa36640 1 -- 172.21.15.145:0/3052361597 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2292b66b0 con 0x55c229426210 2024-09-10T04:50:29.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.557+0000 7fc6daa36640 1 --2- 172.21.15.145:0/3052361597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229426210 0x55c22942bdb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400a470 tx=0x7fc6c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dd008f692dfd3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.557+0000 7fc6da235640 1 -- 172.21.15.145:0/3052361597 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6c4053570 con 0x55c229426210 2024-09-10T04:50:29.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.557+0000 7fc6da235640 1 -- 172.21.15.145:0/3052361597 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c4058070 con 0x55c229426210 2024-09-10T04:50:29.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.557+0000 7fc6da235640 1 -- 172.21.15.145:0/3052361597 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6c4053880 con 0x55c229426210 2024-09-10T04:50:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 -- 172.21.15.145:0/3052361597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229426210 msgr2=0x55c22942bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 --2- 172.21.15.145:0/3052361597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229426210 0x55c22942bdb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400a470 tx=0x7fc6c4045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 -- 172.21.15.145:0/3052361597 shutdown_connections 2024-09-10T04:50:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 --2- 172.21.15.145:0/3052361597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229426210 0x55c22942bdb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 -- 172.21.15.145:0/3052361597 >> 172.21.15.145:0/3052361597 conn(0x55c2294201f0 msgr2=0x55c229422630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 -- 172.21.15.145:0/3052361597 shutdown_connections 2024-09-10T04:50:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.558+0000 7fc6dd746800 1 -- 172.21.15.145:0/3052361597 wait complete. 2024-09-10T04:50:29.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.571+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6dd746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6dd746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2292bedd0 con 0x55c229424e00 2024-09-10T04:50:29.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54862/0 (socket says 172.21.15.145:54862) 2024-09-10T04:50:29.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6db237640 1 -- 172.21.15.145:0/957177539 learned_addr learned my addr 172.21.15.145:0/957177539 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6db237640 1 -- 172.21.15.145:0/957177539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2292d7e10 con 0x55c229424e00 2024-09-10T04:50:29.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.572+0000 7fc6db237640 1 --2- 172.21.15.145:0/957177539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4001800 tx=0x7fc6d4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4882d02066521bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc5c960a640 1 -- 172.21.15.145:0/957177539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4004520 con 0x55c229424e00 2024-09-10T04:50:29.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc5c960a640 1 -- 172.21.15.145:0/957177539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d40046c0 con 0x55c229424e00 2024-09-10T04:50:29.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc5c960a640 1 -- 172.21.15.145:0/957177539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d40049e0 con 0x55c229424e00 2024-09-10T04:50:29.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 -- 172.21.15.145:0/957177539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 msgr2=0x55c229515600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 --2- 172.21.15.145:0/957177539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4001800 tx=0x7fc6d4001cc0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 -- 172.21.15.145:0/957177539 shutdown_connections 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 --2- 172.21.15.145:0/957177539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c229515600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 -- 172.21.15.145:0/957177539 >> 172.21.15.145:0/957177539 conn(0x55c2294201f0 msgr2=0x55c229510f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 -- 172.21.15.145:0/957177539 shutdown_connections 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.573+0000 7fc6dd746800 1 -- 172.21.15.145:0/957177539 wait complete. 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6dd746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c22951cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6dd746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c229426900 con 0x55c229424e00 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c22951cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c22951cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54868/0 (socket says 172.21.15.145:54868) 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6db237640 1 -- 172.21.15.145:0/473116525 learned_addr learned my addr 172.21.15.145:0/473116525 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6db237640 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22951d4e0 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc6db237640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c22951cf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000f80 tx=0x7fc6d4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.574+0000 7fc5c7e07640 1 -- 172.21.15.145:0/473116525 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4022020 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.575+0000 7fc5c7e07640 1 -- 172.21.15.145:0/473116525 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4014890 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.575+0000 7fc5c7e07640 1 -- 172.21.15.145:0/473116525 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4014bb0 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.575+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c22951d770 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.575+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22951e170 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.575+0000 7fc5c7e07640 1 -- 172.21.15.145:0/473116525 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6d4025020 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc5c7e07640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5c003c780 0x7fc5c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc5c7e07640 1 -- 172.21.15.145:0/473116525 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc6d4018030 con 0x55c229424e00 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6daa36640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5c003c780 0x7fc5c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c229426210 0x55c2295245d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229524b10 con 0x55c229426210 2024-09-10T04:50:29.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6dba38640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c229426210 0x55c2295245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6daa36640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5c003c780 0x7fc5c003ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4057000 tx=0x7fc6c4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.576+0000 7fc6dba38640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c229426210 0x55c2295245d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.577+0000 7fc6dba38640 1 -- 172.21.15.145:0/473116525 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c229426210 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.577+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295253c0 0x55c229527880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.577+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229527ff0 con 0x55c2295253c0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.577+0000 7fc6db237640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295253c0 0x55c229527880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.577+0000 7fc6db237640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295253c0 0x55c229527880 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6db237640 1 -- 172.21.15.145:0/473116525 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6d401b070 con 0x55c2295253c0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2295298a0 con 0x55c229426210 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6dba38640 1 -- 172.21.15.145:0/473116525 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c229426210 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229528ad0 con 0x55c2295253c0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6db237640 1 -- 172.21.15.145:0/473116525 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6d401b070 con 0x55c2295253c0 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c22952ac50 0x55c22952d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22952d580 con 0x55c22952ac50 2024-09-10T04:50:29.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6daa36640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c22952ac50 0x55c22952d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.578+0000 7fc6daa36640 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c22952ac50 0x55c22952d040 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6daa36640 1 -- 172.21.15.145:0/473116525 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6c4051070 con 0x55c22952ac50 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6dd746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6dd746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c22931ca00 con 0x55c22942ec90 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54872/0 (socket says 172.21.15.145:54872) 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.579+0000 7fc6db237640 1 -- 172.21.15.145:0/535297018 learned_addr learned my addr 172.21.15.145:0/535297018 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc6db237640 1 -- 172.21.15.145:0/535297018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22942f1b0 con 0x55c22942ec90 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc6db237640 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4006530 tx=0x7fc6d4010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc5c5602640 1 -- 172.21.15.145:0/535297018 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4045070 con 0x55c22942ec90 2024-09-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc5c5602640 1 -- 172.21.15.145:0/535297018 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4034030 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c22942da40 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc5c5602640 1 -- 172.21.15.145:0/535297018 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d404adb0 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.580+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22942dfe0 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc5c5602640 1 -- 172.21.15.145:0/535297018 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6d4010070 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc5c5602640 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 0x7fc5b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc5c5602640 1 -- 172.21.15.145:0/535297018 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc6d403ac80 con 0x55c22942ec90 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc6daa36640 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 0x7fc5b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.581+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6daa36640 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 0x7fc5b403ebf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c22951eeb0 tx=0x7fc6c4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6dd746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6dd746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c229515e50 con 0x55c229549c50 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54884/0 (socket says 172.21.15.145:54884) 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6db237640 1 -- 172.21.15.145:0/2148181977 learned_addr learned my addr 172.21.15.145:0/2148181977 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6db237640 1 -- 172.21.15.145:0/2148181977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22954a640 con 0x55c229549c50 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc6db237640 1 --2- 172.21.15.145:0/2148181977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40267c0 tx=0x7fc6d404bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0885ccf0eec273a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc5beffd640 1 -- 172.21.15.145:0/2148181977 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4063070 con 0x55c229549c50 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc5beffd640 1 -- 172.21.15.145:0/2148181977 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4046040 con 0x55c229549c50 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.582+0000 7fc5beffd640 1 -- 172.21.15.145:0/2148181977 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4050200 con 0x55c229549c50 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- 172.21.15.145:0/2148181977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 msgr2=0x55c22954a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2148181977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40267c0 tx=0x7fc6d404bc60 comp rx=0 tx=0).stop 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- 172.21.15.145:0/2148181977 shutdown_connections 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2148181977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c22954a050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- 172.21.15.145:0/2148181977 >> 172.21.15.145:0/2148181977 conn(0x55c229546050 msgr2=0x55c229544290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- 172.21.15.145:0/2148181977 shutdown_connections 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- 172.21.15.145:0/2148181977 wait complete. 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 Processor -- start 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- start start 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6dd746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c22954aab0 con 0x55c229549c50 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6db237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54896/0 (socket says 172.21.15.145:54896) 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.583+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 learned_addr learned my addr 172.21.15.145:0/2762037522 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c229551610 con 0x55c229549c50 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc6db237640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6d404bca0 tx=0x7fc6d4022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc5bd7fa640 1 -- 172.21.15.145:0/2762037522 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4079070 con 0x55c229549c50 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc5bd7fa640 1 -- 172.21.15.145:0/2762037522 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4050200 con 0x55c229549c50 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c229551610 con 0x55c229549c50 2024-09-10T04:50:29.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc5bd7fa640 1 -- 172.21.15.145:0/2762037522 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d40269a0 con 0x55c229549c50 2024-09-10T04:50:29.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.584+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c229551610 con 0x55c229549c50 2024-09-10T04:50:29.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc5bd7fa640 1 -- 172.21.15.145:0/2762037522 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6d407c070 con 0x55c229549c50 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc5bd7fa640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5a403c730 0x7fc5a403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc5bd7fa640 1 -- 172.21.15.145:0/2762037522 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc6d407fca0 con 0x55c229549c50 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc6daa36640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5a403c730 0x7fc5a403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c22955c690 0x55c22955eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22955f250 con 0x55c22955c690 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.585+0000 7fc6dba38640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c22955c690 0x55c22955eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6daa36640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5a403c730 0x7fc5a403ebf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4000c00 tx=0x7fc6c4053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dba38640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c22955c690 0x55c22955eb00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c22955c690 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 20 realm 2024-09-10T04:50:29.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22955ba40 con 0x55c22955c690 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c22955c690 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.586+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22955fd10 con 0x55c22955c690 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c22955c690 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295608d0 0x55c229562d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229563500 con 0x55c2295608d0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6db237640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295608d0 0x55c229562d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6db237640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295608d0 0x55c229562d90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6d407b030 con 0x55c2295608d0 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.587+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c22955c690 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6dd746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6dd746800 20 searching for the correct realm 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c229565b10 0x55c229567f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2295685f0 con 0x55c229565b10 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6daa36640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c229565b10 0x55c229567f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6daa36640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c229565b10 0x55c229567f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.588+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2295685f0 con 0x55c2295608d0 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d407b030 con 0x55c2295608d0 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6db237640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6d407e060 0x7fc6d4031a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2295685f0 con 0x7fc6d407e060 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6d407e060 0x7fc6d4031a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6d407e060 0x7fc6d4031a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc6cc0083e0 con 0x7fc6d407e060 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc0083e0 con 0x55c22955c690 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.589+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.590+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x7fc6d407e060 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x7fc6d407e060 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.591+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.592+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.593+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x7fc6d407e060 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c22955c690 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x7fc6d407e060 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.594+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x7fc6d407e060 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.595+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c229565b10 2024-09-10T04:50:29.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c229563da0 con 0x55c2295608d0 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.596+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2295645f0 con 0x55c22955c690 2024-09-10T04:50:29.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2295649e0 con 0x55c2295608d0 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229564e00 con 0x7fc6d407e060 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 zone default found 2024-09-10T04:50:29.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 4 Realm: () 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 zonegroup default 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c229565230 con 0x7fc6d407e060 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.597+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22956a4b0 con 0x55c229565b10 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22956a850 con 0x55c229565b10 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 20 started sync module instance, tier type = 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.598+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569950 con 0x55c2295608d0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.599+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.599+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292405558640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956b0f0 con 0x55c2295608d0 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.599+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956b940 con 0x55c22955c690 2024-09-10T04:50:29.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.600+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292405558640] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.600+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.600+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292405562432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956b630 con 0x55c22955c690 2024-09-10T04:50:29.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.600+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956c130 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.602+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292405562432] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.602+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.602+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292405566496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956c0f0 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.602+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956cbe0 con 0x7fc6d407e060 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.604+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292405566496] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.604+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.604+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292405563552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956cbe0 con 0x7fc6d407e060 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.605+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956d630 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.605+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292405563552] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.606+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.606+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292405569216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956d5f0 con 0x55c2295608d0 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.606+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956dff0 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.607+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292405569216] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.607+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.607+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292405571904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956d560 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.607+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956ee60 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.608+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292405571904] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.608+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.608+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292405578160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956edd0 con 0x55c229565b10 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.608+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956fd20 con 0x7fc6d407e060 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292405581936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956fc90 con 0x7fc6d407e060 2024-09-10T04:50:29.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=0 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=1 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=2 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=3 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=4 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=5 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292405578160] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.609+0000 7fc6dd746800 20 add_watcher() i=6 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.610+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292405581936] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.610+0000 7fc6dd746800 20 add_watcher() i=7 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.610+0000 7fc6dd746800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.610+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c22956f250 con 0x55c22955c690 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.611+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.611+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292405583968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956f250 con 0x55c22955c690 2024-09-10T04:50:29.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292405583968] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc5927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dd746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dd746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dd746800 5 note: GC not initialized 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc5917e2640 20 reqs_thread_entry: start 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dd746800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc6dd746800 20 Filter name: none 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.612+0000 7fc58a7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.613+0000 7fc6dd746800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.613+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2295a5d40 con 0x55c22955c690 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.613+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.613+0000 7fc6dd746800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T04:50:29.625 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.614+0000 7fc5927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.614+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292405583968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2295a47f0 con 0x55c22955c690 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.615+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94292405583968] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.615+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292405558640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2295a47f0 con 0x55c2295608d0 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.616+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94292405558640] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.616+0000 7fc6dd746800 20 remove_watcher() i=0 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.616+0000 7fc6dd746800 2 removed watcher, disabling cache 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.616+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292405562432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569d70 con 0x55c22955c690 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.617+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94292405562432] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x55c22955c690 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.617+0000 7fc6dd746800 20 remove_watcher() i=1 2024-09-10T04:50:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.617+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292405566496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569d70 con 0x55c2295608d0 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.618+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94292405566496] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.618+0000 7fc6dd746800 20 remove_watcher() i=2 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.618+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292405563552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569d70 con 0x7fc6d407e060 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.619+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94292405563552] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.619+0000 7fc6dd746800 20 remove_watcher() i=3 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.619+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292405569216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569d70 con 0x55c2295608d0 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.620+0000 7fc6db237640 1 -- 172.21.15.145:0/2762037522 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94292405569216] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d408d040 con 0x55c2295608d0 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.620+0000 7fc6dd746800 20 remove_watcher() i=4 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.620+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292405571904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c229569d70 con 0x55c229565b10 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.621+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94292405571904] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.621+0000 7fc6dd746800 20 remove_watcher() i=5 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.621+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292405578160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956d140 con 0x55c229565b10 2024-09-10T04:50:29.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.622+0000 7fc6daa36640 1 -- 172.21.15.145:0/2762037522 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94292405578160] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6c407c040 con 0x55c229565b10 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.622+0000 7fc6dd746800 20 remove_watcher() i=6 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.622+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292405581936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c22956e9b0 con 0x7fc6d407e060 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94292405581936] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc025040 con 0x7fc6d407e060 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 20 remove_watcher() i=7 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295608d0 msgr2=0x55c229562d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295608d0 0x55c229562d90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c22955c690 msgr2=0x55c22955eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c22955c690 0x55c22955eb00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6d407e060 msgr2=0x7fc6d4031a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6d407e060 0x7fc6d4031a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c229565b10 msgr2=0x55c229567f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c229565b10 0x55c229567f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5a403c730 msgr2=0x7fc5a403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5a403c730 0x7fc5a403ebf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4000c00 tx=0x7fc6c4053000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 msgr2=0x55c2295510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dba38640 1 -- 172.21.15.145:0/2762037522 reap_dead start 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc6d404bca0 tx=0x7fc6d4022f30 comp rx=0 tx=0).stop 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 shutdown_connections 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/2762037522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229549c50 0x55c2295510b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 >> 172.21.15.145:0/2762037522 conn(0x55c229546050 msgr2=0x55c229544260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 shutdown_connections 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/2762037522 wait complete. 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 msgr2=0x7fc5b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 0x7fc5b403ebf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c22951eeb0 tx=0x7fc6c4005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:29.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 msgr2=0x55c22942d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4006530 tx=0x7fc6d4010e80 comp rx=0 tx=0).stop 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 shutdown_connections 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5b403c730 0x7fc5b403ebf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 --2- 172.21.15.145:0/535297018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c22942ec90 0x55c22942d500 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.623+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 >> 172.21.15.145:0/535297018 conn(0x55c22952f4b0 msgr2=0x55c22952f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 shutdown_connections 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/535297018 wait complete. 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295253c0 msgr2=0x55c229527880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c2295253c0 0x55c229527880 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c229426210 msgr2=0x55c2295245d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c229426210 0x55c2295245d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c22952ac50 msgr2=0x55c22952d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c22952ac50 0x55c22952d040 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5c003c780 msgr2=0x7fc5c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc5c003c780 0x7fc5c003ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4057000 tx=0x7fc6c4052000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 msgr2=0x55c22951cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 --2- 172.21.15.145:0/473116525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c229424e00 0x55c22951cf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000f80 tx=0x7fc6d4001250 comp rx=0 tx=0).stop 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dba38640 1 -- 172.21.15.145:0/473116525 reap_dead start 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 shutdown_connections 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 >> 172.21.15.145:0/473116525 conn(0x55c2294201f0 msgr2=0x55c2295168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 shutdown_connections 2024-09-10T04:50:29.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.624+0000 7fc6dd746800 1 -- 172.21.15.145:0/473116525 wait complete. 2024-09-10T04:50:29.636 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.637 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8faafab800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f573d26730 0x55f573d28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8faafab800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f573bcfe40 con 0x55f573d29060 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8faafab800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f573b9a680 con 0x55f573d26730 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8fa8a95640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f573d26730 0x55f573d28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8fa8a95640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f573d26730 0x55f573d28b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54912/0 (socket says 172.21.15.145:54912) 2024-09-10T04:50:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8fa8a95640 1 -- 172.21.15.145:0/3241404799 learned_addr learned my addr 172.21.15.145:0/3241404799 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.680+0000 7f8fa3fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f573d29060 0x55f573d2b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39064/0 (socket says 172.21.15.145:39064) 2024-09-10T04:50:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.681+0000 7f8fa8a95640 1 -- 172.21.15.145:0/3241404799 >> v1:172.21.15.98:6789/0 conn(0x55f573d29060 legacy=0x55f573d2b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.681+0000 7f8fa8a95640 1 -- 172.21.15.145:0/3241404799 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573bb66b0 con 0x55f573d26730 2024-09-10T04:50:29.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.682+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/3241404799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d28b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00a520 tx=0x7f8f9c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd4a5621019a6a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8fa37fe640 1 -- 172.21.15.145:0/3241404799 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c055070 con 0x55f573d26730 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8fa37fe640 1 -- 172.21.15.145:0/3241404799 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0515b0 con 0x55f573d26730 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8fa37fe640 1 -- 172.21.15.145:0/3241404799 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0518d0 con 0x55f573d26730 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 -- 172.21.15.145:0/3241404799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 msgr2=0x55f573d28b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 --2- 172.21.15.145:0/3241404799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d28b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00a520 tx=0x7f8f9c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 -- 172.21.15.145:0/3241404799 shutdown_connections 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 --2- 172.21.15.145:0/3241404799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d28b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 -- 172.21.15.145:0/3241404799 >> 172.21.15.145:0/3241404799 conn(0x55f573d201f0 msgr2=0x55f573d22630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 -- 172.21.15.145:0/3241404799 shutdown_connections 2024-09-10T04:50:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.683+0000 7f8faafab800 1 -- 172.21.15.145:0/3241404799 wait complete. 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.697+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.697+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.697+0000 7f8faafab800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.697+0000 7f8faafab800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f573bbedd0 con 0x55f573d26730 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54928/0 (socket says 172.21.15.145:54928) 2024-09-10T04:50:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8fa8a95640 1 -- 172.21.15.145:0/2531544100 learned_addr learned my addr 172.21.15.145:0/2531544100 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8fa8a95640 1 -- 172.21.15.145:0/2531544100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573bd7e10 con 0x55f573d26730 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/2531544100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0460d0 tx=0x7f8f9c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61527bd05734e632 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.698+0000 7f8e96e05640 1 -- 172.21.15.145:0/2531544100 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0519d0 con 0x55f573d26730 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8e96e05640 1 -- 172.21.15.145:0/2531544100 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c051b70 con 0x55f573d26730 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8e96e05640 1 -- 172.21.15.145:0/2531544100 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c051e50 con 0x55f573d26730 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 -- 172.21.15.145:0/2531544100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 msgr2=0x55f573d25ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 --2- 172.21.15.145:0/2531544100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0460d0 tx=0x7f8f9c051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 -- 172.21.15.145:0/2531544100 shutdown_connections 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 --2- 172.21.15.145:0/2531544100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573d25ea0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 -- 172.21.15.145:0/2531544100 >> 172.21.15.145:0/2531544100 conn(0x55f573d201f0 msgr2=0x55f573e10fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 -- 172.21.15.145:0/2531544100 shutdown_connections 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.699+0000 7f8faafab800 1 -- 172.21.15.145:0/2531544100 wait complete. 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8faafab800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573e1f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8faafab800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f573d2d050 con 0x55f573d26730 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573e1f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573e1f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54930/0 (socket says 172.21.15.145:54930) 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8fa8a95640 1 -- 172.21.15.145:0/138769220 learned_addr learned my addr 172.21.15.145:0/138769220 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8fa8a95640 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573e1f5b0 con 0x55f573d26730 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573e1f050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0460d0 tx=0x7f8f9c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8e95602640 1 -- 172.21.15.145:0/138769220 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c073020 con 0x55f573d26730 2024-09-10T04:50:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8e95602640 1 -- 172.21.15.145:0/138769220 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c06f580 con 0x55f573d26730 2024-09-10T04:50:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f573e1f840 con 0x55f573d26730 2024-09-10T04:50:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.700+0000 7f8e95602640 1 -- 172.21.15.145:0/138769220 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c06f8a0 con 0x55f573d26730 2024-09-10T04:50:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.701+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f573e20450 con 0x55f573d26730 2024-09-10T04:50:29.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.701+0000 7f8e95602640 1 -- 172.21.15.145:0/138769220 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f9c076020 con 0x55f573d26730 2024-09-10T04:50:29.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8e95602640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e9003c780 0x7f8e9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8e95602640 1 -- 172.21.15.145:0/138769220 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f9c06b040 con 0x55f573d26730 2024-09-10T04:50:29.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e9003c780 0x7f8e9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573d29060 0x55f573e266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e26be0 con 0x55f573d29060 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8fa9296640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573d29060 0x55f573e266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e9003c780 0x7f8e9003ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f94001e30 tx=0x7f8f94001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8fa9296640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573d29060 0x55f573e266a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8fa9296640 1 -- 172.21.15.145:0/138769220 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573d29060 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e274e0 0x55f573e29970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.702+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e2a0e0 con 0x55f573e274e0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.703+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e274e0 0x55f573e29970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.703+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e274e0 0x55f573e29970 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.703+0000 7f8fa8a95640 1 -- 172.21.15.145:0/138769220 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e274e0 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.703+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e2b990 con 0x55f573d29060 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.703+0000 7f8fa9296640 1 -- 172.21.15.145:0/138769220 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573d29060 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e2abc0 con 0x55f573e274e0 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8fa8a95640 1 -- 172.21.15.145:0/138769220 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e274e0 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f573e2cd40 0x55f573e2f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e2f670 con 0x55f573e2cd40 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f573e2cd40 0x55f573e2f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f573e2cd40 0x55f573e2f130 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.704+0000 7f8fa3fff640 1 -- 172.21.15.145:0/138769220 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f9400bd50 con 0x55f573e2cd40 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8faafab800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8faafab800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f573c1ca00 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54934/0 (socket says 172.21.15.145:54934) 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.705+0000 7f8fa8a95640 1 -- 172.21.15.145:0/3506411790 learned_addr learned my addr 172.21.15.145:0/3506411790 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8fa8a95640 1 -- 172.21.15.145:0/3506411790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573e3dc80 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c065fd0 tx=0x7f8f9c06fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8e8e7fc640 1 -- 172.21.15.145:0/3506411790 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c05a580 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8e8e7fc640 1 -- 172.21.15.145:0/3506411790 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c08f8b0 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8e8e7fc640 1 -- 172.21.15.145:0/3506411790 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c08fbb0 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f573e3e4b0 con 0x55f573e3d220 2024-09-10T04:50:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.706+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f573e3ea50 con 0x55f573e3d220 2024-09-10T04:50:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8e8e7fc640 1 -- 172.21.15.145:0/3506411790 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f9c09f060 con 0x55f573e3d220 2024-09-10T04:50:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8e8e7fc640 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 0x7f8e8003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8e8e7fc640 1 -- 172.21.15.145:0/3506411790 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f9c09d070 con 0x55f573e3d220 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 0x7f8e8003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 0x7f8e8003eba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c005570 tx=0x7f8f9400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8faafab800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.707+0000 7f8faafab800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f573d24740 con 0x55f573e49ae0 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54948/0 (socket says 172.21.15.145:54948) 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8fa8a95640 1 -- 172.21.15.145:0/2811038707 learned_addr learned my addr 172.21.15.145:0/2811038707 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8fa8a95640 1 -- 172.21.15.145:0/2811038707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573e4a4b0 con 0x55f573e49ae0 2024-09-10T04:50:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/2811038707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c05ac50 tx=0x7f8f9c0814f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691845d0ccbf93d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8e7ffff640 1 -- 172.21.15.145:0/2811038707 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0064b0 con 0x55f573e49ae0 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8e7ffff640 1 -- 172.21.15.145:0/2811038707 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0a7070 con 0x55f573e49ae0 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8e7ffff640 1 -- 172.21.15.145:0/2811038707 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c07a220 con 0x55f573e49ae0 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8faafab800 1 -- 172.21.15.145:0/2811038707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 msgr2=0x55f573e49ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8faafab800 1 --2- 172.21.15.145:0/2811038707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c05ac50 tx=0x7f8f9c0814f0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8faafab800 1 -- 172.21.15.145:0/2811038707 shutdown_connections 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8faafab800 1 --2- 172.21.15.145:0/2811038707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e49ec0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.708+0000 7f8faafab800 1 -- 172.21.15.145:0/2811038707 >> 172.21.15.145:0/2811038707 conn(0x55f573e45ee0 msgr2=0x55f573e44120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 -- 172.21.15.145:0/2811038707 shutdown_connections 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 -- 172.21.15.145:0/2811038707 wait complete. 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 Processor -- start 2024-09-10T04:50:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 -- start start 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8faafab800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f573e4a940 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8fa8a95640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54952/0 (socket says 172.21.15.145:54952) 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 learned_addr learned my addr 172.21.15.145:0/1275145870 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f573e514a0 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.709+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c055950 tx=0x7f8f9c089f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8e7e7fc640 1 -- 172.21.15.145:0/1275145870 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c09c050 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8e7e7fc640 1 -- 172.21.15.145:0/1275145870 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0b2070 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f573e514a0 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8e7e7fc640 1 -- 172.21.15.145:0/1275145870 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c07a200 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f573e514a0 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.710+0000 7f8e7e7fc640 1 -- 172.21.15.145:0/1275145870 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f9c058070 con 0x55f573e49ae0 2024-09-10T04:50:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8e7e7fc640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e7403c780 0x7f8e7403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8e7e7fc640 1 -- 172.21.15.145:0/1275145870 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f9c062070 con 0x55f573e49ae0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e7403c780 0x7f8e7403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e7403c780 0x7f8e7403ec40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55f573e2b940 tx=0x7f8f94010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573e5c4e0 0x55f573e5e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e5f0f0 con 0x55f573e5c4e0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.711+0000 7f8fa9296640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573e5c4e0 0x55f573e5e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8fa9296640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573e5c4e0 0x55f573e5e9a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 realm 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e5b810 con 0x55f573e5c4e0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e5fb80 con 0x55f573e5c4e0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e60960 0x55f573e62d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.712+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e63380 con 0x55f573e60960 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e60960 0x55f573e62d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e60960 0x55f573e62d50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e63c20 con 0x55f573e5c4e0 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 20 searching for the correct realm 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f573e65990 0x55f573e67da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.713+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f573e65990 0x55f573e67da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa3fff640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f573e65990 0x55f573e67da0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa8a95640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8f9c07ac00 0x7f8f9c0a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.714+0000 7f8fa9296640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8f9c07ac00 0x7f8f9c0a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8f9c07ac00 0x7f8f9c0a2470 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fa400a4d0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.715+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.716+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa400a4d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fa4030040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.717+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.718+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.719+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e5c4e0 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.720+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x7f8f9c07ac00 2024-09-10T04:50:29.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4030040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e65990 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.721+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68470 con 0x55f573e60960 2024-09-10T04:50:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e645d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa4030040 con 0x55f573e5c4e0 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e641e0 con 0x55f573e60960 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.722+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e64f40 con 0x7f8f9c07ac00 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 zone default found 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 4 Realm: () 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 zonegroup default 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e68940 con 0x7f8f9c07ac00 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6a7e0 con 0x55f573e65990 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6ab80 con 0x55f573e65990 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 started sync module instance, tier type = 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.723+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e69c70 con 0x55f573e60960 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.725+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.725+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512699842704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b3d0 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.725+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6bc20 con 0x55f573e5c4e0 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.726+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512699842704] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.726+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.726+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512699846432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b930 con 0x55f573e5c4e0 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.726+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6c430 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.727+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512699846432] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.727+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.727+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512699850528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6c3f0 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.727+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6cee0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.728+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512699850528] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.728+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.728+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512699847552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6cee0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.728+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6d930 con 0x55f573e60960 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.729+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512699847552] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.729+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.729+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512699853248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6d8f0 con 0x55f573e60960 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.729+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6e340 con 0x55f573e65990 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.730+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.730+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512699858576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6ebe0 con 0x55f573e65990 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.730+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6f640 con 0x55f573e65990 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.730+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512699853248] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.731+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512699858576] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.731+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.731+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512699855936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6fa60 con 0x55f573e65990 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.731+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e702b0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512699855936] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512699865696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e706a0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=0 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=1 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=2 2024-09-10T04:50:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=3 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=4 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=5 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.732+0000 7f8faafab800 20 add_watcher() i=6 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.733+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512699865696] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.733+0000 7f8faafab800 20 add_watcher() i=7 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.733+0000 7f8faafab800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.733+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573e736d0 con 0x55f573e5c4e0 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.734+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.734+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512699867264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e70c20 con 0x55f573e5c4e0 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512699867264] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8e5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 5 note: GC not initialized 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8e5dfe3640 20 reqs_thread_entry: start 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 20 Filter name: none 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8dcf7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.735+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f573ea62e0 con 0x55f573e5c4e0 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.736+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.736+0000 7f8faafab800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T04:50:29.750 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.737+0000 7f8e5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.737+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512699867264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573ea4dd0 con 0x55f573e5c4e0 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.738+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94512699867264] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.738+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512699842704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e70050 con 0x55f573e60960 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.739+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94512699842704] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.739+0000 7f8faafab800 20 remove_watcher() i=0 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.739+0000 7f8faafab800 2 removed watcher, disabling cache 2024-09-10T04:50:29.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.739+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512699846432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6a090 con 0x55f573e5c4e0 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.740+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94512699846432] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x55f573e5c4e0 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.740+0000 7f8faafab800 20 remove_watcher() i=1 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.740+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512699850528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6a090 con 0x55f573e60960 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.741+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94512699850528] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.741+0000 7f8faafab800 20 remove_watcher() i=2 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.741+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512699847552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6bf20 con 0x7f8f9c07ac00 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.742+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94512699847552] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.742+0000 7f8faafab800 20 remove_watcher() i=3 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.742+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512699853248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b3d0 con 0x55f573e60960 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.743+0000 7f8fa8a95640 1 -- 172.21.15.145:0/1275145870 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94512699853248] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c057030 con 0x55f573e60960 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.743+0000 7f8faafab800 20 remove_watcher() i=4 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.743+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512699858576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b3d0 con 0x55f573e65990 2024-09-10T04:50:29.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.744+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94512699858576] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.744+0000 7f8faafab800 20 remove_watcher() i=5 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.744+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512699855936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b3d0 con 0x55f573e65990 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.745+0000 7f8fa3fff640 1 -- 172.21.15.145:0/1275145870 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94512699855936] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f94037040 con 0x55f573e65990 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.745+0000 7f8faafab800 20 remove_watcher() i=6 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.745+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512699865696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f573e6b3d0 con 0x7f8f9c07ac00 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94512699865696] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4041040 con 0x7f8f9c07ac00 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 20 remove_watcher() i=7 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e60960 msgr2=0x55f573e62d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e60960 0x55f573e62d50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573e5c4e0 msgr2=0x55f573e5e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573e5c4e0 0x55f573e5e9a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8f9c07ac00 msgr2=0x7f8f9c0a2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8f9c07ac00 0x7f8f9c0a2470 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f573e65990 msgr2=0x55f573e67da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f573e65990 0x55f573e67da0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e7403c780 msgr2=0x7f8e7403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e7403c780 0x7f8e7403ec40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55f573e2b940 tx=0x7f8f94010000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 msgr2=0x55f573e50f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c055950 tx=0x7f8f9c089f50 comp rx=0 tx=0).stop 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8fa9296640 1 -- 172.21.15.145:0/1275145870 reap_dead start 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 shutdown_connections 2024-09-10T04:50:29.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 --2- 172.21.15.145:0/1275145870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e49ae0 0x55f573e50f40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 >> 172.21.15.145:0/1275145870 conn(0x55f573e45ee0 msgr2=0x55f573e440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 shutdown_connections 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.746+0000 7f8faafab800 1 -- 172.21.15.145:0/1275145870 wait complete. 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 msgr2=0x7f8e8003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 0x7f8e8003eba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c005570 tx=0x7f8f9400f000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 msgr2=0x55f573e3d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c065fd0 tx=0x7f8f9c06fe10 comp rx=0 tx=0).stop 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 shutdown_connections 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e8003c6e0 0x7f8e8003eba0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/3506411790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573e3d220 0x55f573e3d640 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 >> 172.21.15.145:0/3506411790 conn(0x55f573e315d0 msgr2=0x55f573e319b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 shutdown_connections 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/3506411790 wait complete. 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e274e0 msgr2=0x55f573e29970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f573e274e0 0x55f573e29970 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573d29060 msgr2=0x55f573e266a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f573d29060 0x55f573e266a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f573e2cd40 msgr2=0x55f573e2f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f573e2cd40 0x55f573e2f130 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e9003c780 msgr2=0x7f8e9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8e9003c780 0x7f8e9003ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f94001e30 tx=0x7f8f94001390 comp rx=0 tx=0).stop 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 msgr2=0x55f573e1f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 --2- 172.21.15.145:0/138769220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f573d26730 0x55f573e1f050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0460d0 tx=0x7f8f9c002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8fa9296640 1 -- 172.21.15.145:0/138769220 reap_dead start 2024-09-10T04:50:29.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 shutdown_connections 2024-09-10T04:50:29.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 >> 172.21.15.145:0/138769220 conn(0x55f573d201f0 msgr2=0x55f573e10b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 shutdown_connections 2024-09-10T04:50:29.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.747+0000 7f8faafab800 1 -- 172.21.15.145:0/138769220 wait complete. 2024-09-10T04:50:29.762 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T04:50:29.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T04:50:29.762 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-10T04:50:29.811 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.811 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.809+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.809+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd24b3d800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5642d43b1410 0x5642d43b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd24b3d800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5642d425ce40 con 0x5642d43b1d50 2024-09-10T04:50:29.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd24b3d800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5642d4227680 con 0x5642d43b1410 2024-09-10T04:50:29.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd2082a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5642d43b1410 0x5642d43b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd20029640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5642d43b1d50 0x5642d43b21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39066/0 (socket says 172.21.15.145:39066) 2024-09-10T04:50:29.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd20029640 1 -- 172.21.15.145:0/3735070853 learned_addr learned my addr 172.21.15.145:0/3735070853 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd2082a640 1 -- 172.21.15.145:0/3735070853 >> v1:172.21.15.98:6789/0 conn(0x5642d43b1d50 legacy=0x5642d43b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.810+0000 7fbd2082a640 1 -- 172.21.15.145:0/3735070853 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d42436b0 con 0x5642d43b1410 2024-09-10T04:50:29.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.812+0000 7fbd2082a640 1 --2- 172.21.15.145:0/3735070853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d43b1810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005fd0 tx=0x7fbd10045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f464df844397789 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.812+0000 7fbd1f828640 1 -- 172.21.15.145:0/3735070853 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10058530 con 0x5642d43b1410 2024-09-10T04:50:29.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.812+0000 7fbd1f828640 1 -- 172.21.15.145:0/3735070853 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd100586d0 con 0x5642d43b1410 2024-09-10T04:50:29.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.812+0000 7fbd1f828640 1 -- 172.21.15.145:0/3735070853 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd100589d0 con 0x5642d43b1410 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3735070853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 msgr2=0x5642d43b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3735070853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d43b1810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005fd0 tx=0x7fbd10045c30 comp rx=0 tx=0).stop 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3735070853 shutdown_connections 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3735070853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d43b1810 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3735070853 >> 172.21.15.145:0/3735070853 conn(0x5642d43ad1e0 msgr2=0x5642d43af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3735070853 shutdown_connections 2024-09-10T04:50:29.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.813+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3735070853 wait complete. 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd24b3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd24b3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5642d424bdd0 con 0x5642d43b1410 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54964/0 (socket says 172.21.15.145:54964) 2024-09-10T04:50:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.827+0000 7fbd2082a640 1 -- 172.21.15.145:0/2652311373 learned_addr learned my addr 172.21.15.145:0/2652311373 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.828+0000 7fbd2082a640 1 -- 172.21.15.145:0/2652311373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d4264e10 con 0x5642d43b1410 2024-09-10T04:50:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.828+0000 7fbd2082a640 1 --2- 172.21.15.145:0/2652311373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd10046160 tx=0x7fbd10051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca318277c81f36a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.828+0000 7fbc0ee0d640 1 -- 172.21.15.145:0/2652311373 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10068070 con 0x5642d43b1410 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.828+0000 7fbc0ee0d640 1 -- 172.21.15.145:0/2652311373 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10058880 con 0x5642d43b1410 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.828+0000 7fbc0ee0d640 1 -- 172.21.15.145:0/2652311373 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10058ba0 con 0x5642d43b1410 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2652311373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 msgr2=0x5642d44a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2652311373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd10046160 tx=0x7fbd10051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2652311373 shutdown_connections 2024-09-10T04:50:29.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2652311373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44a4910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2652311373 >> 172.21.15.145:0/2652311373 conn(0x5642d43ad1e0 msgr2=0x5642d44a0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2652311373 shutdown_connections 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2652311373 wait complete. 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd24b3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5642d43b2d40 con 0x5642d43b1410 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54968/0 (socket says 172.21.15.145:54968) 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.829+0000 7fbd2082a640 1 -- 172.21.15.145:0/2626664821 learned_addr learned my addr 172.21.15.145:0/2626664821 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbd2082a640 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d44ac760 con 0x5642d43b1410 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbd2082a640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44ac200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd10066040 tx=0x7fbd10003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbc0d60a640 1 -- 172.21.15.145:0/2626664821 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10068070 con 0x5642d43b1410 2024-09-10T04:50:29.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbc0d60a640 1 -- 172.21.15.145:0/2626664821 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10072070 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d44ac9f0 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbc0d60a640 1 -- 172.21.15.145:0/2626664821 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10063760 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.830+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d44ad370 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbc0d60a640 1 -- 172.21.15.145:0/2626664821 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbd10063900 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbc0d60a640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbc0803c780 0x7fbc0803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbc0d60a640 1 -- 172.21.15.145:0/2626664821 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd100975c0 con 0x5642d43b1410 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbd20029640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbc0803c780 0x7fbc0803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d43b1d50 0x5642d44b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44adfc0 con 0x5642d43b1d50 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbd2102b640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d43b1d50 0x5642d44b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.831+0000 7fbd20029640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbc0803c780 0x7fbc0803ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd14001d70 tx=0x7fbd140012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.832+0000 7fbd2102b640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d43b1d50 0x5642d44b3850 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.832+0000 7fbd2102b640 1 -- 172.21.15.145:0/2626664821 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d43b1d50 2024-09-10T04:50:29.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.832+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44b47c0 0x5642d44b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.832+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44b7210 con 0x5642d44b47c0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.832+0000 7fbd2082a640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44b47c0 0x5642d44b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.833+0000 7fbd2082a640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44b47c0 0x5642d44b6bb0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.833+0000 7fbd2082a640 1 -- 172.21.15.145:0/2626664821 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd1006b070 con 0x5642d44b47c0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.833+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44b8ac0 con 0x5642d43b1d50 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.833+0000 7fbd2102b640 1 -- 172.21.15.145:0/2626664821 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d43b1d50 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.833+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44b7cf0 con 0x5642d44b47c0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd2082a640 1 -- 172.21.15.145:0/2626664821 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd1006b070 con 0x5642d44b47c0 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5642d44b9e70 0x5642d44bc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44bc7a0 con 0x5642d44b9e70 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd20029640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5642d44b9e70 0x5642d44bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd20029640 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5642d44b9e70 0x5642d44bc260 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.834+0000 7fbd20029640 1 -- 172.21.15.145:0/2626664821 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44b9e70 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd24b3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd24b3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5642d42a9a00 con 0x5642d44ca320 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54970/0 (socket says 172.21.15.145:54970) 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd2082a640 1 -- 172.21.15.145:0/1796224791 learned_addr learned my addr 172.21.15.145:0/1796224791 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.835+0000 7fbd2082a640 1 -- 172.21.15.145:0/1796224791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d44cad80 con 0x5642d44ca320 2024-09-10T04:50:29.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbd2082a640 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd1004e560 tx=0x7fbd10063ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbc067fc640 1 -- 172.21.15.145:0/1796224791 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1006c770 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbc067fc640 1 -- 172.21.15.145:0/1796224791 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10069040 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d44cb5b0 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbc067fc640 1 -- 172.21.15.145:0/1796224791 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1006ca40 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d44cb5b0 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.836+0000 7fbc067fc640 1 -- 172.21.15.145:0/1796224791 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbd10094210 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbc067fc640 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 0x7fbbf803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbc067fc640 1 -- 172.21.15.145:0/1796224791 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd10087070 con 0x5642d44ca320 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd20029640 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 0x7fbbf803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd20029640 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 0x7fbbf803eba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bf40 tx=0x7fbd1400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd24b3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd24b3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5642d44a50a0 con 0x5642d44d6a40 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54984/0 (socket says 172.21.15.145:54984) 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd2082a640 1 -- 172.21.15.145:0/2024970530 learned_addr learned my addr 172.21.15.145:0/2024970530 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.837+0000 7fbd2082a640 1 -- 172.21.15.145:0/2024970530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d44d7410 con 0x5642d44d6a40 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd2082a640 1 --2- 172.21.15.145:0/2024970530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd1008e750 tx=0x7fbd10083f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fed767abe4592f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbbf7fff640 1 -- 172.21.15.145:0/2024970530 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd100ae070 con 0x5642d44d6a40 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbbf7fff640 1 -- 172.21.15.145:0/2024970530 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1004f5b0 con 0x5642d44d6a40 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbbf7fff640 1 -- 172.21.15.145:0/2024970530 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd10081e60 con 0x5642d44d6a40 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2024970530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 msgr2=0x5642d44d6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2024970530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd1008e750 tx=0x7fbd10083f30 comp rx=0 tx=0).stop 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2024970530 shutdown_connections 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2024970530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44d6e20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2024970530 >> 172.21.15.145:0/2024970530 conn(0x5642d44d2e40 msgr2=0x5642d44d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2024970530 shutdown_connections 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.838+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2024970530 wait complete. 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd24b3d800 1 Processor -- start 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd24b3d800 1 -- start start 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd24b3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd24b3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5642d44d78a0 con 0x5642d44d6a40 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd2082a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44ddec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:54996/0 (socket says 172.21.15.145:54996) 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 learned_addr learned my addr 172.21.15.145:0/3053759042 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d44de420 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbd2082a640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44ddec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd1008ed00 tx=0x7fbd1008dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.839+0000 7fbbf67fc640 1 -- 172.21.15.145:0/3053759042 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd100b8070 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.840+0000 7fbbf67fc640 1 -- 172.21.15.145:0/3053759042 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1008a410 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.840+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642d44de420 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.840+0000 7fbbf67fc640 1 -- 172.21.15.145:0/3053759042 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd100ae040 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.840+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d44de420 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.840+0000 7fbbf67fc640 1 -- 172.21.15.145:0/3053759042 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbd100bb070 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbbf67fc640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbec03c780 0x7fbbec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbbf67fc640 1 -- 172.21.15.145:0/3053759042 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd100becb0 con 0x5642d44d6a40 2024-09-10T04:50:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd20029640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbec03c780 0x7fbbec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd20029640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbec03c780 0x7fbbec03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c010 tx=0x7fbd14010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d44e92b0 0x5642d44eb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44ebec0 con 0x5642d44e92b0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.841+0000 7fbd2102b640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d44e92b0 0x5642d44eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd2102b640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d44e92b0 0x5642d44eb770 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d44e92b0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 realm 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44e85e0 con 0x5642d44e92b0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d44e92b0 2024-09-10T04:50:29.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44ec950 con 0x5642d44e92b0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d44e92b0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44ed730 0x5642d44efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f01b0 con 0x5642d44ed730 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.842+0000 7fbd2082a640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44ed730 0x5642d44efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd2082a640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44ed730 0x5642d44efb20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d44e92b0 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 20 searching for the correct realm 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5642d44f2770 0x5642d44f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.843+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f5230 con 0x5642d44f2770 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd20029640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5642d44f2770 0x5642d44f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd20029640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5642d44f2770 0x5642d44f4b60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f5230 con 0x5642d44ed730 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd2082a640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fbd100bd070 0x7fbd10081600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f5230 con 0x7fbd100bd070 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.844+0000 7fbd2102b640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fbd100bd070 0x7fbd10081600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fbd100bd070 0x7fbd10081600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd180083e0 con 0x7fbd100bd070 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd180083e0 con 0x5642d44e92b0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.845+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.846+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x7fbd100bd070 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x7fbd100bd070 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.847+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.848+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.849+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x7fbd100bd070 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x7fbd100bd070 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x7fbd100bd070 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.850+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44f2770 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.851+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f0a00 con 0x5642d44ed730 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f1250 con 0x5642d44e92b0 2024-09-10T04:50:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f1640 con 0x5642d44ed730 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.852+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f1a60 con 0x7fbd100bd070 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 zone default found 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 4 Realm: () 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 zonegroup default 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f56b0 con 0x7fbd100bd070 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f71d0 con 0x5642d44f2770 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f7720 con 0x5642d44f2770 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 started sync module instance, tier type = 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.853+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x5642d44ed730 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.855+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.855+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94845029804608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x5642d44ed730 2024-09-10T04:50:29.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.855+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f81a0 con 0x5642d44e92b0 2024-09-10T04:50:29.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.856+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94845029804608] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.856+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.856+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94845029809872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x5642d44e92b0 2024-09-10T04:50:29.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.856+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f8ce0 con 0x5642d44ed730 2024-09-10T04:50:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.859+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94845029809872] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.859+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.859+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94845029812144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x5642d44ed730 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.859+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f9750 con 0x7fbd100bd070 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.860+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94845029812144] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.860+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.860+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94845029814848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x7fbd100bd070 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.860+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fa1a0 con 0x5642d44ed730 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.861+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94845029814848] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.861+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.861+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94845029817520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f6540 con 0x5642d44ed730 2024-09-10T04:50:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.861+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fabb0 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.862+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94845029817520] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.863+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.863+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94845029802128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44f64b0 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.863+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fba70 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.863+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.864+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94845029826064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fc6e0 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.864+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fd0e0 con 0x7fbd100bd070 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.864+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94845029802128] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.864+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94845029826064] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94845029827120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fcbf0 con 0x7fbd100bd070 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=0 2024-09-10T04:50:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=1 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=2 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=3 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=4 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=5 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd24b3d800 20 add_watcher() i=6 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.865+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94845029827120] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.866+0000 7fbd24b3d800 20 add_watcher() i=7 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.866+0000 7fbd24b3d800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.866+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d4500500 con 0x5642d44e92b0 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.866+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.866+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94845029822368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d44fd930 con 0x5642d44e92b0 2024-09-10T04:50:29.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94845029822368] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbbd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbd24b3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbd24b3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbd24b3d800 5 note: GC not initialized 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.867+0000 7fbbd5fe3640 20 reqs_thread_entry: start 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 Filter name: none 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbb477fe640 20 reqs_thread_entry: start 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d4533460 con 0x5642d44e92b0 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d4534050 con 0x7fbd100bd070 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.868+0000 7fbd24b3d800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-10T04:50:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.869+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d4539d10 con 0x5642d44e92b0 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd24b3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd24b3d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd24b3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94845030078320 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d4536940 con 0x5642d44ed730 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94845029817520 notify 137438953482 ret 0) ==== 891+0+0 (crc 0 0 0) 0x5642d44cad80 con 0x5642d44ed730 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbbf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94845029817520 notifier 4391 bl.length()=849 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 94845030078320 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbbf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbbf7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbbf7fff640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbe4003ea0 con 0x5642d44ed730 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94845030078320 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbd10094040 con 0x5642d44ed730 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.870+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d4539770 con 0x7fbd100bd070 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.871+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.871+0000 7fbd24b3d800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.871+0000 7fbd24b3d800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.871+0000 7fbd24b3d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.871+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94845030078320 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5642d45343f0 con 0x5642d44ed730 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94845029804608 notify 137438953483 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fbd10094040 con 0x5642d44ed730 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbbf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94845029804608 notifier 4391 bl.length()=166 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbbf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(68 notify.0 [notify cookie 94845030078320 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbbf7fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbbf7fff640 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbe4003ea0 con 0x5642d44ed730 2024-09-10T04:50:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.872+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94845030078320 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5642d44ad370 con 0x5642d44ed730 2024-09-10T04:50:29.887 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T04:50:29.870835Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:29.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.873+0000 7fbbd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.873+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94845029822368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44e92b0 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.874+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94845029822368] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.874+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94845029804608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44ed730 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.875+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94845029804608] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.875+0000 7fbd24b3d800 20 remove_watcher() i=0 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.875+0000 7fbd24b3d800 2 removed watcher, disabling cache 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.875+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94845029809872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44e92b0 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.876+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94845029809872] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x5642d44e92b0 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.876+0000 7fbd24b3d800 20 remove_watcher() i=1 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.876+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94845029812144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44ed730 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.877+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94845029812144] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.877+0000 7fbd24b3d800 20 remove_watcher() i=2 2024-09-10T04:50:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.877+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94845029814848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x7fbd100bd070 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.878+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94845029814848] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.878+0000 7fbd24b3d800 20 remove_watcher() i=3 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.878+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94845029817520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44ed730 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.879+0000 7fbd2082a640 1 -- 172.21.15.145:0/3053759042 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94845029817520] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100c4070 con 0x5642d44ed730 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.879+0000 7fbd24b3d800 20 remove_watcher() i=4 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.879+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94845029802128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44f2770 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.880+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94845029802128] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.880+0000 7fbd24b3d800 20 remove_watcher() i=5 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.880+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94845029826064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x5642d44f2770 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.881+0000 7fbd20029640 1 -- 172.21.15.145:0/3053759042 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94845029826064] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd14009050 con 0x5642d44f2770 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.881+0000 7fbd24b3d800 20 remove_watcher() i=6 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.881+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94845029827120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5642d45312c0 con 0x7fbd100bd070 2024-09-10T04:50:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94845029827120] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd18025040 con 0x7fbd100bd070 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 20 remove_watcher() i=7 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44ed730 msgr2=0x5642d44efb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44ed730 0x5642d44efb20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d44e92b0 msgr2=0x5642d44eb770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d44e92b0 0x5642d44eb770 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fbd100bd070 msgr2=0x7fbd10081600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fbd100bd070 0x7fbd10081600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5642d44f2770 msgr2=0x5642d44f4b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5642d44f2770 0x5642d44f4b60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbec03c780 msgr2=0x7fbbec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbec03c780 0x7fbbec03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c010 tx=0x7fbd14010000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 msgr2=0x5642d44ddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/3053759042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44d6a40 0x5642d44ddec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd1008ed00 tx=0x7fbd1008dee0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 reap_dead start 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd2102b640 1 -- 172.21.15.145:0/3053759042 reap_dead start 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 shutdown_connections 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 >> 172.21.15.145:0/3053759042 conn(0x5642d44d2e40 msgr2=0x5642d44d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 shutdown_connections 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.882+0000 7fbd24b3d800 1 -- 172.21.15.145:0/3053759042 wait complete. 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 msgr2=0x7fbbf803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 0x7fbbf803eba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400bf40 tx=0x7fbd1400f000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 msgr2=0x5642d44ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd1004e560 tx=0x7fbd10063ec0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 shutdown_connections 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbbf803c6e0 0x7fbbf803eba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/1796224791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d44ca320 0x5642d44ca740 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 >> 172.21.15.145:0/1796224791 conn(0x5642d44be6d0 msgr2=0x5642d44beab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 shutdown_connections 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/1796224791 wait complete. 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44b47c0 msgr2=0x5642d44b6bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5642d44b47c0 0x5642d44b6bb0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d43b1d50 msgr2=0x5642d44b3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5642d43b1d50 0x5642d44b3850 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5642d44b9e70 msgr2=0x5642d44bc260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5642d44b9e70 0x5642d44bc260 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbc0803c780 msgr2=0x7fbc0803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fbc0803c780 0x7fbc0803ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd14001d70 tx=0x7fbd140012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 msgr2=0x5642d44ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 --2- 172.21.15.145:0/2626664821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5642d43b1410 0x5642d44ac200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd10066040 tx=0x7fbd10003330 comp rx=0 tx=0).stop 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd2102b640 1 -- 172.21.15.145:0/2626664821 reap_dead start 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 shutdown_connections 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 >> 172.21.15.145:0/2626664821 conn(0x5642d43ad1e0 msgr2=0x5642d44a5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 shutdown_connections 2024-09-10T04:50:29.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.883+0000 7fbd24b3d800 1 -- 172.21.15.145:0/2626664821 wait complete. 2024-09-10T04:50:29.898 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T04:50:29.870835Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:29.898 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:50:29.899 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:50:29.943 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:29.943 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.941+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5dfa344800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5602192d0690 0x5602192d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5dfa344800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560219179e40 con 0x5602192d3020 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5dfa344800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x560219144680 con 0x5602192d0690 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5df60f4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5602192d0690 0x5602192d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5ded8f3640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5602192d3020 0x5602192d54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39078/0 (socket says 172.21.15.145:39078) 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3554175890 learned_addr learned my addr 172.21.15.145:0/3554175890 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5df60f4640 1 -- 172.21.15.145:0/3554175890 >> v1:172.21.15.98:6789/0 conn(0x5602192d3020 legacy=0x5602192d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5df58f3640 1 -- 172.21.15.145:0/3554175890 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764092269 0 0) 0x560219179e40 con 0x5602192d3020 2024-09-10T04:50:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.942+0000 7f5df60f4640 1 -- 172.21.15.145:0/3554175890 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602191606b0 con 0x5602192d0690 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.944+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3554175890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602192d2a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a470 tx=0x7f5de8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babfb83a16b3fd29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.944+0000 7f5df58f3640 1 -- 172.21.15.145:0/3554175890 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8053570 con 0x5602192d0690 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.944+0000 7f5df58f3640 1 -- 172.21.15.145:0/3554175890 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8058070 con 0x5602192d0690 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.944+0000 7f5df58f3640 1 -- 172.21.15.145:0/3554175890 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8053880 con 0x5602192d0690 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 -- 172.21.15.145:0/3554175890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 msgr2=0x5602192d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3554175890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602192d2a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a470 tx=0x7f5de8045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 -- 172.21.15.145:0/3554175890 shutdown_connections 2024-09-10T04:50:29.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3554175890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602192d2a80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 -- 172.21.15.145:0/3554175890 >> 172.21.15.145:0/3554175890 conn(0x5602192ca1f0 msgr2=0x5602192cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 -- 172.21.15.145:0/3554175890 shutdown_connections 2024-09-10T04:50:29.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.945+0000 7f5dfa344800 1 -- 172.21.15.145:0/3554175890 wait complete. 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5dfa344800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5dfa344800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560219168dd0 con 0x5602192d0690 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55012/0 (socket says 172.21.15.145:55012) 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.959+0000 7f5df60f4640 1 -- 172.21.15.145:0/2860014911 learned_addr learned my addr 172.21.15.145:0/2860014911 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.960+0000 7f5df60f4640 1 -- 172.21.15.145:0/2860014911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560219181e10 con 0x5602192d0690 2024-09-10T04:50:29.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.960+0000 7f5df60f4640 1 --2- 172.21.15.145:0/2860014911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5de8025c20 tx=0x7f5de8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9081a4b21cf0750 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.960+0000 7f5ce4608640 1 -- 172.21.15.145:0/2860014911 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8053a20 con 0x5602192d0690 2024-09-10T04:50:29.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.960+0000 7f5ce4608640 1 -- 172.21.15.145:0/2860014911 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8063070 con 0x5602192d0690 2024-09-10T04:50:29.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.960+0000 7f5ce4608640 1 -- 172.21.15.145:0/2860014911 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8053d30 con 0x5602192d0690 2024-09-10T04:50:29.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- 172.21.15.145:0/2860014911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 msgr2=0x5602193bf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 --2- 172.21.15.145:0/2860014911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5de8025c20 tx=0x7f5de8051000 comp rx=0 tx=0).stop 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- 172.21.15.145:0/2860014911 shutdown_connections 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 --2- 172.21.15.145:0/2860014911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193bf440 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- 172.21.15.145:0/2860014911 >> 172.21.15.145:0/2860014911 conn(0x5602192ca1f0 msgr2=0x5602193badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- 172.21.15.145:0/2860014911 shutdown_connections 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- 172.21.15.145:0/2860014911 wait complete. 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5dfa344800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602192d7040 con 0x5602192d0690 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55014/0 (socket says 172.21.15.145:55014) 2024-09-10T04:50:29.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.961+0000 7f5df60f4640 1 -- 172.21.15.145:0/3860195570 learned_addr learned my addr 172.21.15.145:0/3860195570 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5df60f4640 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602193c7270 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193c6d10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5de8025c20 tx=0x7f5de8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5ce2e05640 1 -- 172.21.15.145:0/3860195570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8078070 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5ce2e05640 1 -- 172.21.15.145:0/3860195570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8073470 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5ce2e05640 1 -- 172.21.15.145:0/3860195570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8073750 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602193c7500 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.962+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602193c8110 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5ce2e05640 1 -- 172.21.15.145:0/3860195570 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5de807b070 con 0x5602192d0690 2024-09-10T04:50:29.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5ce2e05640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cdc03c780 0x7f5cdc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5ce2e05640 1 -- 172.21.15.145:0/3860195570 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5de8097ba0 con 0x5602192d0690 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cdc03c780 0x7f5cdc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5602192d3020 0x5602193ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602193c8ad0 con 0x5602192d3020 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5602192d3020 0x5602193ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.963+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cdc03c780 0x7f5cdc03ec40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000c00 tx=0x7f5de00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5602192d3020 0x5602193ce360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5df68f5640 1 -- 172.21.15.145:0/3860195570 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5df000a4d0 con 0x5602192d3020 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602193cf290 0x5602193d1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602193d1cb0 con 0x5602193cf290 2024-09-10T04:50:29.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602193cf290 0x5602193d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.964+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602193cf290 0x5602193d1680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5df60f4640 1 -- 172.21.15.145:0/3860195570 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5de807a030 con 0x5602193cf290 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602193d3560 con 0x5602192d3020 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5df68f5640 1 -- 172.21.15.145:0/3860195570 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5df000a4d0 con 0x5602192d3020 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602193d2790 con 0x5602193cf290 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5df60f4640 1 -- 172.21.15.145:0/3860195570 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5de807a030 con 0x5602193cf290 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5602193d4910 0x5602193d6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602193d7240 con 0x5602193d4910 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.965+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5602193d4910 0x5602193d6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5602193d4910 0x5602193d6d00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3860195570 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5de000f670 con 0x5602193d4910 2024-09-10T04:50:29.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5dfa344800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.966+0000 7f5dfa344800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602191c6a00 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55024/0 (socket says 172.21.15.145:55024) 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5df60f4640 1 -- 172.21.15.145:0/774913818 learned_addr learned my addr 172.21.15.145:0/774913818 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5df60f4640 1 -- 172.21.15.145:0/774913818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602193e57f0 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5df60f4640 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5de8045a60 tx=0x7f5de807cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5cdbfff640 1 -- 172.21.15.145:0/774913818 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de807c8b0 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5cdbfff640 1 -- 172.21.15.145:0/774913818 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8068470 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602193e6020 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5cdbfff640 1 -- 172.21.15.145:0/774913818 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8068750 con 0x5602193e4d90 2024-09-10T04:50:29.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.967+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602193e65c0 con 0x5602193e4d90 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.968+0000 7f5cdbfff640 1 -- 172.21.15.145:0/774913818 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5de809e060 con 0x5602193e4d90 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.968+0000 7f5cdbfff640 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 0x7f5cd003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.968+0000 7f5cdbfff640 1 -- 172.21.15.145:0/774913818 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5de8092070 con 0x5602193e4d90 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.968+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 0x7f5cd003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.968+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 0x7f5cd003ec40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5602193c83f0 tx=0x7f5de0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5dfa344800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5dfa344800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602193bfc30 con 0x5602193f16d0 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55040/0 (socket says 172.21.15.145:55040) 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5df60f4640 1 -- 172.21.15.145:0/693262365 learned_addr learned my addr 172.21.15.145:0/693262365 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5df60f4640 1 -- 172.21.15.145:0/693262365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602193f20a0 con 0x5602193f16d0 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5df60f4640 1 --2- 172.21.15.145:0/693262365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5de805cfb0 tx=0x7f5de807de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37922ffddf0e9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5cd9ffb640 1 -- 172.21.15.145:0/693262365 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de80ae020 con 0x5602193f16d0 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5cd9ffb640 1 -- 172.21.15.145:0/693262365 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8073a20 con 0x5602193f16d0 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.969+0000 7f5cd9ffb640 1 -- 172.21.15.145:0/693262365 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de805c9a0 con 0x5602193f16d0 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- 172.21.15.145:0/693262365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 msgr2=0x5602193f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 --2- 172.21.15.145:0/693262365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5de805cfb0 tx=0x7f5de807de10 comp rx=0 tx=0).stop 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- 172.21.15.145:0/693262365 shutdown_connections 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 --2- 172.21.15.145:0/693262365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f1ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- 172.21.15.145:0/693262365 >> 172.21.15.145:0/693262365 conn(0x5602193edad0 msgr2=0x5602193ebd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- 172.21.15.145:0/693262365 shutdown_connections 2024-09-10T04:50:29.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- 172.21.15.145:0/693262365 wait complete. 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 Processor -- start 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- start start 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5dfa344800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5602193f2530 con 0x5602193f16d0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5df60f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55056/0 (socket says 172.21.15.145:55056) 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.970+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 learned_addr learned my addr 172.21.15.145:0/3316005935 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602193f9000 con 0x5602193f16d0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5de8068ab0 tx=0x7f5de8084f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5cc7fff640 1 -- 172.21.15.145:0/3316005935 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8077a90 con 0x5602193f16d0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5cc7fff640 1 -- 172.21.15.145:0/3316005935 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8077c30 con 0x5602193f16d0 2024-09-10T04:50:29.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602193f9000 con 0x5602193f16d0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5cc7fff640 1 -- 172.21.15.145:0/3316005935 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de8077e20 con 0x5602193f16d0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.971+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602193f9000 con 0x5602193f16d0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5cc7fff640 1 -- 172.21.15.145:0/3316005935 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5de80c3030 con 0x5602193f16d0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5cc7fff640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cc003c6e0 0x7f5cc003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5cc7fff640 1 -- 172.21.15.145:0/3316005935 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5de80c1070 con 0x5602193f16d0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cc003c6e0 0x7f5cc003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560219404070 0x560219406530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560219406c80 con 0x560219404070 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.972+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560219404070 0x560219406530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cc003c6e0 0x7f5cc003eba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ffd0 tx=0x7f5de0023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560219404070 0x560219406530 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 realm 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602194033f0 con 0x560219404070 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560219407710 con 0x560219404070 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602194084f0 0x56021940a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.973+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940af10 con 0x5602194084f0 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602194084f0 0x56021940a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602194084f0 0x56021940a8e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940b300 con 0x560219404070 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 20 searching for the correct realm 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56021940d1e0 0x56021940f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.974+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56021940fc80 con 0x56021940d1e0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56021940d1e0 0x56021940f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5ded8f3640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56021940d1e0 0x56021940f5d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56021940fc80 con 0x5602194084f0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5df60f4640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5de80d0040 0x7f5de80a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.975+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5de80d0040 0x7f5de80a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5de80d0040 0x7f5de80a37c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5df000a4d0 con 0x7f5de80d0040 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.976+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.977+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df000a4d0 con 0x560219404070 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:29.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x7f5de80d0040 2024-09-10T04:50:29.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:29.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:29.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:29.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5df0030040 con 0x7f5de80d0040 2024-09-10T04:50:29.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.978+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.979+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x7f5de80d0040 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.980+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x560219404070 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x7f5de80d0040 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x7f5de80d0040 2024-09-10T04:50:30.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5df0030040 con 0x7f5de80d0040 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.981+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x56021940d1e0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.982+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5de8095020 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940bb50 con 0x560219404070 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5df0030040 con 0x560219404070 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940bf40 con 0x5602194084f0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940bf40 con 0x7f5de80d0040 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 zone default found 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 4 Realm: () 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 zonegroup default 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.983+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940c360 con 0x7f5de80d0040 2024-09-10T04:50:30.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021940c360 con 0x56021940d1e0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560219411ad0 con 0x56021940d1e0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 started sync module instance, tier type = 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.984+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x5602194084f0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.986+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.986+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567013618880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x5602194084f0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.986+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602194125f0 con 0x560219404070 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.987+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567013618880] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.987+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.987+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567013621984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x560219404070 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.987+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219413090 con 0x5602194084f0 2024-09-10T04:50:30.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.988+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567013621984] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.988+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.988+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567013624704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.988+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219413b20 con 0x7f5de80d0040 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.989+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567013624704] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.989+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.989+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567013627376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x7f5de80d0040 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.989+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219414570 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.990+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567013627376] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.991+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.991+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567013630080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219410f70 con 0x5602194084f0 2024-09-10T04:50:30.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.991+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219414fb0 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.992+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.992+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567013630080] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.992+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567013616320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602194153a0 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.992+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219415d60 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.993+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567013616320] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.993+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.993+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567013632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219416600 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.993+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219416fc0 con 0x7f5de80d0040 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567013632768] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567013638992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560219416fc0 con 0x7f5de80d0040 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=0 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=1 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=2 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=3 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=4 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=5 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.994+0000 7f5dfa344800 20 add_watcher() i=6 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567013638992] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5dfa344800 20 add_watcher() i=7 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5dfa344800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021941c780 con 0x560219404070 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.995+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567013641440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602192ce930 con 0x560219404070 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567013641440] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5cad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 5 note: GC not initialized 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5ca77fe640 20 reqs_thread_entry: start 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 20 Filter name: none 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5ca57fa640 20 reqs_thread_entry: start 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.997+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56021944f1c0 con 0x560219404070 2024-09-10T04:50:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.998+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.998+0000 7f5dfa344800 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T04:50:30.013 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T04:50:29.870835Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.999+0000 7f5cad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:29.999+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567013641440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021941b770 con 0x560219404070 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.000+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94567013641440] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.000+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567013618880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x5602194084f0 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.001+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94567013618880] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.001+0000 7f5dfa344800 20 remove_watcher() i=0 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.001+0000 7f5dfa344800 2 removed watcher, disabling cache 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.001+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567013621984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x560219404070 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.002+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94567013621984] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x560219404070 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.002+0000 7f5dfa344800 20 remove_watcher() i=1 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.002+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567013624704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x5602194084f0 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.003+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94567013624704] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.003+0000 7f5dfa344800 20 remove_watcher() i=2 2024-09-10T04:50:30.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.003+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567013627376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x7f5de80d0040 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.004+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94567013627376] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.004+0000 7f5dfa344800 20 remove_watcher() i=3 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.004+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567013630080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x5602194084f0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.005+0000 7f5df60f4640 1 -- 172.21.15.145:0/3316005935 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94567013630080] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de807a030 con 0x5602194084f0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.005+0000 7f5dfa344800 20 remove_watcher() i=4 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.005+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567013616320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x56021940d1e0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.006+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94567013616320] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.006+0000 7f5dfa344800 20 remove_watcher() i=5 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.006+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567013632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x56021940d1e0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.007+0000 7f5ded8f3640 1 -- 172.21.15.145:0/3316005935 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94567013632768] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de0037040 con 0x56021940d1e0 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.007+0000 7f5dfa344800 20 remove_watcher() i=6 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.007+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567013638992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56021944d120 con 0x7f5de80d0040 2024-09-10T04:50:30.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94567013638992] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5df0041040 con 0x7f5de80d0040 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 20 remove_watcher() i=7 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602194084f0 msgr2=0x56021940a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602194084f0 0x56021940a8e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560219404070 msgr2=0x560219406530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x560219404070 0x560219406530 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5de80d0040 msgr2=0x7f5de80a37c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5de80d0040 0x7f5de80a37c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56021940d1e0 msgr2=0x56021940f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56021940d1e0 0x56021940f5d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cc003c6e0 msgr2=0x7f5cc003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cc003c6e0 0x7f5cc003eba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ffd0 tx=0x7f5de0023040 comp rx=0 tx=0).stop 2024-09-10T04:50:30.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 msgr2=0x5602193f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5df68f5640 1 -- 172.21.15.145:0/3316005935 reap_dead start 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5de8068ab0 tx=0x7f5de8084f40 comp rx=0 tx=0).stop 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 shutdown_connections 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3316005935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193f16d0 0x5602193f8aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 >> 172.21.15.145:0/3316005935 conn(0x5602193edad0 msgr2=0x5602193ebce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 shutdown_connections 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/3316005935 wait complete. 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 msgr2=0x7f5cd003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 0x7f5cd003ec40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5602193c83f0 tx=0x7f5de0006000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 msgr2=0x5602193e51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5de8045a60 tx=0x7f5de807cb00 comp rx=0 tx=0).stop 2024-09-10T04:50:30.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 shutdown_connections 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cd003c780 0x7f5cd003ec40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 --2- 172.21.15.145:0/774913818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602193e4d90 0x5602193e51b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.008+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 >> 172.21.15.145:0/774913818 conn(0x5602193d9140 msgr2=0x5602193d9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 shutdown_connections 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/774913818 wait complete. 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602193cf290 msgr2=0x5602193d1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5602193cf290 0x5602193d1680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5602192d3020 msgr2=0x5602193ce360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5602192d3020 0x5602193ce360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5602193d4910 msgr2=0x5602193d6d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5602193d4910 0x5602193d6d00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cdc03c780 msgr2=0x7f5cdc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5cdc03c780 0x7f5cdc03ec40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000c00 tx=0x7f5de00013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 msgr2=0x5602193c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 --2- 172.21.15.145:0/3860195570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5602192d0690 0x5602193c6d10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5de8025c20 tx=0x7f5de8002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5df68f5640 1 -- 172.21.15.145:0/3860195570 reap_dead start 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 shutdown_connections 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 >> 172.21.15.145:0/3860195570 conn(0x5602192ca1f0 msgr2=0x5602193c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 shutdown_connections 2024-09-10T04:50:30.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.009+0000 7f5dfa344800 1 -- 172.21.15.145:0/3860195570 wait complete. 2024-09-10T04:50:30.026 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T04:50:29.870835Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:30.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T04:50:30.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T04:50:30.027 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-10T04:50:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a440f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56072ce956b0 0x56072ce97aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a440f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56072cd3ee40 con 0x56072ce98040 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a440f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x56072cd09680 con 0x56072ce956b0 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a1f00640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56072ce956b0 0x56072ce97aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a1f00640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56072ce956b0 0x56072ce97aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55068/0 (socket says 172.21.15.145:55068) 2024-09-10T04:50:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a16ff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x56072ce98040 0x56072ce9a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39092/0 (socket says 172.21.15.145:39092) 2024-09-10T04:50:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.072+0000 7f15a1f00640 1 -- 172.21.15.145:0/4186867397 learned_addr learned my addr 172.21.15.145:0/4186867397 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.073+0000 7f15a1f00640 1 -- 172.21.15.145:0/4186867397 >> v1:172.21.15.98:6789/0 conn(0x56072ce98040 legacy=0x56072ce9a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.073+0000 7f15a1f00640 1 -- 172.21.15.145:0/4186867397 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072cd256b0 con 0x56072ce956b0 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.074+0000 7f15a1f00640 1 --2- 172.21.15.145:0/4186867397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072ce97aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f159400a520 tx=0x7f1594045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943626758d57a209 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.074+0000 7f15a0efe640 1 -- 172.21.15.145:0/4186867397 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1594055070 con 0x56072ce956b0 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a0efe640 1 -- 172.21.15.145:0/4186867397 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15940515b0 con 0x56072ce956b0 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a0efe640 1 -- 172.21.15.145:0/4186867397 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940518d0 con 0x56072ce956b0 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 -- 172.21.15.145:0/4186867397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 msgr2=0x56072ce97aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 --2- 172.21.15.145:0/4186867397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072ce97aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f159400a520 tx=0x7f1594045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 -- 172.21.15.145:0/4186867397 shutdown_connections 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 --2- 172.21.15.145:0/4186867397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072ce97aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 -- 172.21.15.145:0/4186867397 >> 172.21.15.145:0/4186867397 conn(0x56072ce8f1d0 msgr2=0x56072ce91630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 -- 172.21.15.145:0/4186867397 shutdown_connections 2024-09-10T04:50:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.075+0000 7f15a440f800 1 -- 172.21.15.145:0/4186867397 wait complete. 2024-09-10T04:50:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.089+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.089+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.089+0000 7f15a440f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.089+0000 7f15a440f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56072cd2ddd0 con 0x56072ce956b0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55082/0 (socket says 172.21.15.145:55082) 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f15a1f00640 1 -- 172.21.15.145:0/2118480092 learned_addr learned my addr 172.21.15.145:0/2118480092 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f15a1f00640 1 -- 172.21.15.145:0/2118480092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072cd46e10 con 0x56072ce956b0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2118480092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15940460d0 tx=0x7f1594051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5ae0cf3f4f9794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f148fe07640 1 -- 172.21.15.145:0/2118480092 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940519d0 con 0x56072ce956b0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f148fe07640 1 -- 172.21.15.145:0/2118480092 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594051b70 con 0x56072ce956b0 2024-09-10T04:50:30.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.090+0000 7f148fe07640 1 -- 172.21.15.145:0/2118480092 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1594051e50 con 0x56072ce956b0 2024-09-10T04:50:30.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- 172.21.15.145:0/2118480092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 msgr2=0x56072cf84660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 --2- 172.21.15.145:0/2118480092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15940460d0 tx=0x7f1594051000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- 172.21.15.145:0/2118480092 shutdown_connections 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 --2- 172.21.15.145:0/2118480092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf84660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- 172.21.15.145:0/2118480092 >> 172.21.15.145:0/2118480092 conn(0x56072ce8f1d0 msgr2=0x56072cf7ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- 172.21.15.145:0/2118480092 shutdown_connections 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- 172.21.15.145:0/2118480092 wait complete. 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf8be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a440f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56072ce9c040 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf8be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.091+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf8be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55090/0 (socket says 172.21.15.145:55090) 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f15a1f00640 1 -- 172.21.15.145:0/2507756442 learned_addr learned my addr 172.21.15.145:0/2507756442 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f15a1f00640 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072cf8c3b0 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf8be50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15940460d0 tx=0x7f1594002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f148e604640 1 -- 172.21.15.145:0/2507756442 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1594073020 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f148e604640 1 -- 172.21.15.145:0/2507756442 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159406f580 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072cf8c640 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f148e604640 1 -- 172.21.15.145:0/2507756442 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f159406f8a0 con 0x56072ce956b0 2024-09-10T04:50:30.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.092+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072cf8d200 con 0x56072ce956b0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f148e604640 1 -- 172.21.15.145:0/2507756442 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1594076020 con 0x56072ce956b0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f148e604640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f148803c780 0x7f148803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f148e604640 1 -- 172.21.15.145:0/2507756442 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f159406b040 con 0x56072ce956b0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f148803c780 0x7f148803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072ce98040 0x56072cf93450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cf93990 con 0x56072ce98040 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.093+0000 7f15a2701640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072ce98040 0x56072cf93450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f148803c780 0x7f148803ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1598001e80 tx=0x7f15980013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a2701640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072ce98040 0x56072cf93450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a2701640 1 -- 172.21.15.145:0/2507756442 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072ce98040 2024-09-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cf94290 0x56072cf96720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cf96e90 con 0x56072cf94290 2024-09-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cf94290 0x56072cf96720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.094+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cf94290 0x56072cf96720 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a1f00640 1 -- 172.21.15.145:0/2507756442 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1594057030 con 0x56072cf94290 2024-09-10T04:50:30.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cf98740 con 0x56072ce98040 2024-09-10T04:50:30.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a2701640 1 -- 172.21.15.145:0/2507756442 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072ce98040 2024-09-10T04:50:30.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cf97970 con 0x56072cf94290 2024-09-10T04:50:30.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a1f00640 1 -- 172.21.15.145:0/2507756442 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1594057030 con 0x56072cf94290 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56072cf99af0 0x56072cf9bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.095+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cf9c420 con 0x56072cf99af0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.096+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56072cf99af0 0x56072cf9bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.096+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56072cf99af0 0x56072cf9bee0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.096+0000 7f15a16ff640 1 -- 172.21.15.145:0/2507756442 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f159800bda0 con 0x56072cf99af0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.096+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a440f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a440f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56072cd8ba00 con 0x56072cfa9fa0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55102/0 (socket says 172.21.15.145:55102) 2024-09-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a1f00640 1 -- 172.21.15.145:0/3839758612 learned_addr learned my addr 172.21.15.145:0/3839758612 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a1f00640 1 -- 172.21.15.145:0/3839758612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072cfaaa00 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a1f00640 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f15940963e0 tx=0x7f159406fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f14877fe640 1 -- 172.21.15.145:0/3839758612 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940644e0 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f14877fe640 1 -- 172.21.15.145:0/3839758612 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594088070 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f14877fe640 1 -- 172.21.15.145:0/3839758612 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940791a0 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.097+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072cfab230 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.098+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072cfab230 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.098+0000 7f14877fe640 1 -- 172.21.15.145:0/3839758612 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1594058070 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.098+0000 7f14877fe640 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 0x7f147c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.098+0000 7f14877fe640 1 -- 172.21.15.145:0/3839758612 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1594062070 con 0x56072cfa9fa0 2024-09-10T04:50:30.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a16ff640 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 0x7f147c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a16ff640 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 0x7f147c03ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x56072cf986b0 tx=0x7f159800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a440f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a440f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56072cf84df0 con 0x56072ce94760 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55108/0 (socket says 172.21.15.145:55108) 2024-09-10T04:50:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a1f00640 1 -- 172.21.15.145:0/1846309877 learned_addr learned my addr 172.21.15.145:0/1846309877 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.099+0000 7f15a1f00640 1 -- 172.21.15.145:0/1846309877 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072ce950a0 con 0x56072ce94760 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a1f00640 1 --2- 172.21.15.145:0/1846309877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f159405a760 tx=0x7f1594006e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779d5cf89a11cc45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f14857fa640 1 -- 172.21.15.145:0/1846309877 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940af070 con 0x56072ce94760 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f14857fa640 1 -- 172.21.15.145:0/1846309877 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594083460 con 0x56072ce94760 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f14857fa640 1 -- 172.21.15.145:0/1846309877 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940a6040 con 0x56072ce94760 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 -- 172.21.15.145:0/1846309877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 msgr2=0x56072ce94b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 --2- 172.21.15.145:0/1846309877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f159405a760 tx=0x7f1594006e60 comp rx=0 tx=0).stop 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 -- 172.21.15.145:0/1846309877 shutdown_connections 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 --2- 172.21.15.145:0/1846309877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072ce94b60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 -- 172.21.15.145:0/1846309877 >> 172.21.15.145:0/1846309877 conn(0x56072cfb2aa0 msgr2=0x56072cfb0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 -- 172.21.15.145:0/1846309877 shutdown_connections 2024-09-10T04:50:30.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 -- 172.21.15.145:0/1846309877 wait complete. 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.100+0000 7f15a440f800 1 Processor -- start 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a440f800 1 -- start start 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a440f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072cfbfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a440f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56072ce934a0 con 0x56072ce94760 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072cfbfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a1f00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072cfbfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55118/0 (socket says 172.21.15.145:55118) 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 learned_addr learned my addr 172.21.15.145:0/2085736041 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072cfc0300 con 0x56072ce94760 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072cfbfda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f15940514a0 tx=0x7f1594056ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f14737fe640 1 -- 172.21.15.145:0/2085736041 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940b8020 con 0x56072ce94760 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f14737fe640 1 -- 172.21.15.145:0/2085736041 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159405ed50 con 0x56072ce94760 2024-09-10T04:50:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072cfc0300 con 0x56072ce94760 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f14737fe640 1 -- 172.21.15.145:0/2085736041 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15940af040 con 0x56072ce94760 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.101+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072cfc0900 con 0x56072ce94760 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.102+0000 7f14737fe640 1 -- 172.21.15.145:0/2085736041 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f15940bb020 con 0x56072ce94760 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.102+0000 7f14737fe640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f146c03c6e0 0x7f146c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.102+0000 7f14737fe640 1 -- 172.21.15.145:0/2085736041 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f15940bec60 con 0x56072ce94760 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.102+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f146c03c6e0 0x7f146c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f146c03c6e0 0x7f146c03eba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f159800fed0 tx=0x7f1598010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072cfcb2e0 0x56072cfcd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfcdef0 con 0x56072cfcb2e0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a2701640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072cfcb2e0 0x56072cfcd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.103+0000 7f15a2701640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072cfcb2e0 0x56072cfcd7a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 realm 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfca610 con 0x56072cfcb2e0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfce980 con 0x56072cfcb2e0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cfcf760 0x56072cfd1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd21b0 con 0x56072cfcf760 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.104+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cfcf760 0x56072cfd1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cfcf760 0x56072cfd1b50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd2a00 con 0x56072cfcb2e0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 20 searching for the correct realm 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.105+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56072cfd4770 0x56072cfd6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56072cfd4770 0x56072cfd6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a16ff640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56072cfd4770 0x56072cfd6ba0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a1f00640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f15940c8040 0x7f15940ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.106+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f15940c8040 0x7f15940ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f15940c8040 0x7f15940ae170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f159c00a4d0 con 0x7f15940c8040 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.107+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.108+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c00a4d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x7f15940c8040 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.109+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f159c030040 con 0x7f15940c8040 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.110+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.111+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcb2e0 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.112+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159c030040 con 0x7f15940c8040 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.113+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfd4770 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7270 con 0x56072cfcf760 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.114+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd33b0 con 0x56072cfcb2e0 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159c030040 con 0x56072cfcb2e0 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd3c50 con 0x56072cfcf760 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd2ff0 con 0x7f15940c8040 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 zone default found 2024-09-10T04:50:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 4 Realm: () 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 zonegroup default 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.115+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd7710 con 0x7f15940c8040 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd9570 con 0x56072cfd4770 2024-09-10T04:50:30.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd9e80 con 0x56072cfd4770 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 started sync module instance, tier type = 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.116+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd89e0 con 0x56072cfcf760 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.117+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.117+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94588819574272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfd89e0 con 0x56072cfcf760 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.117+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfda6d0 con 0x56072cfcb2e0 2024-09-10T04:50:30.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.118+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.119+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94588819579424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdaaf0 con 0x56072cfcb2e0 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.119+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdb5a0 con 0x56072cfcf760 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.119+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94588819574272] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.119+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94588819579424] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.120+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.120+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94588819572016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfda640 con 0x56072cfcf760 2024-09-10T04:50:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.120+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdbe70 con 0x7f15940c8040 2024-09-10T04:50:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.121+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94588819572016] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.121+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.121+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94588819583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfda640 con 0x7f15940c8040 2024-09-10T04:50:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.121+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdc5c0 con 0x56072cfcf760 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.122+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94588819583152] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.122+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.122+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94588819587216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdc580 con 0x56072cfcf760 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.122+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdcfd0 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.123+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.123+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94588819589920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdd820 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.123+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfde2c0 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.123+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94588819587216] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.124+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94588819589920] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.124+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.124+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94588819594672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfde6e0 con 0x56072cfd4770 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.124+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdef70 con 0x7f15940c8040 2024-09-10T04:50:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94588819597024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdeb40 con 0x7f15940c8040 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=0 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=1 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=2 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=3 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=4 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=5 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94588819594672] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.125+0000 7f15a440f800 20 add_watcher() i=6 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.126+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94588819597024] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.126+0000 7f15a440f800 20 add_watcher() i=7 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.126+0000 7f15a440f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.126+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdb970 con 0x56072cfcb2e0 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.127+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.127+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94588819600144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072cfdb970 con 0x56072cfcb2e0 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94588819600144] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f14537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a440f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a440f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a440f800 5 note: GC not initialized 2024-09-10T04:50:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f14527fc640 20 reqs_thread_entry: start 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a440f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.128+0000 7f15a440f800 20 Filter name: none 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f13c3fff640 20 reqs_thread_entry: start 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072d0154c0 con 0x56072cfcb2e0 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.129+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d01bef0 con 0x56072cfcb2e0 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a440f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a440f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a440f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94588819847472 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072d0175f0 con 0x56072cfcf760 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.130+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94588819587216 notify 137438953484 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f159409a020 con 0x56072cfcf760 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f14857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94588819587216 notifier 4405 bl.length()=758 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f14857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f14857fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94588819847472 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f14857fa640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1464003ea0 con 0x56072cfcf760 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94588819847472 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56072cfaaa00 con 0x56072cfcf760 2024-09-10T04:50:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.131+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d01b930 con 0x56072cfcb2e0 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a440f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94588819847472 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcf760 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94588819574272 notify 137438953485 ret 0) ==== 201+0+0 (crc 0 0 0) 0x56072cfaaa00 con 0x56072cfcf760 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f1484ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94588819574272 notifier 4405 bl.length()=159 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f1484ff9640 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f13cc0032c0 con 0x56072cfcf760 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(67 notify.0 [notify cookie 94588819847472 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.132+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.133+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94588819847472 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56072cf8d200 con 0x56072cfcf760 2024-09-10T04:50:30.150 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T04:50:29.870835Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.133+0000 7f14537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.133+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94588819600144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcb2e0 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.134+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94588819600144] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.134+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94588819574272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcf760 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.135+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94588819574272] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.135+0000 7f15a440f800 20 remove_watcher() i=0 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.136+0000 7f15a440f800 2 removed watcher, disabling cache 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.136+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94588819579424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcb2e0 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.136+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94588819579424] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x56072cfcb2e0 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.136+0000 7f15a440f800 20 remove_watcher() i=1 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.136+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94588819572016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcf760 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.138+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94588819572016] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.138+0000 7f15a440f800 20 remove_watcher() i=2 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.138+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94588819583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x7f15940c8040 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.139+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94588819583152] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.139+0000 7f15a440f800 20 remove_watcher() i=3 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.139+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94588819587216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfcf760 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.140+0000 7f15a1f00640 1 -- 172.21.15.145:0/2085736041 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94588819587216] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15940b2040 con 0x56072cfcf760 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.140+0000 7f15a440f800 20 remove_watcher() i=4 2024-09-10T04:50:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.140+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94588819589920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfd4770 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.141+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94588819589920] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.141+0000 7f15a440f800 20 remove_watcher() i=5 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.141+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94588819594672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x56072cfd4770 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.142+0000 7f15a16ff640 1 -- 172.21.15.145:0/2085736041 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94588819594672] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1598037040 con 0x56072cfd4770 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.142+0000 7f15a440f800 20 remove_watcher() i=6 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.142+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94588819597024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56072d017140 con 0x7f15940c8040 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.142+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94588819597024] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159c041040 con 0x7f15940c8040 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.142+0000 7f15a440f800 20 remove_watcher() i=7 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cfcf760 msgr2=0x56072cfd1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cfcf760 0x56072cfd1b50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072cfcb2e0 msgr2=0x56072cfcd7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072cfcb2e0 0x56072cfcd7a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f15940c8040 msgr2=0x7f15940ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f15940c8040 0x7f15940ae170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56072cfd4770 msgr2=0x56072cfd6ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56072cfd4770 0x56072cfd6ba0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f146c03c6e0 msgr2=0x7f146c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f146c03c6e0 0x7f146c03eba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f159800fed0 tx=0x7f1598010000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 msgr2=0x56072cfbfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/2085736041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce94760 0x56072cfbfda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f15940514a0 tx=0x7f1594056ee0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 reap_dead start 2024-09-10T04:50:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a2701640 1 -- 172.21.15.145:0/2085736041 reap_dead start 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 shutdown_connections 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 >> 172.21.15.145:0/2085736041 conn(0x56072cfb2aa0 msgr2=0x56072cfb0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 shutdown_connections 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/2085736041 wait complete. 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 msgr2=0x7f147c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 0x7f147c03ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x56072cf986b0 tx=0x7f159800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 msgr2=0x56072cfaa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f15940963e0 tx=0x7f159406fe10 comp rx=0 tx=0).stop 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 shutdown_connections 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f147c03c780 0x7f147c03ec40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 --2- 172.21.15.145:0/3839758612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072cfa9fa0 0x56072cfaa3c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 >> 172.21.15.145:0/3839758612 conn(0x56072cf9e350 msgr2=0x56072cf9e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 shutdown_connections 2024-09-10T04:50:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.143+0000 7f15a440f800 1 -- 172.21.15.145:0/3839758612 wait complete. 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cf94290 msgr2=0x56072cf96720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56072cf94290 0x56072cf96720 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072ce98040 msgr2=0x56072cf93450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56072ce98040 0x56072cf93450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56072cf99af0 msgr2=0x56072cf9bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56072cf99af0 0x56072cf9bee0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f148803c780 msgr2=0x7f148803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f148803c780 0x7f148803ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1598001e80 tx=0x7f15980013e0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 msgr2=0x56072cf8be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 --2- 172.21.15.145:0/2507756442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56072ce956b0 0x56072cf8be50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15940460d0 tx=0x7f1594002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a2701640 1 -- 172.21.15.145:0/2507756442 reap_dead start 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 shutdown_connections 2024-09-10T04:50:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 >> 172.21.15.145:0/2507756442 conn(0x56072ce8f1d0 msgr2=0x56072cf7e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 shutdown_connections 2024-09-10T04:50:30.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.144+0000 7f15a440f800 1 -- 172.21.15.145:0/2507756442 wait complete. 2024-09-10T04:50:30.161 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T04:50:29.870835Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:30.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T04:50:30.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T04:50:30.161 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-10T04:50:30.205 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.205 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe540125800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5562a4c284a0 0x5562a4c288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe540125800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562a4ad3e40 con 0x5562a4c28de0 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe540125800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5562a4a9e680 con 0x5562a4c284a0 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe53bd33640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5562a4c284a0 0x5562a4c288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe53b532640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5562a4c28de0 0x5562a4c29290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39108/0 (socket says 172.21.15.145:39108) 2024-09-10T04:50:30.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.204+0000 7fe53b532640 1 -- 172.21.15.145:0/3740088372 learned_addr learned my addr 172.21.15.145:0/3740088372 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:30.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.205+0000 7fe53bd33640 1 -- 172.21.15.145:0/3740088372 >> v1:172.21.15.98:6789/0 conn(0x5562a4c28de0 legacy=0x5562a4c29290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.205+0000 7fe53bd33640 1 -- 172.21.15.145:0/3740088372 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4aba6b0 con 0x5562a4c284a0 2024-09-10T04:50:30.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.205+0000 7fe53ad31640 1 -- 172.21.15.145:0/3740088372 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353941421 0 0) 0x5562a4ad3e40 con 0x5562a4c28de0 2024-09-10T04:50:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.206+0000 7fe53bd33640 1 --2- 172.21.15.145:0/3740088372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4c288a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00a470 tx=0x7fe52c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaef8bfa7de36908 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe53ad31640 1 -- 172.21.15.145:0/3740088372 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053570 con 0x5562a4c284a0 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe53ad31640 1 -- 172.21.15.145:0/3740088372 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c058070 con 0x5562a4c284a0 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe53ad31640 1 -- 172.21.15.145:0/3740088372 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053880 con 0x5562a4c284a0 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 -- 172.21.15.145:0/3740088372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 msgr2=0x5562a4c288a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 --2- 172.21.15.145:0/3740088372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4c288a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00a470 tx=0x7fe52c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 -- 172.21.15.145:0/3740088372 shutdown_connections 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 --2- 172.21.15.145:0/3740088372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4c288a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 -- 172.21.15.145:0/3740088372 >> 172.21.15.145:0/3740088372 conn(0x5562a4c241f0 msgr2=0x5562a4c26630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 -- 172.21.15.145:0/3740088372 shutdown_connections 2024-09-10T04:50:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.207+0000 7fe540125800 1 -- 172.21.15.145:0/3740088372 wait complete. 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe540125800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe540125800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5562a4ac2dd0 con 0x5562a4c284a0 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55132/0 (socket says 172.21.15.145:55132) 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.221+0000 7fe53bd33640 1 -- 172.21.15.145:0/158312573 learned_addr learned my addr 172.21.15.145:0/158312573 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.222+0000 7fe53bd33640 1 -- 172.21.15.145:0/158312573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4adbe10 con 0x5562a4c284a0 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.222+0000 7fe53bd33640 1 --2- 172.21.15.145:0/158312573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ce5b67b26dae91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.222+0000 7fe429e0b640 1 -- 172.21.15.145:0/158312573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053a20 con 0x5562a4c284a0 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.222+0000 7fe429e0b640 1 -- 172.21.15.145:0/158312573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c063070 con 0x5562a4c284a0 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.222+0000 7fe429e0b640 1 -- 172.21.15.145:0/158312573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053d30 con 0x5562a4c284a0 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- 172.21.15.145:0/158312573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 msgr2=0x5562a4d1b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 --2- 172.21.15.145:0/158312573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c051000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- 172.21.15.145:0/158312573 shutdown_connections 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 --2- 172.21.15.145:0/158312573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d1b670 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- 172.21.15.145:0/158312573 >> 172.21.15.145:0/158312573 conn(0x5562a4c241f0 msgr2=0x5562a4d16ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- 172.21.15.145:0/158312573 shutdown_connections 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- 172.21.15.145:0/158312573 wait complete. 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe540125800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5562a4c29d60 con 0x5562a4c284a0 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.223+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d22fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55138/0 (socket says 172.21.15.145:55138) 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe53bd33640 1 -- 172.21.15.145:0/419957158 learned_addr learned my addr 172.21.15.145:0/419957158 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe53bd33640 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4d23500 con 0x5562a4c284a0 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe53bd33640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d22fa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe423fff640 1 -- 172.21.15.145:0/419957158 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c078070 con 0x5562a4c284a0 2024-09-10T04:50:30.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe423fff640 1 -- 172.21.15.145:0/419957158 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c073470 con 0x5562a4c284a0 2024-09-10T04:50:30.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562a4d23790 con 0x5562a4c284a0 2024-09-10T04:50:30.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe423fff640 1 -- 172.21.15.145:0/419957158 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c073750 con 0x5562a4c284a0 2024-09-10T04:50:30.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.224+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562a4d24350 con 0x5562a4c284a0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe423fff640 1 -- 172.21.15.145:0/419957158 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe52c07b070 con 0x5562a4c284a0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe423fff640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe42403c780 0x7fe42403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe423fff640 1 -- 172.21.15.145:0/419957158 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe52c097ba0 con 0x5562a4c284a0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe53b532640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe42403c780 0x7fe42403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4c28de0 0x5562a4d2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.225+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d24d10 con 0x5562a4c28de0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe53c534640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4c28de0 0x5562a4d2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe53b532640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe42403c780 0x7fe42403ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe530000c00 tx=0x7fe5300013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe53c534640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4c28de0 0x5562a4d2a5a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe53c534640 1 -- 172.21.15.145:0/419957158 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4c28de0 2024-09-10T04:50:30.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d2b4d0 0x5562a4d2d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d2def0 con 0x5562a4d2b4d0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.226+0000 7fe53bd33640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d2b4d0 0x5562a4d2d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.227+0000 7fe53bd33640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d2b4d0 0x5562a4d2d8c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.227+0000 7fe53bd33640 1 -- 172.21.15.145:0/419957158 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d2b4d0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.227+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d2f7a0 con 0x5562a4c28de0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.227+0000 7fe53c534640 1 -- 172.21.15.145:0/419957158 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4c28de0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.227+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d2e9d0 con 0x5562a4d2b4d0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe53bd33640 1 -- 172.21.15.145:0/419957158 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d2b4d0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5562a4d30b50 0x5562a4d32f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d33480 con 0x5562a4d30b50 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe53b532640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5562a4d30b50 0x5562a4d32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe53b532640 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5562a4d30b50 0x5562a4d32f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.228+0000 7fe53b532640 1 -- 172.21.15.145:0/419957158 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe53000f670 con 0x5562a4d30b50 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe540125800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe540125800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5562a4b20a00 con 0x5562a4d40fd0 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55144/0 (socket says 172.21.15.145:55144) 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe53bd33640 1 -- 172.21.15.145:0/1837883708 learned_addr learned my addr 172.21.15.145:0/1837883708 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.229+0000 7fe53bd33640 1 -- 172.21.15.145:0/1837883708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4d41a30 con 0x5562a4d40fd0 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe53bd33640 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe52c045a60 tx=0x7fe52c07cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe4217fa640 1 -- 172.21.15.145:0/1837883708 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c07c8b0 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe4217fa640 1 -- 172.21.15.145:0/1837883708 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c068470 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562a4d42260 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe4217fa640 1 -- 172.21.15.145:0/1837883708 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c068750 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562a4d42800 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.230+0000 7fe4217fa640 1 -- 172.21.15.145:0/1837883708 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe52c09e060 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe4217fa640 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 0x7fe41403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe4217fa640 1 -- 172.21.15.145:0/1837883708 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe52c092070 con 0x5562a4d40fd0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe53b532640 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 0x7fe41403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe53b532640 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 0x7fe41403ec40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5562a4d24630 tx=0x7fe530006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe540125800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe540125800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5562a4d1be60 con 0x5562a4d4d910 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55158/0 (socket says 172.21.15.145:55158) 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.231+0000 7fe53bd33640 1 -- 172.21.15.145:0/1636098765 learned_addr learned my addr 172.21.15.145:0/1636098765 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe53bd33640 1 -- 172.21.15.145:0/1636098765 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4d4e2e0 con 0x5562a4d4d910 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe53bd33640 1 --2- 172.21.15.145:0/1636098765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe52c05cfb0 tx=0x7fe52c07de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe434b00eed9083c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe41affd640 1 -- 172.21.15.145:0/1636098765 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c0ae020 con 0x5562a4d4d910 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe41affd640 1 -- 172.21.15.145:0/1636098765 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c073a20 con 0x5562a4d4d910 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe41affd640 1 -- 172.21.15.145:0/1636098765 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c05c9a0 con 0x5562a4d4d910 2024-09-10T04:50:30.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 -- 172.21.15.145:0/1636098765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 msgr2=0x5562a4d4dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 --2- 172.21.15.145:0/1636098765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe52c05cfb0 tx=0x7fe52c07de10 comp rx=0 tx=0).stop 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 -- 172.21.15.145:0/1636098765 shutdown_connections 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 --2- 172.21.15.145:0/1636098765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d4dcf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 -- 172.21.15.145:0/1636098765 >> 172.21.15.145:0/1636098765 conn(0x5562a4d49d10 msgr2=0x5562a4d47f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 -- 172.21.15.145:0/1636098765 shutdown_connections 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.232+0000 7fe540125800 1 -- 172.21.15.145:0/1636098765 wait complete. 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe540125800 1 Processor -- start 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe540125800 1 -- start start 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe540125800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe540125800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5562a4d4e770 con 0x5562a4d4d910 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe53bd33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55172/0 (socket says 172.21.15.145:55172) 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 learned_addr learned my addr 172.21.15.145:0/437882624 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.233+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4d55260 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe53bd33640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe52c068ab0 tx=0x7fe52c084f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe4197fa640 1 -- 172.21.15.145:0/437882624 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c077a90 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe4197fa640 1 -- 172.21.15.145:0/437882624 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c077c30 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562a4d55260 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe4197fa640 1 -- 172.21.15.145:0/437882624 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c077e20 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.234+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562a4d55860 con 0x5562a4d4d910 2024-09-10T04:50:30.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe4197fa640 1 -- 172.21.15.145:0/437882624 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe52c0c3030 con 0x5562a4d4d910 2024-09-10T04:50:30.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe4197fa640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe40403c730 0x7fe40403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe4197fa640 1 -- 172.21.15.145:0/437882624 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe52c0c1070 con 0x5562a4d4d910 2024-09-10T04:50:30.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe53b532640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe40403c730 0x7fe40403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe53b532640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe40403c730 0x7fe40403ebf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe53000ffd0 tx=0x7fe530023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4d60270 0x5562a4d62730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.235+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d62e80 con 0x5562a4d60270 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe53c534640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4d60270 0x5562a4d62730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe53c534640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4d60270 0x5562a4d62730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 20 realm 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d5f5a0 con 0x5562a4d60270 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d63910 con 0x5562a4d60270 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.236+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d646f0 0x5562a4d66ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d67140 con 0x5562a4d646f0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe53bd33640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d646f0 0x5562a4d66ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe53bd33640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d646f0 0x5562a4d66ae0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.237+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d67680 con 0x5562a4d60270 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe540125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe540125800 20 searching for the correct realm 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5562a4d693f0 0x5562a4d6b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6be60 con 0x5562a4d693f0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe53b532640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5562a4d693f0 0x5562a4d6b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe53b532640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5562a4d693f0 0x5562a4d6b7e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.238+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6be60 con 0x5562a4d646f0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53bd33640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe52c0b3040 0x7fe52c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe52c0b3040 0x7fe52c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe52c0b3040 0x7fe52c0a3810 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe53400a4d0 con 0x7fe52c0b3040 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.239+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.240+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53400a4d0 con 0x5562a4d60270 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x7fe52c0b3040 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe534030040 con 0x7fe52c0b3040 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.241+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.242+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.243+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x7fe52c0b3040 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d60270 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x7fe52c0b3040 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.244+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x7fe52c0b3040 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe534030040 con 0x7fe52c0b3040 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d693f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.245+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe52c095020 con 0x5562a4d646f0 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d67ed0 con 0x5562a4d60270 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe534030040 con 0x5562a4d60270 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d682c0 con 0x5562a4d646f0 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.246+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d682c0 con 0x7fe52c0b3040 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 zone default found 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 4 Realm: () 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 zonegroup default 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d67ad0 con 0x7fe52c0b3040 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6dcd0 con 0x5562a4d693f0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6e070 con 0x5562a4d693f0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 started sync module instance, tier type = 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.247+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6d170 con 0x5562a4d646f0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.248+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.248+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93882160698992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6d170 con 0x5562a4d646f0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.248+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6ea80 con 0x5562a4d60270 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.249+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93882160698992] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.250+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.250+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93882160696992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6ea80 con 0x5562a4d60270 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.250+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6f4d0 con 0x5562a4d646f0 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.250+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93882160696992] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.251+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.251+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93882160705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6ea80 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.251+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6ff60 con 0x7fe52c0b3040 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.252+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.252+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93882160708144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d6ff20 con 0x7fe52c0b3040 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.252+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d70f00 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.252+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93882160705472] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.253+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93882160708144] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.253+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.253+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93882160710480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d70a50 con 0x5562a4d646f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.253+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d717d0 con 0x5562a4d693f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.254+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.254+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93882160714528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d70a50 con 0x5562a4d693f0 2024-09-10T04:50:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.254+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93882160710480] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.254+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d72530 con 0x5562a4d693f0 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.255+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.255+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93882160714528] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.255+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93882160717952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d728d0 con 0x5562a4d693f0 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.255+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d73380 con 0x7fe52c0b3040 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93882160717952] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93882160716656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d73340 con 0x7fe52c0b3040 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=0 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=1 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=2 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=3 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=4 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=5 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.256+0000 7fe540125800 20 add_watcher() i=6 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93882160716656] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe540125800 20 add_watcher() i=7 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe540125800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d76890 con 0x5562a4d60270 2024-09-10T04:50:30.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.257+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93882160722016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4d73db0 con 0x5562a4d60270 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.258+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93882160722016] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.258+0000 7fe3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.258+0000 7fe540125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.258+0000 7fe540125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.258+0000 7fe540125800 5 note: GC not initialized 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe3f0fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 20 Filter name: none 2024-09-10T04:50:30.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe36a7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da98f0 con 0x5562a4d60270 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 20 rados_obj.operate() r=0 bl.length=582 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.259+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4dafda0 con 0x5562a4d60270 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.260+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.260+0000 7fe540125800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.260+0000 7fe540125800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.260+0000 7fe540125800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93882160969632 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562a4dab710 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93882160710480 notify 137438953486 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5562a4d42260 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe41affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 93882160710480 notifier 4412 bl.length()=732 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe41affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93882160969632 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe41affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe41affd640 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe400003ea0 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.261+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93882160969632 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562a4d41a30 con 0x5562a4d646f0 2024-09-10T04:50:30.277 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T04:50:29.870835Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:30.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.262+0000 7fe3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.262+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93882160722016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d60270 2024-09-10T04:50:30.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.263+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93882160722016] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.263+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93882160698992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d646f0 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.264+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93882160698992] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.264+0000 7fe540125800 20 remove_watcher() i=0 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.264+0000 7fe540125800 2 removed watcher, disabling cache 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.264+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93882160696992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d60270 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.265+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93882160696992] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x5562a4d60270 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.265+0000 7fe540125800 20 remove_watcher() i=1 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.265+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93882160705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d646f0 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.266+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93882160705472] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.266+0000 7fe540125800 20 remove_watcher() i=2 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.266+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93882160708144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x7fe52c0b3040 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.267+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93882160708144] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.267+0000 7fe540125800 20 remove_watcher() i=3 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.267+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93882160710480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d646f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.268+0000 7fe53bd33640 1 -- 172.21.15.145:0/437882624 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93882160710480] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x5562a4d646f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.268+0000 7fe540125800 20 remove_watcher() i=4 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.268+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93882160714528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d693f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.269+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93882160714528] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.269+0000 7fe540125800 20 remove_watcher() i=5 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.269+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93882160717952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x5562a4d693f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.270+0000 7fe53b532640 1 -- 172.21.15.145:0/437882624 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93882160717952] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe530037040 con 0x5562a4d693f0 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.270+0000 7fe540125800 20 remove_watcher() i=6 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.270+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93882160716656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562a4da77b0 con 0x7fe52c0b3040 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93882160716656] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe534041040 con 0x7fe52c0b3040 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 20 remove_watcher() i=7 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d646f0 msgr2=0x5562a4d66ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d646f0 0x5562a4d66ae0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4d60270 msgr2=0x5562a4d62730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4d60270 0x5562a4d62730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe52c0b3040 msgr2=0x7fe52c0a3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe52c0b3040 0x7fe52c0a3810 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5562a4d693f0 msgr2=0x5562a4d6b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5562a4d693f0 0x5562a4d6b7e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe40403c730 msgr2=0x7fe40403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe40403c730 0x7fe40403ebf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe53000ffd0 tx=0x7fe530023040 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 msgr2=0x5562a4d54d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe53c534640 1 -- 172.21.15.145:0/437882624 reap_dead start 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe52c068ab0 tx=0x7fe52c084f40 comp rx=0 tx=0).stop 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 shutdown_connections 2024-09-10T04:50:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 --2- 172.21.15.145:0/437882624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d4d910 0x5562a4d54d00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 >> 172.21.15.145:0/437882624 conn(0x5562a4d49d10 msgr2=0x5562a4d47f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 shutdown_connections 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.271+0000 7fe540125800 1 -- 172.21.15.145:0/437882624 wait complete. 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 msgr2=0x7fe41403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 0x7fe41403ec40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5562a4d24630 tx=0x7fe530006000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 msgr2=0x5562a4d413f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe52c045a60 tx=0x7fe52c07cb00 comp rx=0 tx=0).stop 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 shutdown_connections 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe41403c780 0x7fe41403ec40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/1837883708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4d40fd0 0x5562a4d413f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 >> 172.21.15.145:0/1837883708 conn(0x5562a4d35380 msgr2=0x5562a4d35760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 shutdown_connections 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/1837883708 wait complete. 2024-09-10T04:50:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d2b4d0 msgr2=0x5562a4d2d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5562a4d2b4d0 0x5562a4d2d8c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4c28de0 msgr2=0x5562a4d2a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5562a4c28de0 0x5562a4d2a5a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5562a4d30b50 msgr2=0x5562a4d32f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5562a4d30b50 0x5562a4d32f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe42403c780 msgr2=0x7fe42403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe42403c780 0x7fe42403ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe530000c00 tx=0x7fe5300013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 msgr2=0x5562a4d22fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 --2- 172.21.15.145:0/419957158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5562a4c284a0 0x5562a4d22fa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe53c534640 1 -- 172.21.15.145:0/419957158 reap_dead start 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 shutdown_connections 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 >> 172.21.15.145:0/419957158 conn(0x5562a4c241f0 msgr2=0x5562a4d1c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 shutdown_connections 2024-09-10T04:50:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.272+0000 7fe540125800 1 -- 172.21.15.145:0/419957158 wait complete. 2024-09-10T04:50:30.288 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T04:50:29.870835Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:30.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T04:50:30.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T04:50:30.289 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-10T04:50:30.336 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.336 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b4f23800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562479c5ea80 0x562479cf2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b4f23800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562479b93e40 con 0x562479c5df70 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b4f23800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562479b5e680 con 0x562479c5ea80 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8abfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562479c5ea80 0x562479cf2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8abfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562479c5ea80 0x562479cf2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55174/0 (socket says 172.21.15.145:55174) 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8b0c13640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x562479c5df70 0x562479c5e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39114/0 (socket says 172.21.15.145:39114) 2024-09-10T04:50:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.335+0000 7fc8abfff640 1 -- 172.21.15.145:0/1770141413 learned_addr learned my addr 172.21.15.145:0/1770141413 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.336+0000 7fc8abfff640 1 -- 172.21.15.145:0/1770141413 >> v1:172.21.15.98:6789/0 conn(0x562479c5df70 legacy=0x562479c5e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.336+0000 7fc8ab7fe640 1 -- 172.21.15.145:0/1770141413 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503242198 0 0) 0x562479b93e40 con 0x562479c5df70 2024-09-10T04:50:30.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.336+0000 7fc8abfff640 1 -- 172.21.15.145:0/1770141413 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479b7a6b0 con 0x562479c5ea80 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.337+0000 7fc8abfff640 1 --2- 172.21.15.145:0/1770141413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5ea80 0x562479cf2b30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00a520 tx=0x7fc89c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de69dcc2769a2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8ab7fe640 1 -- 172.21.15.145:0/1770141413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c055070 con 0x562479c5ea80 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8ab7fe640 1 -- 172.21.15.145:0/1770141413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0515b0 con 0x562479c5ea80 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8ab7fe640 1 -- 172.21.15.145:0/1770141413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c0518d0 con 0x562479c5ea80 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 -- 172.21.15.145:0/1770141413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5ea80 msgr2=0x562479cf2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/1770141413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5ea80 0x562479cf2b30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00a520 tx=0x7fc89c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 -- 172.21.15.145:0/1770141413 shutdown_connections 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/1770141413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5ea80 0x562479cf2b30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 -- 172.21.15.145:0/1770141413 >> 172.21.15.145:0/1770141413 conn(0x562479ce53e0 msgr2=0x562479ce7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 -- 172.21.15.145:0/1770141413 shutdown_connections 2024-09-10T04:50:30.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.338+0000 7fc8b4f23800 1 -- 172.21.15.145:0/1770141413 wait complete. 2024-09-10T04:50:30.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b4f23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b4f23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562479b82dd0 con 0x562479c5df70 2024-09-10T04:50:30.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55186/0 (socket says 172.21.15.145:55186) 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.352+0000 7fc8b0c13640 1 -- 172.21.15.145:0/931622253 learned_addr learned my addr 172.21.15.145:0/931622253 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.353+0000 7fc8b0c13640 1 -- 172.21.15.145:0/931622253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479b9be10 con 0x562479c5df70 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.353+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/931622253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4001ea0 tx=0x7fc8a400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eece7028ae08e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.353+0000 7fc79ee05640 1 -- 172.21.15.145:0/931622253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4008070 con 0x562479c5df70 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.353+0000 7fc79ee05640 1 -- 172.21.15.145:0/931622253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a400d500 con 0x562479c5df70 2024-09-10T04:50:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.353+0000 7fc79ee05640 1 -- 172.21.15.145:0/931622253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a400d880 con 0x562479c5df70 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- 172.21.15.145:0/931622253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 msgr2=0x562479ddb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/931622253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4001ea0 tx=0x7fc8a400b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- 172.21.15.145:0/931622253 shutdown_connections 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/931622253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479ddb630 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- 172.21.15.145:0/931622253 >> 172.21.15.145:0/931622253 conn(0x562479ce53e0 msgr2=0x562479dd6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- 172.21.15.145:0/931622253 shutdown_connections 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- 172.21.15.145:0/931622253 wait complete. 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479de2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.354+0000 7fc8b4f23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562479cf3340 con 0x562479c5df70 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479de2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479de2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55196/0 (socket says 172.21.15.145:55196) 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3906828047 learned_addr learned my addr 172.21.15.145:0/3906828047 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479de34e0 con 0x562479c5df70 2024-09-10T04:50:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479de2f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40012f0 tx=0x7fc8a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc79d602640 1 -- 172.21.15.145:0/3906828047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a400f9d0 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc79d602640 1 -- 172.21.15.145:0/3906828047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a400fb70 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc79d602640 1 -- 172.21.15.145:0/3906828047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a400fe50 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562479de3770 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.355+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562479de4170 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.356+0000 7fc79d602640 1 -- 172.21.15.145:0/3906828047 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc8a4017040 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.356+0000 7fc79d602640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc79803c8d0 0x7fc79803ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.356+0000 7fc79d602640 1 -- 172.21.15.145:0/3906828047 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8a4015020 con 0x562479c5df70 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.356+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc79803c8d0 0x7fc79803ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479c5ea80 0x562479dea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479deab10 con 0x562479c5ea80 2024-09-10T04:50:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b1414640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479c5ea80 0x562479dea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc79803c8d0 0x7fc79803ed90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc89c057000 tx=0x7fc89c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b1414640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479c5ea80 0x562479dea5d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b1414640 1 -- 172.21.15.145:0/3906828047 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479c5ea80 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479deb3c0 0x562479ded830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479dedfa0 con 0x562479deb3c0 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.357+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479deb3c0 0x562479ded830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.358+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479deb3c0 0x562479ded830 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.358+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3906828047 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8a402d070 con 0x562479deb3c0 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.358+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479def850 con 0x562479c5ea80 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.358+0000 7fc8b1414640 1 -- 172.21.15.145:0/3906828047 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479c5ea80 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.358+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479deea80 con 0x562479deb3c0 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3906828047 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8a402d070 con 0x562479deb3c0 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562479df0c00 0x562479df2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479df3530 con 0x562479df0c00 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562479df0c00 0x562479df2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562479df0c00 0x562479df2ff0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.359+0000 7fc8abfff640 1 -- 172.21.15.145:0/3906828047 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc89c057030 con 0x562479df0c00 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b4f23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b4f23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562479be0a00 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55206/0 (socket says 172.21.15.145:55206) 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3512323121 learned_addr learned my addr 172.21.15.145:0/3512323121 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.360+0000 7fc8b0c13640 1 -- 172.21.15.145:0/3512323121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479e01b10 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c010 tx=0x7fc8a400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc796ffd640 1 -- 172.21.15.145:0/3512323121 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a404b2a0 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc796ffd640 1 -- 172.21.15.145:0/3512323121 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a401c970 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc796ffd640 1 -- 172.21.15.145:0/3512323121 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a401cb20 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562479e02340 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.361+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562479e028e0 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc796ffd640 1 -- 172.21.15.145:0/3512323121 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc8a4044990 con 0x562479e010b0 2024-09-10T04:50:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc796ffd640 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 0x7fc78803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc796ffd640 1 -- 172.21.15.145:0/3512323121 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8a403bc90 con 0x562479e010b0 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 0x7fc78803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8abfff640 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 0x7fc78803ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562479c5fe50 tx=0x7fc89c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8b4f23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8b4f23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562479ddbe80 con 0x562479e0d9b0 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.362+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55216/0 (socket says 172.21.15.145:55216) 2024-09-10T04:50:30.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b0c13640 1 -- 172.21.15.145:0/492748096 learned_addr learned my addr 172.21.15.145:0/492748096 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b0c13640 1 -- 172.21.15.145:0/492748096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479e0e3a0 con 0x562479e0d9b0 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/492748096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4054340 tx=0x7fc8a401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efaa9f879700f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc794ff9640 1 -- 172.21.15.145:0/492748096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4035040 con 0x562479e0d9b0 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc794ff9640 1 -- 172.21.15.145:0/492748096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4044c80 con 0x562479e0d9b0 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc794ff9640 1 -- 172.21.15.145:0/492748096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4026430 con 0x562479e0d9b0 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 -- 172.21.15.145:0/492748096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 msgr2=0x562479e0ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/492748096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4054340 tx=0x7fc8a401cd80 comp rx=0 tx=0).stop 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 -- 172.21.15.145:0/492748096 shutdown_connections 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/492748096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e0ddb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 -- 172.21.15.145:0/492748096 >> 172.21.15.145:0/492748096 conn(0x562479e09db0 msgr2=0x562479e07ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 -- 172.21.15.145:0/492748096 shutdown_connections 2024-09-10T04:50:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.363+0000 7fc8b4f23800 1 -- 172.21.15.145:0/492748096 wait complete. 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b4f23800 1 Processor -- start 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b4f23800 1 -- start start 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b4f23800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b4f23800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562479e0e810 con 0x562479e0d9b0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b0c13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55224/0 (socket says 172.21.15.145:55224) 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 learned_addr learned my addr 172.21.15.145:0/82938534 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.364+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562479e15320 con 0x562479e0d9b0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc8a404cfd0 tx=0x7fc8a40448c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc78e7fc640 1 -- 172.21.15.145:0/82938534 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4035050 con 0x562479e0d9b0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc78e7fc640 1 -- 172.21.15.145:0/82938534 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4044e30 con 0x562479e0d9b0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562479e15320 con 0x562479e0d9b0 2024-09-10T04:50:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc78e7fc640 1 -- 172.21.15.145:0/82938534 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4044130 con 0x562479e0d9b0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562479e15320 con 0x562479e0d9b0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.365+0000 7fc78e7fc640 1 -- 172.21.15.145:0/82938534 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc8a405c030 con 0x562479e0d9b0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc78e7fc640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc77803c780 0x7fc77803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc78e7fc640 1 -- 172.21.15.145:0/82938534 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8a4066070 con 0x562479e0d9b0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8abfff640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc77803c780 0x7fc77803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8abfff640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc77803c780 0x7fc77803ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc89c077040 tx=0x7fc89c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479e20340 0x562479e22800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e22f50 con 0x562479e20340 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.366+0000 7fc8b1414640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479e20340 0x562479e22800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b1414640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479e20340 0x562479e22800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 realm 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e1f670 con 0x562479e20340 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e239e0 con 0x562479e20340 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479e247c0 0x562479e26bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.367+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e27210 con 0x562479e247c0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479e247c0 0x562479e26bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479e247c0 0x562479e26bb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b4f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.368+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e27a60 con 0x562479e20340 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b4f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b4f23800 20 searching for the correct realm 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562479e297d0 0x562479e2bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8abfff640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562479e297d0 0x562479e2bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8abfff640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562479e297d0 0x562479e2bbe0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b0c13640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc8a404db30 0x7fc8a4028250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.369+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc8a404db30 0x7fc8a4028250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc8a404db30 0x7fc8a4028250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x7fc8a404db30 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.370+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.371+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac00a4d0 con 0x562479e20340 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x7fc8a404db30 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.372+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8ac030040 con 0x7fc8a404db30 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.373+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.374+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e20340 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.375+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac030040 con 0x7fc8a404db30 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.376+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e297d0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c2b0 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e283e0 con 0x562479e20340 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac030040 con 0x562479e20340 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.377+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e28c80 con 0x562479e247c0 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e28020 con 0x7fc8a404db30 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 zone default found 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 4 Realm: () 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 zonegroup default 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e2c750 con 0x7fc8a404db30 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.378+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e2e5b0 con 0x562479e297d0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e2ea40 con 0x562479e297d0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 20 started sync module instance, tier type = 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.379+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2da20 con 0x562479e247c0 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.380+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.380+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94714663722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2da20 con 0x562479e247c0 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.380+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2f520 con 0x562479e20340 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.381+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94714663722784] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.381+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.381+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94714663727120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2da20 con 0x562479e20340 2024-09-10T04:50:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.381+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2ffc0 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.382+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94714663727120] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.383+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.383+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94714663729840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2da20 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.383+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e30a90 con 0x7fc8a404db30 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.384+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94714663729840] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.384+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.384+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94714663732608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e2da20 con 0x7fc8a404db30 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.384+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e314a0 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.385+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94714663732608] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.385+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.385+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94714663720304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e314a0 con 0x562479e247c0 2024-09-10T04:50:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.385+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e31ea0 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.386+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94714663720304] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.386+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.386+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94714663735280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e31410 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.386+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e32d60 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.387+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94714663735280] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.387+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.387+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94714663740048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e335b0 con 0x562479e297d0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.387+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e33f70 con 0x7fc8a404db30 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94714663746240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e34390 con 0x7fc8a404db30 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=0 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=1 2024-09-10T04:50:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=2 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=3 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=4 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.388+0000 7fc8b4f23800 20 add_watcher() i=5 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.389+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94714663740048] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.389+0000 7fc8b4f23800 20 add_watcher() i=6 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94714663746240] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b4f23800 20 add_watcher() i=7 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b4f23800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e34390 con 0x562479e20340 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.390+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94714663747296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e34300 con 0x562479e20340 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.391+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94714663747296] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc7677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 5 note: GC not initialized 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc7667dc640 20 reqs_thread_entry: start 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 20 Filter name: none 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc6d7fff640 20 reqs_thread_entry: start 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.392+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e6a3f0 con 0x562479e20340 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b4f23800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b4f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b4f23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b4f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.393+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e709a0 con 0x562479e20340 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b4f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b4f23800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b4f23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94714663994336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e6c0a0 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94714663720304 notify 137438953487 ret 0) ==== 609+0+0 (crc 0 0 0) 0x562479e02340 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.394+0000 7fc794ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94714663720304 notifier 4419 bl.length()=567 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc794ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94714663994336 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc794ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc794ff9640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc77c003ea0 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94714663994336 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562479e01b10 con 0x562479e247c0 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.395+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e703e0 con 0x7fc8a404db30 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.396+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.396+0000 7fc8b4f23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.396+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94714663994336 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562479e6bbf0 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94714663722784 notify 137438953488 ret 0) ==== 201+0+0 (crc 0 0 0) 0x562479e01b10 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc794ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94714663722784 notifier 4419 bl.length()=159 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(67 notify.0 [notify cookie 94714663994336 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc794ff9640 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc77c003ea0 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.397+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94714663994336 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8a404a030 con 0x562479e247c0 2024-09-10T04:50:30.411 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.398+0000 7fc7677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.398+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94714663747296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e20340 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.399+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94714663747296] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.399+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94714663722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e247c0 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.400+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94714663722784] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.400+0000 7fc8b4f23800 20 remove_watcher() i=0 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.400+0000 7fc8b4f23800 2 removed watcher, disabling cache 2024-09-10T04:50:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.400+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94714663727120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e20340 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.401+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94714663727120] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x562479e20340 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.401+0000 7fc8b4f23800 20 remove_watcher() i=1 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.401+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94714663729840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e247c0 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.402+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94714663729840] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.402+0000 7fc8b4f23800 20 remove_watcher() i=2 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.402+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94714663732608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x7fc8a404db30 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.403+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94714663732608] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.403+0000 7fc8b4f23800 20 remove_watcher() i=3 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.403+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94714663720304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e247c0 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.404+0000 7fc8b0c13640 1 -- 172.21.15.145:0/82938534 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94714663720304] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a402d070 con 0x562479e247c0 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.404+0000 7fc8b4f23800 20 remove_watcher() i=4 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.404+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94714663735280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e297d0 2024-09-10T04:50:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.405+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94714663735280] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.405+0000 7fc8b4f23800 20 remove_watcher() i=5 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.405+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94714663740048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x562479e297d0 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.406+0000 7fc8abfff640 1 -- 172.21.15.145:0/82938534 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94714663740048] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c057030 con 0x562479e297d0 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.406+0000 7fc8b4f23800 20 remove_watcher() i=6 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.406+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94714663746240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562479e68290 con 0x7fc8a404db30 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94714663746240] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac041040 con 0x7fc8a404db30 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 20 remove_watcher() i=7 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479e247c0 msgr2=0x562479e26bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479e247c0 0x562479e26bb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479e20340 msgr2=0x562479e22800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479e20340 0x562479e22800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc8a404db30 msgr2=0x7fc8a4028250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc8a404db30 0x7fc8a4028250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562479e297d0 msgr2=0x562479e2bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562479e297d0 0x562479e2bbe0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc77803c780 msgr2=0x7fc77803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc77803c780 0x7fc77803ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc89c077040 tx=0x7fc89c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b1414640 1 -- 172.21.15.145:0/82938534 reap_dead start 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 msgr2=0x562479e14dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc8a404cfd0 tx=0x7fc8a40448c0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 shutdown_connections 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/82938534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e0d9b0 0x562479e14dc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 >> 172.21.15.145:0/82938534 conn(0x562479e09db0 msgr2=0x562479e07fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 shutdown_connections 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/82938534 wait complete. 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 msgr2=0x7fc78803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 0x7fc78803ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562479c5fe50 tx=0x7fc89c005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 msgr2=0x562479e014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.407+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c010 tx=0x7fc8a400e940 comp rx=0 tx=0).stop 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 shutdown_connections 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc78803c730 0x7fc78803ebf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3512323121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479e010b0 0x562479e014d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 >> 172.21.15.145:0/3512323121 conn(0x562479df5460 msgr2=0x562479df5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 shutdown_connections 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3512323121 wait complete. 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479deb3c0 msgr2=0x562479ded830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562479deb3c0 0x562479ded830 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479c5ea80 msgr2=0x562479dea5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562479c5ea80 0x562479dea5d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562479df0c00 msgr2=0x562479df2ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562479df0c00 0x562479df2ff0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc79803c8d0 msgr2=0x7fc79803ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc79803c8d0 0x7fc79803ed90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc89c057000 tx=0x7fc89c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 msgr2=0x562479de2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 --2- 172.21.15.145:0/3906828047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562479c5df70 0x562479de2f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40012f0 tx=0x7fc8a4000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b1414640 1 -- 172.21.15.145:0/3906828047 reap_dead start 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 shutdown_connections 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 >> 172.21.15.145:0/3906828047 conn(0x562479ce53e0 msgr2=0x562479ddc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 shutdown_connections 2024-09-10T04:50:30.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.408+0000 7fc8b4f23800 1 -- 172.21.15.145:0/3906828047 wait complete. 2024-09-10T04:50:30.422 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:30.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T04:50:30.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T04:50:30.422 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T04:50:30.467 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.467 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28b1b26800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562a3ee41610 0x562a3ee43a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28b1b26800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a3eceae40 con 0x562a3ee44030 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28b1b26800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562a3ecb5680 con 0x562a3ee41610 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28ad7d9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562a3ee41610 0x562a3ee43a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28acfd8640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x562a3ee44030 0x562a3ee464f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39120/0 (socket says 172.21.15.145:39120) 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28acfd8640 1 -- 172.21.15.145:0/3433058399 learned_addr learned my addr 172.21.15.145:0/3433058399 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28ad7d9640 1 -- 172.21.15.145:0/3433058399 >> v1:172.21.15.98:6789/0 conn(0x562a3ee44030 legacy=0x562a3ee464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.466+0000 7f28ad7d9640 1 -- 172.21.15.145:0/3433058399 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ecd16b0 con 0x562a3ee41610 2024-09-10T04:50:30.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.468+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/3433058399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ee43a00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28a000a470 tx=0x7f28a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5f2edb527e8fca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.468+0000 7f289ffff640 1 -- 172.21.15.145:0/3433058399 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0053570 con 0x562a3ee41610 2024-09-10T04:50:30.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.468+0000 7f289ffff640 1 -- 172.21.15.145:0/3433058399 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a0058070 con 0x562a3ee41610 2024-09-10T04:50:30.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.468+0000 7f289ffff640 1 -- 172.21.15.145:0/3433058399 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0053880 con 0x562a3ee41610 2024-09-10T04:50:30.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 -- 172.21.15.145:0/3433058399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 msgr2=0x562a3ee43a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 --2- 172.21.15.145:0/3433058399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ee43a00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28a000a470 tx=0x7f28a0045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 -- 172.21.15.145:0/3433058399 shutdown_connections 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 --2- 172.21.15.145:0/3433058399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ee43a00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 -- 172.21.15.145:0/3433058399 >> 172.21.15.145:0/3433058399 conn(0x562a3ee3b1f0 msgr2=0x562a3ee3d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 -- 172.21.15.145:0/3433058399 shutdown_connections 2024-09-10T04:50:30.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.469+0000 7f28b1b26800 1 -- 172.21.15.145:0/3433058399 wait complete. 2024-09-10T04:50:30.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28b1b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28b1b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a3ecd9dd0 con 0x562a3ee41610 2024-09-10T04:50:30.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55234/0 (socket says 172.21.15.145:55234) 2024-09-10T04:50:30.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28ad7d9640 1 -- 172.21.15.145:0/814114052 learned_addr learned my addr 172.21.15.145:0/814114052 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.483+0000 7f28ad7d9640 1 -- 172.21.15.145:0/814114052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ecf2e10 con 0x562a3ee41610 2024-09-10T04:50:30.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.484+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/814114052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28a0025c20 tx=0x7f28a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa21e29024bf41fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.484+0000 7f279b606640 1 -- 172.21.15.145:0/814114052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0053a20 con 0x562a3ee41610 2024-09-10T04:50:30.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.484+0000 7f279b606640 1 -- 172.21.15.145:0/814114052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a0063070 con 0x562a3ee41610 2024-09-10T04:50:30.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.484+0000 7f279b606640 1 -- 172.21.15.145:0/814114052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0053cf0 con 0x562a3ee41610 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- 172.21.15.145:0/814114052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 msgr2=0x562a3ef30600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 --2- 172.21.15.145:0/814114052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28a0025c20 tx=0x7f28a0051000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- 172.21.15.145:0/814114052 shutdown_connections 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 --2- 172.21.15.145:0/814114052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef30600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- 172.21.15.145:0/814114052 >> 172.21.15.145:0/814114052 conn(0x562a3ee3b1f0 msgr2=0x562a3ef2bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- 172.21.15.145:0/814114052 shutdown_connections 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- 172.21.15.145:0/814114052 wait complete. 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef37e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28b1b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a3ee48050 con 0x562a3ee41610 2024-09-10T04:50:30.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef37e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef37e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55244/0 (socket says 172.21.15.145:55244) 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.485+0000 7f28ad7d9640 1 -- 172.21.15.145:0/543969400 learned_addr learned my addr 172.21.15.145:0/543969400 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f28ad7d9640 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ef38380 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef37e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28a0025c20 tx=0x7f28a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f2799e03640 1 -- 172.21.15.145:0/543969400 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a006c030 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f2799e03640 1 -- 172.21.15.145:0/543969400 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a0068660 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f2799e03640 1 -- 172.21.15.145:0/543969400 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0068940 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3ef38610 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.486+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3ef39010 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f2799e03640 1 -- 172.21.15.145:0/543969400 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28a0068ae0 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f2799e03640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f279403c780 0x7f279403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f2799e03640 1 -- 172.21.15.145:0/543969400 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f28a0097fc0 con 0x562a3ee41610 2024-09-10T04:50:30.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f28acfd8640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f279403c780 0x7f279403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ee44030 0x562a3ef3f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef39bf0 con 0x562a3ee44030 2024-09-10T04:50:30.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f28adfda640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ee44030 0x562a3ef3f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.487+0000 7f28acfd8640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f279403c780 0x7f279403ec40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f28a4001d70 tx=0x7f28a40012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28adfda640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ee44030 0x562a3ef3f470 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28adfda640 1 -- 172.21.15.145:0/543969400 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ee44030 2024-09-10T04:50:30.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef40400 0x562a3ef427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef42e50 con 0x562a3ef40400 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef40400 0x562a3ef427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.488+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef40400 0x562a3ef427f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28ad7d9640 1 -- 172.21.15.145:0/543969400 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28a0051070 con 0x562a3ef40400 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef44700 con 0x562a3ee44030 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28adfda640 1 -- 172.21.15.145:0/543969400 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ee44030 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef43930 con 0x562a3ef40400 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28ad7d9640 1 -- 172.21.15.145:0/543969400 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28a0051070 con 0x562a3ef40400 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562a3ef45ab0 0x562a3ef47ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef483e0 con 0x562a3ef45ab0 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.489+0000 7f28acfd8640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562a3ef45ab0 0x562a3ef47ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.490+0000 7f28acfd8640 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562a3ef45ab0 0x562a3ef47ea0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.490+0000 7f28acfd8640 1 -- 172.21.15.145:0/543969400 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef45ab0 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.490+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.490+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28b1b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28b1b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a3ed37a00 con 0x562a3ef55f60 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55256/0 (socket says 172.21.15.145:55256) 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28ad7d9640 1 -- 172.21.15.145:0/4170387490 learned_addr learned my addr 172.21.15.145:0/4170387490 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28ad7d9640 1 -- 172.21.15.145:0/4170387490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ef569c0 con 0x562a3ef55f60 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28a0096350 tx=0x7f28a0052690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f2792ffd640 1 -- 172.21.15.145:0/4170387490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a008c070 con 0x562a3ef55f60 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f2792ffd640 1 -- 172.21.15.145:0/4170387490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a005c660 con 0x562a3ef55f60 2024-09-10T04:50:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f2792ffd640 1 -- 172.21.15.145:0/4170387490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0083040 con 0x562a3ef55f60 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3ef571f0 con 0x562a3ef55f60 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.491+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3ef57790 con 0x562a3ef55f60 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.492+0000 7f2792ffd640 1 -- 172.21.15.145:0/4170387490 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28a008f070 con 0x562a3ef55f60 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.492+0000 7f2792ffd640 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 0x7f278803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.492+0000 7f2792ffd640 1 -- 172.21.15.145:0/4170387490 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f28a009dc80 con 0x562a3ef55f60 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.492+0000 7f28acfd8640 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 0x7f278803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28acfd8640 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 0x7f278803ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28a400bf40 tx=0x7f28a400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28b1b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28b1b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a3ef30df0 con 0x562a3ef62880 2024-09-10T04:50:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55270/0 (socket says 172.21.15.145:55270) 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1835028098 learned_addr learned my addr 172.21.15.145:0/1835028098 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1835028098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ef63250 con 0x562a3ef62880 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/1835028098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28a0091010 tx=0x7f28a005e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ae23c10aa57513 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f2790ff9640 1 -- 172.21.15.145:0/1835028098 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a00aa020 con 0x562a3ef62880 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f2790ff9640 1 -- 172.21.15.145:0/1835028098 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a008f690 con 0x562a3ef62880 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.493+0000 7f2790ff9640 1 -- 172.21.15.145:0/1835028098 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a007be10 con 0x562a3ef62880 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- 172.21.15.145:0/1835028098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 msgr2=0x562a3ef62c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1835028098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28a0091010 tx=0x7f28a005e8e0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- 172.21.15.145:0/1835028098 shutdown_connections 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1835028098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef62c60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- 172.21.15.145:0/1835028098 >> 172.21.15.145:0/1835028098 conn(0x562a3ef5ec80 msgr2=0x562a3ef5cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- 172.21.15.145:0/1835028098 shutdown_connections 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- 172.21.15.145:0/1835028098 wait complete. 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 Processor -- start 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- start start 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.494+0000 7f28b1b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a3ef636e0 con 0x562a3ef62880 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28ad7d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55278/0 (socket says 172.21.15.145:55278) 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 learned_addr learned my addr 172.21.15.145:0/1964025129 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3ef6a1e0 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28a00951c0 tx=0x7f28a0056f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f277effd640 1 -- 172.21.15.145:0/1964025129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a00be070 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f277effd640 1 -- 172.21.15.145:0/1964025129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a0052c60 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f277effd640 1 -- 172.21.15.145:0/1964025129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a0095ff0 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3ef6a1e0 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.495+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3ef6a1e0 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.496+0000 7f277effd640 1 -- 172.21.15.145:0/1964025129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28a00c1070 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.496+0000 7f277effd640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f277803c730 0x7f277803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.496+0000 7f277effd640 1 -- 172.21.15.145:0/1964025129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f28a00b6070 con 0x562a3ef62880 2024-09-10T04:50:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.496+0000 7f28acfd8640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f277803c730 0x7f277803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ef75230 0x562a3ef776f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef77e40 con 0x562a3ef75230 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28adfda640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ef75230 0x562a3ef776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28acfd8640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f277803c730 0x7f277803ebf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c010 tx=0x7f28a4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28adfda640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ef75230 0x562a3ef776f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 20 realm 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.497+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef74560 con 0x562a3ef75230 2024-09-10T04:50:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef788d0 con 0x562a3ef75230 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef796b0 0x562a3ef7baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef796b0 0x562a3ef7baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.498+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef796b0 0x562a3ef7baa0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c970 con 0x562a3ef75230 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 20 searching for the correct realm 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562a3ef7e6e0 0x562a3ef80af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef811c0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28acfd8640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562a3ef7e6e0 0x562a3ef80af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.499+0000 7f28acfd8640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562a3ef7e6e0 0x562a3ef80af0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef811c0 con 0x562a3ef796b0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28ad7d9640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f28a00c3060 0x7f28a0087430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28adfda640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f28a00c3060 0x7f28a0087430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28adfda640 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f28a00c3060 0x7f28a0087430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28a800a4d0 con 0x7f28a00c3060 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.500+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.501+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a800a4d0 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x7f28a00c3060 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.502+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28a8030040 con 0x7f28a00c3060 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.503+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.504+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x7f28a00c3060 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.505+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x7f28a00c3060 2024-09-10T04:50:30.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x7f28a00c3060 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a8030040 con 0x7f28a00c3060 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.506+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7c0d0 con 0x562a3ef796b0 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7d1c0 con 0x562a3ef75230 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a8030040 con 0x562a3ef75230 2024-09-10T04:50:30.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.507+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7d5b0 con 0x562a3ef796b0 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef7d5b0 con 0x7f28a00c3060 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 zone default found 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 4 Realm: () 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 zonegroup default 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef81690 con 0x7f28a00c3060 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.508+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef83080 con 0x562a3ef7e6e0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef83420 con 0x562a3ef7e6e0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 20 started sync module instance, tier type = 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.509+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef82520 con 0x562a3ef796b0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.510+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.510+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739445066320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef82520 con 0x562a3ef796b0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.510+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef83f10 con 0x562a3ef75230 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.511+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739445066320] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.511+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.511+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739445070368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef83f10 con 0x562a3ef75230 2024-09-10T04:50:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.511+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef849e0 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.512+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.512+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739445073104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef849e0 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.512+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef859e0 con 0x7f28a00c3060 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.512+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739445070368] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.513+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739445073104] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.513+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.513+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739445075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef859a0 con 0x7f28a00c3060 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.513+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef86280 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.514+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739445075456] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.514+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.514+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739445077200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef859a0 con 0x562a3ef796b0 2024-09-10T04:50:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.514+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef868a0 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.515+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739445077200] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.515+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.515+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739445081072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef86c90 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.515+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef87690 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.516+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739445081072] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.517+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.517+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739445079504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef87f30 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.517+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef888f0 con 0x7f28a00c3060 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739445079504] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739445089344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef88d10 con 0x7f28a00c3060 2024-09-10T04:50:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=0 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=1 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=2 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=3 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=4 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=5 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.518+0000 7f28b1b26800 20 add_watcher() i=6 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739445089344] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28b1b26800 20 add_watcher() i=7 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28b1b26800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef8bfb0 con 0x562a3ef75230 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.519+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739445090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3ef892a0 con 0x562a3ef75230 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739445090768] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f2763fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f28b1b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f28b1b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f28b1b26800 5 note: GC not initialized 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.520+0000 7f2762fe5640 20 reqs_thread_entry: start 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 20 Filter name: none 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f2760fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbec10 con 0x562a3ef75230 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.521+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbf4d0 con 0x562a3ef75230 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.522+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.522+0000 7f28b1b26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.522+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3efc04e0 con 0x7f28a00c3060 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.522+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.523+0000 7f2763fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.523+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739445090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef75230 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.524+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94739445090768] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.524+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739445066320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef796b0 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.525+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94739445066320] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.525+0000 7f28b1b26800 20 remove_watcher() i=0 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.525+0000 7f28b1b26800 2 removed watcher, disabling cache 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.525+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739445070368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef75230 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.526+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94739445070368] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x562a3ef75230 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.526+0000 7f28b1b26800 20 remove_watcher() i=1 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.526+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739445073104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef796b0 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.527+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94739445073104] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.527+0000 7f28b1b26800 20 remove_watcher() i=2 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.527+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739445075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x7f28a00c3060 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.528+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94739445075456] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.528+0000 7f28b1b26800 20 remove_watcher() i=3 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.528+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739445077200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef796b0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.529+0000 7f28ad7d9640 1 -- 172.21.15.145:0/1964025129 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94739445077200] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a00c0030 con 0x562a3ef796b0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.529+0000 7f28b1b26800 20 remove_watcher() i=4 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.529+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739445081072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef7e6e0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.530+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94739445081072] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.530+0000 7f28b1b26800 20 remove_watcher() i=5 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.530+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739445079504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x562a3ef7e6e0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.531+0000 7f28acfd8640 1 -- 172.21.15.145:0/1964025129 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94739445079504] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a4009050 con 0x562a3ef7e6e0 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.531+0000 7f28b1b26800 20 remove_watcher() i=6 2024-09-10T04:50:30.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.531+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739445089344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3efbcb30 con 0x7f28a00c3060 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.531+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94739445089344] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a8041040 con 0x7f28a00c3060 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.531+0000 7f28b1b26800 20 remove_watcher() i=7 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef796b0 msgr2=0x562a3ef7baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef796b0 0x562a3ef7baa0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ef75230 msgr2=0x562a3ef776f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ef75230 0x562a3ef776f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f28a00c3060 msgr2=0x7f28a0087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f28a00c3060 0x7f28a0087430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562a3ef7e6e0 msgr2=0x562a3ef80af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562a3ef7e6e0 0x562a3ef80af0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f277803c730 msgr2=0x7f277803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f277803c730 0x7f277803ebf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c010 tx=0x7f28a4010000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 msgr2=0x562a3ef69c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28adfda640 1 -- 172.21.15.145:0/1964025129 reap_dead start 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28a00951c0 tx=0x7f28a0056f80 comp rx=0 tx=0).stop 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 shutdown_connections 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/1964025129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef62880 0x562a3ef69c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 >> 172.21.15.145:0/1964025129 conn(0x562a3ef5ec80 msgr2=0x562a3ef5ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 shutdown_connections 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/1964025129 wait complete. 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 msgr2=0x7f278803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 0x7f278803ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28a400bf40 tx=0x7f28a400f000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 msgr2=0x562a3ef56380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28a0096350 tx=0x7f28a0052690 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 shutdown_connections 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f278803c730 0x7f278803ebf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 --2- 172.21.15.145:0/4170387490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ef55f60 0x562a3ef56380 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 >> 172.21.15.145:0/4170387490 conn(0x562a3ef4a310 msgr2=0x562a3ef4a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 shutdown_connections 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.532+0000 7f28b1b26800 1 -- 172.21.15.145:0/4170387490 wait complete. 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef40400 msgr2=0x562a3ef427f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562a3ef40400 0x562a3ef427f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ee44030 msgr2=0x562a3ef3f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562a3ee44030 0x562a3ef3f470 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562a3ef45ab0 msgr2=0x562a3ef47ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562a3ef45ab0 0x562a3ef47ea0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f279403c780 msgr2=0x7f279403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f279403c780 0x7f279403ec40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f28a4001d70 tx=0x7f28a40012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 msgr2=0x562a3ef37e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 --2- 172.21.15.145:0/543969400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a3ee41610 0x562a3ef37e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28a0025c20 tx=0x7f28a0002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28adfda640 1 -- 172.21.15.145:0/543969400 reap_dead start 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 shutdown_connections 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 >> 172.21.15.145:0/543969400 conn(0x562a3ee3b1f0 msgr2=0x562a3ef2a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 shutdown_connections 2024-09-10T04:50:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.533+0000 7f28b1b26800 1 -- 172.21.15.145:0/543969400 wait complete. 2024-09-10T04:50:30.549 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-10T04:50:30.549 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T04:50:30.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T04:50:30.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T04:50:30.549 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T04:50:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.592+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.592+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.592+0000 7ff362daf800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562c00f4efc0 0x562c00f57ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.592+0000 7ff362daf800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c00df8e40 con 0x562c00f4d4a0 2024-09-10T04:50:30.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.592+0000 7ff362daf800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562c00dc3680 con 0x562c00f4efc0 2024-09-10T04:50:30.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.593+0000 7ff360098640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562c00f4efc0 0x562c00f57ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.593+0000 7ff360899640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x562c00f4d4a0 0x562c00f4d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39136/0 (socket says 172.21.15.145:39136) 2024-09-10T04:50:30.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.593+0000 7ff360899640 1 -- 172.21.15.145:0/3210298272 learned_addr learned my addr 172.21.15.145:0/3210298272 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:30.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.593+0000 7ff360098640 1 -- 172.21.15.145:0/3210298272 >> v1:172.21.15.98:6789/0 conn(0x562c00f4d4a0 legacy=0x562c00f4d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.593+0000 7ff360098640 1 -- 172.21.15.145:0/3210298272 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c00ddf6b0 con 0x562c00f4efc0 2024-09-10T04:50:30.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff360098640 1 --2- 172.21.15.145:0/3210298272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4efc0 0x562c00f57ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff35400a470 tx=0x7ff354045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa1d75783fd768b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff35f897640 1 -- 172.21.15.145:0/3210298272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff354053570 con 0x562c00f4efc0 2024-09-10T04:50:30.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff35f897640 1 -- 172.21.15.145:0/3210298272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff354058070 con 0x562c00f4efc0 2024-09-10T04:50:30.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff35f897640 1 -- 172.21.15.145:0/3210298272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff354053880 con 0x562c00f4efc0 2024-09-10T04:50:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 -- 172.21.15.145:0/3210298272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4efc0 msgr2=0x562c00f57ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 --2- 172.21.15.145:0/3210298272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4efc0 0x562c00f57ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff35400a470 tx=0x7ff354045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 -- 172.21.15.145:0/3210298272 shutdown_connections 2024-09-10T04:50:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 --2- 172.21.15.145:0/3210298272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4efc0 0x562c00f57ae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 -- 172.21.15.145:0/3210298272 >> 172.21.15.145:0/3210298272 conn(0x562c00f491f0 msgr2=0x562c00f4b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 -- 172.21.15.145:0/3210298272 shutdown_connections 2024-09-10T04:50:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.595+0000 7ff362daf800 1 -- 172.21.15.145:0/3210298272 wait complete. 2024-09-10T04:50:30.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.609+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.609+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.609+0000 7ff362daf800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.609+0000 7ff362daf800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c00de7dd0 con 0x562c00f4d4a0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55296/0 (socket says 172.21.15.145:55296) 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff360899640 1 -- 172.21.15.145:0/1766602916 learned_addr learned my addr 172.21.15.145:0/1766602916 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff360899640 1 -- 172.21.15.145:0/1766602916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c00e00e10 con 0x562c00f4d4a0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff360899640 1 --2- 172.21.15.145:0/1766602916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff350001df0 tx=0x7ff35000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e510c9cfce234194 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff24ee0d640 1 -- 172.21.15.145:0/1766602916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350012020 con 0x562c00f4d4a0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff24ee0d640 1 -- 172.21.15.145:0/1766602916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35000e470 con 0x562c00f4d4a0 2024-09-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.610+0000 7ff24ee0d640 1 -- 172.21.15.145:0/1766602916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff35000e7f0 con 0x562c00f4d4a0 2024-09-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- 172.21.15.145:0/1766602916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 msgr2=0x562c01040800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 --2- 172.21.15.145:0/1766602916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff350001df0 tx=0x7ff35000b6c0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- 172.21.15.145:0/1766602916 shutdown_connections 2024-09-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 --2- 172.21.15.145:0/1766602916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01040800 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- 172.21.15.145:0/1766602916 >> 172.21.15.145:0/1766602916 conn(0x562c00f491f0 msgr2=0x562c0103c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- 172.21.15.145:0/1766602916 shutdown_connections 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- 172.21.15.145:0/1766602916 wait complete. 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01048160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.611+0000 7ff362daf800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c00f582f0 con 0x562c00f4d4a0 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01048160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01048160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55312/0 (socket says 172.21.15.145:55312) 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff360899640 1 -- 172.21.15.145:0/2626816339 learned_addr learned my addr 172.21.15.145:0/2626816339 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff360899640 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c010486c0 con 0x562c00f4d4a0 2024-09-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff360899640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01048160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x562c01041790 tx=0x7ff350000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff24d60a640 1 -- 172.21.15.145:0/2626816339 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350012030 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff24d60a640 1 -- 172.21.15.145:0/2626816339 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35001a6d0 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff24d60a640 1 -- 172.21.15.145:0/2626816339 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff35001a9d0 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c01048950 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.612+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c01049350 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.613+0000 7ff24d60a640 1 -- 172.21.15.145:0/2626816339 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff350015020 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.613+0000 7ff24d60a640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff24803c780 0x7ff24803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff24d60a640 1 -- 172.21.15.145:0/2626816339 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff350020030 con 0x562c00f4d4a0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff360098640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff24803c780 0x7ff24803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c00f4efc0 0x562c0104f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0104fcf0 con 0x562c00f4efc0 2024-09-10T04:50:30.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff36109a640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c00f4efc0 0x562c0104f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff360098640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff24803c780 0x7ff24803ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff354057000 tx=0x7ff354052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff36109a640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c00f4efc0 0x562c0104f7b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff36109a640 1 -- 172.21.15.145:0/2626816339 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c00f4efc0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c010505f0 0x562c01052a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.614+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01053200 con 0x562c010505f0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.615+0000 7ff360899640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c010505f0 0x562c01052a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.615+0000 7ff360899640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c010505f0 0x562c01052a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.615+0000 7ff360899640 1 -- 172.21.15.145:0/2626816339 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35001ad50 con 0x562c010505f0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.615+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01054ab0 con 0x562c00f4efc0 2024-09-10T04:50:30.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff36109a640 1 -- 172.21.15.145:0/2626816339 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c00f4efc0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01053ce0 con 0x562c010505f0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff360899640 1 -- 172.21.15.145:0/2626816339 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35001ad50 con 0x562c010505f0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c01055e60 0x562c01058250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01058790 con 0x562c01055e60 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff360098640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c01055e60 0x562c01058250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.616+0000 7ff360098640 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c01055e60 0x562c01058250 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff360098640 1 -- 172.21.15.145:0/2626816339 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff354051070 con 0x562c01055e60 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff362daf800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff362daf800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c00e45a00 con 0x562c01066320 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55314/0 (socket says 172.21.15.145:55314) 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.617+0000 7ff360899640 1 -- 172.21.15.145:0/3529691512 learned_addr learned my addr 172.21.15.145:0/3529691512 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff360899640 1 -- 172.21.15.145:0/3529691512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c01066d80 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff360899640 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff350001240 tx=0x7ff35000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff2467fc640 1 -- 172.21.15.145:0/3529691512 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350022e30 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff2467fc640 1 -- 172.21.15.145:0/3529691512 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350016570 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c010675b0 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff2467fc640 1 -- 172.21.15.145:0/3529691512 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350016850 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.618+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c01067b50 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff2467fc640 1 -- 172.21.15.145:0/3529691512 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff35004aec0 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff2467fc640 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 0x7ff23803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff2467fc640 1 -- 172.21.15.145:0/3529691512 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff35003fa10 con 0x562c01066320 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff360098640 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 0x7ff23803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff360098640 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 0x7ff23803ebf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x562c0104a0c0 tx=0x7ff354005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff362daf800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.619+0000 7ff362daf800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c01041050 con 0x562c01072b80 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55330/0 (socket says 172.21.15.145:55330) 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff360899640 1 -- 172.21.15.145:0/1947806388 learned_addr learned my addr 172.21.15.145:0/1947806388 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff360899640 1 -- 172.21.15.145:0/1947806388 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c01073570 con 0x562c01072b80 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff360899640 1 --2- 172.21.15.145:0/1947806388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff350043160 tx=0x7ff35003b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e207ec006411f1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff237fff640 1 -- 172.21.15.145:0/1947806388 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350048410 con 0x562c01072b80 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff237fff640 1 -- 172.21.15.145:0/1947806388 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350053aa0 con 0x562c01072b80 2024-09-10T04:50:30.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff237fff640 1 -- 172.21.15.145:0/1947806388 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350024cb0 con 0x562c01072b80 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.620+0000 7ff362daf800 1 -- 172.21.15.145:0/1947806388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 msgr2=0x562c01072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 --2- 172.21.15.145:0/1947806388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff350043160 tx=0x7ff35003b410 comp rx=0 tx=0).stop 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- 172.21.15.145:0/1947806388 shutdown_connections 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 --2- 172.21.15.145:0/1947806388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01072f80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- 172.21.15.145:0/1947806388 >> 172.21.15.145:0/1947806388 conn(0x562c0106ef80 msgr2=0x562c0106d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- 172.21.15.145:0/1947806388 shutdown_connections 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- 172.21.15.145:0/1947806388 wait complete. 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 Processor -- start 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- start start 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01079f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff362daf800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c010739e0 con 0x562c01072b80 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01079f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff360899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01079f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55346/0 (socket says 172.21.15.145:55346) 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 learned_addr learned my addr 172.21.15.145:0/697845916 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.621+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0107a4e0 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff360899640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01079f80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff350043160 tx=0x7ff350010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff2367fc640 1 -- 172.21.15.145:0/697845916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff35006b020 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff2367fc640 1 -- 172.21.15.145:0/697845916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35004b390 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff2367fc640 1 -- 172.21.15.145:0/697845916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff350024420 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0107a4e0 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.622+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0107a4e0 con 0x562c01072b80 2024-09-10T04:50:30.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff2367fc640 1 -- 172.21.15.145:0/697845916 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff35006e020 con 0x562c01072b80 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff2367fc640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff22c03c730 0x7ff22c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff2367fc640 1 -- 172.21.15.145:0/697845916 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff350061050 con 0x562c01072b80 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff360098640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff22c03c730 0x7ff22c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c01085580 0x562c01087a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.623+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01088190 con 0x562c01085580 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff36109a640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c01085580 0x562c01087a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff360098640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff22c03c730 0x7ff22c03ebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff354045f20 tx=0x7ff354053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff36109a640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c01085580 0x562c01087a40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 20 realm 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c010848b0 con 0x562c01085580 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.624+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01088c20 con 0x562c01085580 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c01089a00 0x562c0108bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0108c420 con 0x562c01089a00 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff360899640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c01089a00 0x562c0108bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff360899640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c01089a00 0x562c0108bdf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.625+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0108ccc0 con 0x562c01085580 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff362daf800 20 searching for the correct realm 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c0108ea30 0x562c01090e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff360098640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c0108ea30 0x562c01090e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff360098640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c0108ea30 0x562c01090e60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.626+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff360899640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff350070020 0x7ff35004c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff350070020 0x7ff35004c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff350070020 0x7ff35004c630 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff35800a4d0 con 0x7ff350070020 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.627+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.628+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35800a4d0 con 0x562c01085580 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x7ff350070020 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.629+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff358030040 con 0x7ff350070020 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.630+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.631+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01085580 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.632+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff358030040 con 0x7ff350070020 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c0108ea30 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.633+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c01091530 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0108d640 con 0x562c01085580 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff358030040 con 0x562c01085580 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.634+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0108dac0 con 0x562c01089a00 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0108df60 con 0x7ff350070020 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 zone default found 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 4 Realm: () 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 zonegroup default 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01091a00 con 0x7ff350070020 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c01093550 con 0x562c0108ea30 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.635+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c010939f0 con 0x562c0108ea30 2024-09-10T04:50:30.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.636+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.636+0000 7ff362daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.636+0000 7ff362daf800 20 started sync module instance, tier type = 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.636+0000 7ff362daf800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.636+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01092890 con 0x562c01089a00 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.637+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.637+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94746995928496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01092890 con 0x562c01089a00 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.637+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010944d0 con 0x562c01085580 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.638+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.638+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94746995933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010944d0 con 0x562c01085580 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.638+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010954b0 con 0x562c01089a00 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.638+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94746995928496] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.639+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94746995933120] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.639+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.639+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94746995935424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01094fc0 con 0x562c01089a00 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.639+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01095d80 con 0x7ff350070020 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.640+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94746995935424] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.640+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.640+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94746995925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01094fc0 con 0x7ff350070020 2024-09-10T04:50:30.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.640+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01096440 con 0x562c01089a00 2024-09-10T04:50:30.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.641+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94746995925984] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.641+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.641+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94746995941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01096440 con 0x562c01089a00 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.641+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01096e50 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.642+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94746995941152] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.642+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.642+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94746995943840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01097240 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.642+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01097c40 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.643+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94746995943840] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.643+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.643+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94746995939392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01098030 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.643+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01098ab0 con 0x7ff350070020 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94746995939392] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94746995951008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c01098030 con 0x7ff350070020 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=0 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=1 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=2 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=3 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=4 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=5 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.644+0000 7ff362daf800 20 add_watcher() i=6 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.645+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94746995951008] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.645+0000 7ff362daf800 20 add_watcher() i=7 2024-09-10T04:50:30.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.645+0000 7ff362daf800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.645+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c0109bf30 con 0x562c01085580 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.646+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.646+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94746995947344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010994c0 con 0x562c01085580 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94746995947344] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff2177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff362daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff362daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff362daf800 5 note: GC not initialized 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff2167e4640 20 reqs_thread_entry: start 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff362daf800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.647+0000 7ff362daf800 20 Filter name: none 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff20f7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c010ceb10 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c010cf3a0 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c010d03b0 con 0x7ff350070020 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.648+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.649+0000 7ff2177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.649+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94746995947344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.650+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94746995947344] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.650+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94746995928496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c01089a00 2024-09-10T04:50:30.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.652+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94746995928496] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.652+0000 7ff362daf800 20 remove_watcher() i=0 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.652+0000 7ff362daf800 2 removed watcher, disabling cache 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.652+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94746995933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c01085580 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.653+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94746995933120] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x562c01085580 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.653+0000 7ff362daf800 20 remove_watcher() i=1 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.653+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94746995935424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c01089a00 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.654+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94746995935424] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.654+0000 7ff362daf800 20 remove_watcher() i=2 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.654+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94746995925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x7ff350070020 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.655+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94746995925984] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.655+0000 7ff362daf800 20 remove_watcher() i=3 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.655+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94746995941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c01089a00 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.656+0000 7ff360899640 1 -- 172.21.15.145:0/697845916 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94746995941152] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35001ad50 con 0x562c01089a00 2024-09-10T04:50:30.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.656+0000 7ff362daf800 20 remove_watcher() i=4 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.656+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94746995943840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c0108ea30 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.657+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94746995943840] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.657+0000 7ff362daf800 20 remove_watcher() i=5 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.657+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94746995939392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x562c0108ea30 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.658+0000 7ff360098640 1 -- 172.21.15.145:0/697845916 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94746995939392] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35407c040 con 0x562c0108ea30 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.658+0000 7ff362daf800 20 remove_watcher() i=6 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.658+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94746995951008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c010cca30 con 0x7ff350070020 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94746995951008] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff358041040 con 0x7ff350070020 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 20 remove_watcher() i=7 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c01089a00 msgr2=0x562c0108bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c01089a00 0x562c0108bdf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c01085580 msgr2=0x562c01087a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c01085580 0x562c01087a40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff350070020 msgr2=0x7ff35004c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff350070020 0x7ff35004c630 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c0108ea30 msgr2=0x562c01090e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c0108ea30 0x562c01090e60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff22c03c730 msgr2=0x7ff22c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff22c03c730 0x7ff22c03ebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff354045f20 tx=0x7ff354053000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 msgr2=0x562c01079f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/697845916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01072b80 0x562c01079f80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff350043160 tx=0x7ff350010f60 comp rx=0 tx=0).stop 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 reap_dead start 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff36109a640 1 -- 172.21.15.145:0/697845916 reap_dead start 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 shutdown_connections 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 >> 172.21.15.145:0/697845916 conn(0x562c0106ef80 msgr2=0x562c0106d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 shutdown_connections 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/697845916 wait complete. 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 msgr2=0x7ff23803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 0x7ff23803ebf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x562c0104a0c0 tx=0x7ff354005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 msgr2=0x562c01066740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff350001240 tx=0x7ff35000d7a0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 shutdown_connections 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff23803c730 0x7ff23803ebf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 --2- 172.21.15.145:0/3529691512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c01066320 0x562c01066740 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.659+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 >> 172.21.15.145:0/3529691512 conn(0x562c0105a6d0 msgr2=0x562c0105aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 shutdown_connections 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/3529691512 wait complete. 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c010505f0 msgr2=0x562c01052a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c010505f0 0x562c01052a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c00f4efc0 msgr2=0x562c0104f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c00f4efc0 0x562c0104f7b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c01055e60 msgr2=0x562c01058250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c01055e60 0x562c01058250 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff24803c780 msgr2=0x7ff24803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff24803c780 0x7ff24803ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff354057000 tx=0x7ff354052000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 msgr2=0x562c01048160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 --2- 172.21.15.145:0/2626816339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c00f4d4a0 0x562c01048160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x562c01041790 tx=0x7ff350000bc0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff36109a640 1 -- 172.21.15.145:0/2626816339 reap_dead start 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 shutdown_connections 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 >> 172.21.15.145:0/2626816339 conn(0x562c00f491f0 msgr2=0x562c01041ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 shutdown_connections 2024-09-10T04:50:30.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.660+0000 7ff362daf800 1 -- 172.21.15.145:0/2626816339 wait complete. 2024-09-10T04:50:30.675 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-10T04:50:30.675 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T04:50:30.692 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:30.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T04:50:30.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T04:50:30.693 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T04:50:30.737 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.737 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6720e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b2e1458a80 0x55b2e14ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6720e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2e138de40 con 0x55b2e1457f70 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6720e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55b2e1358680 con 0x55b2e1458a80 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6216a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b2e1458a80 0x55b2e14ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6296b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55b2e1457f70 0x55b2e1458370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39142/0 (socket says 172.21.15.145:39142) 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6296b640 1 -- 172.21.15.145:0/1586167501 learned_addr learned my addr 172.21.15.145:0/1586167501 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6216a640 1 -- 172.21.15.145:0/1586167501 >> v1:172.21.15.98:6789/0 conn(0x55b2e1457f70 legacy=0x55b2e1458370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.736+0000 7fec6216a640 1 -- 172.21.15.145:0/1586167501 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e13746b0 con 0x55b2e1458a80 2024-09-10T04:50:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.738+0000 7fec6216a640 1 --2- 172.21.15.145:0/1586167501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1458a80 0x55b2e14ecaf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00a470 tx=0x7fec4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461db9b37a9fd6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.738+0000 7fec61969640 1 -- 172.21.15.145:0/1586167501 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c053570 con 0x55b2e1458a80 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.738+0000 7fec61969640 1 -- 172.21.15.145:0/1586167501 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c058070 con 0x55b2e1458a80 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.738+0000 7fec61969640 1 -- 172.21.15.145:0/1586167501 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c053880 con 0x55b2e1458a80 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 -- 172.21.15.145:0/1586167501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1458a80 msgr2=0x55b2e14ecaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 --2- 172.21.15.145:0/1586167501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1458a80 0x55b2e14ecaf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00a470 tx=0x7fec4c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 -- 172.21.15.145:0/1586167501 shutdown_connections 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 --2- 172.21.15.145:0/1586167501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1458a80 0x55b2e14ecaf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 -- 172.21.15.145:0/1586167501 >> 172.21.15.145:0/1586167501 conn(0x55b2e14df3c0 msgr2=0x55b2e14e1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 -- 172.21.15.145:0/1586167501 shutdown_connections 2024-09-10T04:50:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.739+0000 7fec6720e800 1 -- 172.21.15.145:0/1586167501 wait complete. 2024-09-10T04:50:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6720e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6720e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b2e137cdd0 con 0x55b2e1457f70 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55360/0 (socket says 172.21.15.145:55360) 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.753+0000 7fec6296b640 1 -- 172.21.15.145:0/723137518 learned_addr learned my addr 172.21.15.145:0/723137518 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.754+0000 7fec6296b640 1 -- 172.21.15.145:0/723137518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e1395e10 con 0x55b2e1457f70 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.754+0000 7fec6296b640 1 --2- 172.21.15.145:0/723137518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec54001e40 tx=0x7fec54001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88951149c31b7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.754+0000 7feb50e09640 1 -- 172.21.15.145:0/723137518 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54012020 con 0x55b2e1457f70 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.754+0000 7feb50e09640 1 -- 172.21.15.145:0/723137518 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5400e5a0 con 0x55b2e1457f70 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.754+0000 7feb50e09640 1 -- 172.21.15.145:0/723137518 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5400e8a0 con 0x55b2e1457f70 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- 172.21.15.145:0/723137518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 msgr2=0x55b2e15d57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 --2- 172.21.15.145:0/723137518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec54001e40 tx=0x7fec54001e70 comp rx=0 tx=0).stop 2024-09-10T04:50:30.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- 172.21.15.145:0/723137518 shutdown_connections 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 --2- 172.21.15.145:0/723137518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15d57e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- 172.21.15.145:0/723137518 >> 172.21.15.145:0/723137518 conn(0x55b2e14df3c0 msgr2=0x55b2e15d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- 172.21.15.145:0/723137518 shutdown_connections 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- 172.21.15.145:0/723137518 wait complete. 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15dd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.755+0000 7fec6720e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b2e14ed300 con 0x55b2e1457f70 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15dd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55362/0 (socket says 172.21.15.145:55362) 2024-09-10T04:50:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6296b640 1 -- 172.21.15.145:0/4274500468 learned_addr learned my addr 172.21.15.145:0/4274500468 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6296b640 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e15dd690 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6296b640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15dd130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec540012b0 tx=0x7fec54000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7feb4f606640 1 -- 172.21.15.145:0/4274500468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54012030 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e15dd920 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7feb4f606640 1 -- 172.21.15.145:0/4274500468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5401a750 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e15de320 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.756+0000 7feb4f606640 1 -- 172.21.15.145:0/4274500468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5401aa70 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.757+0000 7feb4f606640 1 -- 172.21.15.145:0/4274500468 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec54015020 con 0x55b2e1457f70 2024-09-10T04:50:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.757+0000 7feb4f606640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb4803c730 0x7feb4803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7feb4f606640 1 -- 172.21.15.145:0/4274500468 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fec54020030 con 0x55b2e1457f70 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6216a640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb4803c730 0x7feb4803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e1458a80 0x55b2e15e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15e4cc0 con 0x55b2e1458a80 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6316c640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e1458a80 0x55b2e15e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6216a640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb4803c730 0x7feb4803ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec4c057000 tx=0x7fec4c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6316c640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e1458a80 0x55b2e15e4780 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6316c640 1 -- 172.21.15.145:0/4274500468 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e1458a80 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e15e5570 0x55b2e15e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.758+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15e8170 con 0x55b2e15e5570 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.759+0000 7fec6296b640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e15e5570 0x55b2e15e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.759+0000 7fec6296b640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e15e5570 0x55b2e15e7a00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.759+0000 7fec6296b640 1 -- 172.21.15.145:0/4274500468 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec54018950 con 0x55b2e15e5570 2024-09-10T04:50:30.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.759+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15e9a20 con 0x55b2e1458a80 2024-09-10T04:50:30.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6316c640 1 -- 172.21.15.145:0/4274500468 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e1458a80 2024-09-10T04:50:30.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15e8c50 con 0x55b2e15e5570 2024-09-10T04:50:30.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6296b640 1 -- 172.21.15.145:0/4274500468 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec54018950 con 0x55b2e15e5570 2024-09-10T04:50:30.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b2e15eadd0 0x55b2e15ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15ed700 con 0x55b2e15eadd0 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.760+0000 7fec6216a640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b2e15eadd0 0x55b2e15ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6216a640 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b2e15eadd0 0x55b2e15ed1c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6216a640 1 -- 172.21.15.145:0/4274500468 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec4c051070 con 0x55b2e15eadd0 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6720e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.761+0000 7fec6720e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b2e13daa00 con 0x55b2e15fb290 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55378/0 (socket says 172.21.15.145:55378) 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6296b640 1 -- 172.21.15.145:0/3568851292 learned_addr learned my addr 172.21.15.145:0/3568851292 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6296b640 1 -- 172.21.15.145:0/3568851292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e15fbcf0 con 0x55b2e15fb290 2024-09-10T04:50:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6296b640 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec5401a6a0 tx=0x7fec54016870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7feb4ce01640 1 -- 172.21.15.145:0/3568851292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5400d7a0 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7feb4ce01640 1 -- 172.21.15.145:0/3568851292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5404af20 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e15fc520 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7feb4ce01640 1 -- 172.21.15.145:0/3568851292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5404b200 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.762+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e15fc520 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.763+0000 7feb4ce01640 1 -- 172.21.15.145:0/3568851292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec5402c7d0 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.763+0000 7feb4ce01640 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 0x7feb3c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.763+0000 7feb4ce01640 1 -- 172.21.15.145:0/3568851292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fec54037c90 con 0x55b2e15fb290 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.763+0000 7fec6216a640 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 0x7feb3c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.763+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6216a640 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 0x7feb3c03eba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b2e15df020 tx=0x7fec4c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6720e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6720e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b2e15d6030 con 0x55b2e16079f0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55394/0 (socket says 172.21.15.145:55394) 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6296b640 1 -- 172.21.15.145:0/3821116664 learned_addr learned my addr 172.21.15.145:0/3821116664 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6296b640 1 -- 172.21.15.145:0/3821116664 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e16083e0 con 0x55b2e16079f0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7fec6296b640 1 --2- 172.21.15.145:0/3821116664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fec5401dfd0 tx=0x7fec54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5194f3d8ce9c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.764+0000 7feb467fc640 1 -- 172.21.15.145:0/3821116664 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5405a040 con 0x55b2e16079f0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7feb467fc640 1 -- 172.21.15.145:0/3821116664 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54053470 con 0x55b2e16079f0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7feb467fc640 1 -- 172.21.15.145:0/3821116664 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5402dae0 con 0x55b2e16079f0 2024-09-10T04:50:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- 172.21.15.145:0/3821116664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 msgr2=0x55b2e1607df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 --2- 172.21.15.145:0/3821116664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fec5401dfd0 tx=0x7fec54007d30 comp rx=0 tx=0).stop 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- 172.21.15.145:0/3821116664 shutdown_connections 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 --2- 172.21.15.145:0/3821116664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e1607df0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- 172.21.15.145:0/3821116664 >> 172.21.15.145:0/3821116664 conn(0x55b2e1603df0 msgr2=0x55b2e1602030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- 172.21.15.145:0/3821116664 shutdown_connections 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- 172.21.15.145:0/3821116664 wait complete. 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 Processor -- start 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.765+0000 7fec6720e800 1 -- start start 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6720e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6720e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b2e1608850 con 0x55b2e16079f0 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6296b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55400/0 (socket says 172.21.15.145:55400) 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 learned_addr learned my addr 172.21.15.145:0/2054809781 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e160f370 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6296b640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec54051900 tx=0x7fec54044f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7feb44ff9640 1 -- 172.21.15.145:0/2054809781 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5402d3f0 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7feb44ff9640 1 -- 172.21.15.145:0/2054809781 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5406e030 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e160f370 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7feb44ff9640 1 -- 172.21.15.145:0/2054809781 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5402dcc0 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.766+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e160f370 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.767+0000 7feb44ff9640 1 -- 172.21.15.145:0/2054809781 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec54051be0 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.767+0000 7feb44ff9640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb2c03c730 0x7feb2c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.767+0000 7feb44ff9640 1 -- 172.21.15.145:0/2054809781 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fec54074c80 con 0x55b2e16079f0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6216a640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb2c03c730 0x7feb2c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e161a310 0x55b2e161c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e161cf20 con 0x55b2e161a310 2024-09-10T04:50:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6316c640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e161a310 0x55b2e161c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6216a640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb2c03c730 0x7feb2c03ebf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec4c053fd0 tx=0x7fec4c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6316c640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e161a310 0x55b2e161c7d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 20 realm 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.768+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1619640 con 0x55b2e161a310 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e161d9b0 con 0x55b2e161a310 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e161e790 0x55b2e1620b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16211b0 con 0x55b2e161e790 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6296b640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e161e790 0x55b2e1620b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.769+0000 7fec6296b640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e161e790 0x55b2e1620b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1621a50 con 0x55b2e161a310 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 20 searching for the correct realm 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b2e16237c0 0x55b2e1625bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6216a640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b2e16237c0 0x55b2e1625bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.770+0000 7fec6216a640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b2e16237c0 0x55b2e1625bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6296b640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fec54069050 0x7fec5403c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6316c640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fec54069050 0x7fec5403c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6316c640 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fec54069050 0x7fec5403c6f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec5c00a4d0 con 0x7fec54069050 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.771+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.772+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c00a4d0 con 0x55b2e161a310 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x7fec54069050 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.773+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec5c030040 con 0x7fec54069050 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.774+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.775+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x7fec54069050 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.776+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x7fec54069050 2024-09-10T04:50:30.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x7fec54069050 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5c030040 con 0x7fec54069050 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.777+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e16237c0 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.778+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16262a0 con 0x55b2e161e790 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1622400 con 0x55b2e161a310 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5c030040 con 0x55b2e161a310 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1622880 con 0x55b2e161e790 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1622d20 con 0x7fec54069050 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 zone default found 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 4 Realm: () 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 zonegroup default 2024-09-10T04:50:30.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.779+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1626770 con 0x7fec54069050 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16282f0 con 0x55b2e16237c0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1628810 con 0x55b2e16237c0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 started sync module instance, tier type = 2024-09-10T04:50:30.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.780+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1627600 con 0x55b2e161e790 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.781+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.782+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94226773867264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1627600 con 0x55b2e161e790 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.782+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629290 con 0x55b2e161a310 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.783+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94226773867264] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.783+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.783+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94226773864784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629290 con 0x55b2e161a310 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.783+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629d40 con 0x55b2e161e790 2024-09-10T04:50:30.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.783+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94226773864784] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.784+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.784+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94226773874720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629290 con 0x55b2e161e790 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.784+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162a7f0 con 0x7fec54069050 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.785+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94226773874720] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.785+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.785+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94226773877456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629290 con 0x7fec54069050 2024-09-10T04:50:30.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.785+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162b240 con 0x55b2e161e790 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.787+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94226773877456] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.787+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.787+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94226773880144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629290 con 0x55b2e161e790 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.787+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162bc50 con 0x55b2e16237c0 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.788+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94226773880144] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.788+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.788+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94226773872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1629200 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.788+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162cb10 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.789+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94226773872096] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.789+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.789+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94226773886560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162ca80 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.789+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162d9d0 con 0x7fec54069050 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94226773890336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162d940 con 0x7fec54069050 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=1 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=2 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=3 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94226773886560] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=4 2024-09-10T04:50:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=5 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.790+0000 7fec6720e800 20 add_watcher() i=6 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94226773890336] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6720e800 20 add_watcher() i=7 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6720e800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162cf00 con 0x55b2e161a310 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.791+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94226773892368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e162cf00 con 0x55b2e161a310 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94226773892368] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7feb197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7fec6720e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7fec6720e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7fec6720e800 5 note: GC not initialized 2024-09-10T04:50:30.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.792+0000 7fea93fff640 20 reqs_thread_entry: start 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 Filter name: none 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fea91ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1663ac0 con 0x55b2e161a310 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1664350 con 0x55b2e161a310 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.793+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1665360 con 0x7fec54069050 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.794+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.795+0000 7feb197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.795+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94226773892368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e161a310 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.796+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94226773892368] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.796+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94226773867264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e161e790 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.797+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94226773867264] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.797+0000 7fec6720e800 20 remove_watcher() i=0 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.797+0000 7fec6720e800 2 removed watcher, disabling cache 2024-09-10T04:50:30.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.797+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94226773864784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e161a310 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.798+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94226773864784] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x55b2e161a310 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.798+0000 7fec6720e800 20 remove_watcher() i=1 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.798+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94226773874720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e161e790 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.799+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94226773874720] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.799+0000 7fec6720e800 20 remove_watcher() i=2 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.799+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94226773877456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x7fec54069050 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.800+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94226773877456] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.800+0000 7fec6720e800 20 remove_watcher() i=3 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.800+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94226773880144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e161e790 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.801+0000 7fec6296b640 1 -- 172.21.15.145:0/2054809781 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94226773880144] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5407a070 con 0x55b2e161e790 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.801+0000 7fec6720e800 20 remove_watcher() i=4 2024-09-10T04:50:30.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.801+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94226773872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e16237c0 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.802+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94226773872096] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.802+0000 7fec6720e800 20 remove_watcher() i=5 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.802+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94226773886560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x55b2e16237c0 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.803+0000 7fec6216a640 1 -- 172.21.15.145:0/2054809781 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94226773886560] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4c07c040 con 0x55b2e16237c0 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.803+0000 7fec6720e800 20 remove_watcher() i=6 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.803+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94226773890336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e16619a0 con 0x7fec54069050 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94226773890336] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5c041040 con 0x7fec54069050 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 20 remove_watcher() i=7 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e161e790 msgr2=0x55b2e1620b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e161e790 0x55b2e1620b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e161a310 msgr2=0x55b2e161c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e161a310 0x55b2e161c7d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fec54069050 msgr2=0x7fec5403c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fec54069050 0x7fec5403c6f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b2e16237c0 msgr2=0x55b2e1625bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55b2e16237c0 0x55b2e1625bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb2c03c730 msgr2=0x7feb2c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb2c03c730 0x7feb2c03ebf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec4c053fd0 tx=0x7fec4c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6316c640 1 -- 172.21.15.145:0/2054809781 reap_dead start 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 msgr2=0x55b2e160ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec54051900 tx=0x7fec54044f00 comp rx=0 tx=0).stop 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 shutdown_connections 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 --2- 172.21.15.145:0/2054809781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e16079f0 0x55b2e160ee10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 >> 172.21.15.145:0/2054809781 conn(0x55b2e1603df0 msgr2=0x55b2e1602000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 shutdown_connections 2024-09-10T04:50:30.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.804+0000 7fec6720e800 1 -- 172.21.15.145:0/2054809781 wait complete. 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 msgr2=0x7feb3c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 0x7feb3c03eba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b2e15df020 tx=0x7fec4c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 msgr2=0x55b2e15fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec5401a6a0 tx=0x7fec54016870 comp rx=0 tx=0).stop 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 shutdown_connections 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb3c03c6e0 0x7feb3c03eba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/3568851292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e15fb290 0x55b2e15fb6b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 >> 172.21.15.145:0/3568851292 conn(0x55b2e15ef640 msgr2=0x55b2e15efa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 shutdown_connections 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/3568851292 wait complete. 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e15e5570 msgr2=0x55b2e15e7a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b2e15e5570 0x55b2e15e7a00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e1458a80 msgr2=0x55b2e15e4780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b2e1458a80 0x55b2e15e4780 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b2e15eadd0 msgr2=0x55b2e15ed1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b2e15eadd0 0x55b2e15ed1c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb4803c730 msgr2=0x7feb4803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7feb4803c730 0x7feb4803ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec4c057000 tx=0x7fec4c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 msgr2=0x55b2e15dd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 --2- 172.21.15.145:0/4274500468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b2e1457f70 0x55b2e15dd130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec540012b0 tx=0x7fec54000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6316c640 1 -- 172.21.15.145:0/4274500468 reap_dead start 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 shutdown_connections 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 >> 172.21.15.145:0/4274500468 conn(0x55b2e14df3c0 msgr2=0x55b2e15d6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 shutdown_connections 2024-09-10T04:50:30.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.805+0000 7fec6720e800 1 -- 172.21.15.145:0/4274500468 wait complete. 2024-09-10T04:50:30.819 INFO:teuthology.orchestra.run.smithi145.stdout:["myfoo"] 2024-09-10T04:50:30.819 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T04:50:30.822 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:30.822 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T04:50:30.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T04:50:30.822 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T04:50:30.865 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:30.865 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b891f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c7039d5de0 0x55c7039d6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b891f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c703880e40 con 0x55c7039d7020 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b891f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55c70384b680 con 0x55c7039d5de0 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b46a2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c7039d5de0 0x55c7039d6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35abfff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55c7039d7020 0x55c7039dbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39152/0 (socket says 172.21.15.145:39152) 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35abfff640 1 -- 172.21.15.145:0/1302337047 learned_addr learned my addr 172.21.15.145:0/1302337047 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b46a2640 1 -- 172.21.15.145:0/1302337047 >> v1:172.21.15.98:6789/0 conn(0x55c7039d7020 legacy=0x55c7039dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.864+0000 7f35b46a2640 1 -- 172.21.15.145:0/1302337047 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7038676b0 con 0x55c7039d5de0 2024-09-10T04:50:30.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.866+0000 7f35b46a2640 1 --2- 172.21.15.145:0/1302337047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c7039d6ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35a400a470 tx=0x7f35a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1146703409fa668 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.866+0000 7f35b3ea1640 1 -- 172.21.15.145:0/1302337047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a4053570 con 0x55c7039d5de0 2024-09-10T04:50:30.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.866+0000 7f35b3ea1640 1 -- 172.21.15.145:0/1302337047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4058070 con 0x55c7039d5de0 2024-09-10T04:50:30.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.866+0000 7f35b3ea1640 1 -- 172.21.15.145:0/1302337047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a4053880 con 0x55c7039d5de0 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 -- 172.21.15.145:0/1302337047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 msgr2=0x55c7039d6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 --2- 172.21.15.145:0/1302337047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c7039d6ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35a400a470 tx=0x7f35a4045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 -- 172.21.15.145:0/1302337047 shutdown_connections 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 --2- 172.21.15.145:0/1302337047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c7039d6ae0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 -- 172.21.15.145:0/1302337047 >> 172.21.15.145:0/1302337047 conn(0x55c7039d11b0 msgr2=0x55c7039d3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 -- 172.21.15.145:0/1302337047 shutdown_connections 2024-09-10T04:50:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.867+0000 7f35b891f800 1 -- 172.21.15.145:0/1302337047 wait complete. 2024-09-10T04:50:30.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c70386fdd0 con 0x55c7039d5de0 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55430/0 (socket says 172.21.15.145:55430) 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.881+0000 7f35b46a2640 1 -- 172.21.15.145:0/2682975472 learned_addr learned my addr 172.21.15.145:0/2682975472 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.882+0000 7f35b46a2640 1 -- 172.21.15.145:0/2682975472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c703888e10 con 0x55c7039d5de0 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.882+0000 7f35b46a2640 1 --2- 172.21.15.145:0/2682975472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f35a4025c20 tx=0x7f35a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac241bbe3ca4fcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.882+0000 7f34a260c640 1 -- 172.21.15.145:0/2682975472 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a4053a20 con 0x55c7039d5de0 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.882+0000 7f34a260c640 1 -- 172.21.15.145:0/2682975472 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4063070 con 0x55c7039d5de0 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.882+0000 7f34a260c640 1 -- 172.21.15.145:0/2682975472 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a4053cf0 con 0x55c7039d5de0 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- 172.21.15.145:0/2682975472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 msgr2=0x55c703949d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 --2- 172.21.15.145:0/2682975472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f35a4025c20 tx=0x7f35a4051000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- 172.21.15.145:0/2682975472 shutdown_connections 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 --2- 172.21.15.145:0/2682975472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703949d00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- 172.21.15.145:0/2682975472 >> 172.21.15.145:0/2682975472 conn(0x55c7039d11b0 msgr2=0x55c703ac0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- 172.21.15.145:0/2682975472 shutdown_connections 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- 172.21.15.145:0/2682975472 wait complete. 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703ad0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c7039d7710 con 0x55c7039d5de0 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703ad0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703ad0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55446/0 (socket says 172.21.15.145:55446) 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.883+0000 7f35b46a2640 1 -- 172.21.15.145:0/4116916797 learned_addr learned my addr 172.21.15.145:0/4116916797 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f35b46a2640 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c703ad05a0 con 0x55c7039d5de0 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f35b46a2640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703ad0040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35a4025c20 tx=0x7f35a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f34a0e09640 1 -- 172.21.15.145:0/4116916797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a406c030 con 0x55c7039d5de0 2024-09-10T04:50:30.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f34a0e09640 1 -- 172.21.15.145:0/4116916797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4068660 con 0x55c7039d5de0 2024-09-10T04:50:30.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c703ad0830 con 0x55c7039d5de0 2024-09-10T04:50:30.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f34a0e09640 1 -- 172.21.15.145:0/4116916797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a4068940 con 0x55c7039d5de0 2024-09-10T04:50:30.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.884+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c703ad1230 con 0x55c7039d5de0 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f34a0e09640 1 -- 172.21.15.145:0/4116916797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f35a4068ae0 con 0x55c7039d5de0 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f34a0e09640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f349c03c730 0x7f349c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f34a0e09640 1 -- 172.21.15.145:0/4116916797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f35a4097fe0 con 0x55c7039d5de0 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f35abfff640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f349c03c730 0x7f349c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c7039d7020 0x55c703ad7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703ad7bd0 con 0x55c7039d7020 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.885+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c7039d7020 0x55c703ad7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35abfff640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f349c03c730 0x7f349c03ebf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f359c004170 tx=0x7f359c001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c7039d7020 0x55c703ad7690 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b4ea3640 1 -- 172.21.15.145:0/4116916797 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c7039d7020 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703ad8480 0x55c703ada940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703adb0b0 con 0x55c703ad8480 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b46a2640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703ad8480 0x55c703ada940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.886+0000 7f35b46a2640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703ad8480 0x55c703ada940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b46a2640 1 -- 172.21.15.145:0/4116916797 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35a4051070 con 0x55c703ad8480 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703adc960 con 0x55c7039d7020 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b4ea3640 1 -- 172.21.15.145:0/4116916797 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c7039d7020 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703adbb90 con 0x55c703ad8480 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b46a2640 1 -- 172.21.15.145:0/4116916797 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35a4051070 con 0x55c703ad8480 2024-09-10T04:50:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c703addd10 0x55c703ae0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703ae0640 con 0x55c703addd10 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.887+0000 7f35abfff640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c703addd10 0x55c703ae0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35abfff640 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c703addd10 0x55c703ae0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35abfff640 1 -- 172.21.15.145:0/4116916797 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f359c009050 con 0x55c703addd10 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35b891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.888+0000 7f35b891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c7038cda00 con 0x55c703aee1e0 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55452/0 (socket says 172.21.15.145:55452) 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b46a2640 1 -- 172.21.15.145:0/1150343989 learned_addr learned my addr 172.21.15.145:0/1150343989 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b46a2640 1 -- 172.21.15.145:0/1150343989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c703aeec40 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b46a2640 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f35a407b8e0 tx=0x7f35a4052690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f3499ffb640 1 -- 172.21.15.145:0/1150343989 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a408c020 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f3499ffb640 1 -- 172.21.15.145:0/1150343989 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a407bbd0 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c703aef470 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f3499ffb640 1 -- 172.21.15.145:0/1150343989 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a405daf0 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.889+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c703aefa10 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.890+0000 7f3499ffb640 1 -- 172.21.15.145:0/1150343989 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f35a4086040 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.890+0000 7f3499ffb640 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 0x7f348c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.890+0000 7f3499ffb640 1 -- 172.21.15.145:0/1150343989 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f35a4083040 con 0x55c703aee1e0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.890+0000 7f35abfff640 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 0x7f348c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.890+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35abfff640 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 0x7f348c03ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c703adc930 tx=0x7f359c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c703acb610 con 0x55c703afaac0 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55464/0 (socket says 172.21.15.145:55464) 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b46a2640 1 -- 172.21.15.145:0/1380868190 learned_addr learned my addr 172.21.15.145:0/1380868190 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.891+0000 7f35b46a2640 1 -- 172.21.15.145:0/1380868190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c703afb490 con 0x55c703afaac0 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b46a2640 1 --2- 172.21.15.145:0/1380868190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f35a4052720 tx=0x7f35a408f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede061d194ee4132 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f34937fe640 1 -- 172.21.15.145:0/1380868190 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a404d290 con 0x55c703afaac0 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f34937fe640 1 -- 172.21.15.145:0/1380868190 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a40aa030 con 0x55c703afaac0 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f34937fe640 1 -- 172.21.15.145:0/1380868190 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a405e5f0 con 0x55c703afaac0 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 -- 172.21.15.145:0/1380868190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 msgr2=0x55c703afaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 --2- 172.21.15.145:0/1380868190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f35a4052720 tx=0x7f35a408f980 comp rx=0 tx=0).stop 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 -- 172.21.15.145:0/1380868190 shutdown_connections 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 --2- 172.21.15.145:0/1380868190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703afaea0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 -- 172.21.15.145:0/1380868190 >> 172.21.15.145:0/1380868190 conn(0x55c703af6ec0 msgr2=0x55c703af5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 -- 172.21.15.145:0/1380868190 shutdown_connections 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 -- 172.21.15.145:0/1380868190 wait complete. 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.892+0000 7f35b891f800 1 Processor -- start 2024-09-10T04:50:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b891f800 1 -- start start 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b891f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703b01f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b891f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c703afb920 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703b01f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b46a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703b01f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55478/0 (socket says 172.21.15.145:55478) 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 learned_addr learned my addr 172.21.15.145:0/609617271 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c703b02470 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b46a2640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703b01f10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f35a407b510 tx=0x7f35a4063f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f3491ffb640 1 -- 172.21.15.145:0/609617271 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a404d0b0 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f3491ffb640 1 -- 172.21.15.145:0/609617271 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a409cbe0 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c703b02470 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.893+0000 7f3491ffb640 1 -- 172.21.15.145:0/609617271 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35a404d290 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.894+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c703b02470 con 0x55c703afaac0 2024-09-10T04:50:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.894+0000 7f3491ffb640 1 -- 172.21.15.145:0/609617271 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f35a405d560 con 0x55c703afaac0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f3491ffb640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348403c780 0x7f348403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f3491ffb640 1 -- 172.21.15.145:0/609617271 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f35a40b7070 con 0x55c703afaac0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35abfff640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348403c780 0x7f348403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c703b0d470 0x55c703b0f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b10080 con 0x55c703b0d470 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c703b0d470 0x55c703b0f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35abfff640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348403c780 0x7f348403ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f359c00efd0 tx=0x7f359c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.895+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c703b0d470 0x55c703b0f930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 realm 2024-09-10T04:50:30.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b0c7a0 con 0x55c703b0d470 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b10b10 con 0x55c703b0d470 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703b118f0 0x55c703b13ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.896+0000 7f35b46a2640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703b118f0 0x55c703b13ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b46a2640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703b118f0 0x55c703b13ce0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14bb0 con 0x55c703b0d470 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 20 searching for the correct realm 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c703b16920 0x55c703b18d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b19420 con 0x55c703b16920 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.897+0000 7f35abfff640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c703b16920 0x55c703b18d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35abfff640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c703b16920 0x55c703b18d50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b19420 con 0x55c703b118f0 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35b46a2640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f35a40ba030 0x7f35a409e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.898+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f35a40ba030 0x7f35a409e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f35a40ba030 0x7f35a409e500 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f35ac00a4d0 con 0x7f35a40ba030 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.899+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.900+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac00a4d0 con 0x55c703b0d470 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x7f35a40ba030 2024-09-10T04:50:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f35ac030040 con 0x7f35a40ba030 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.901+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.902+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.903+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x7f35a40ba030 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x7f35a40ba030 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x7f35a40ba030 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac030040 con 0x7f35a40ba030 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.904+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b16920 2024-09-10T04:50:30.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.905+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35ac030040 con 0x55c703b0d470 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b157f0 con 0x55c703b118f0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b157f0 con 0x7f35a40ba030 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.906+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 zone default found 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 4 Realm: () 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 zonegroup default 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15c10 con 0x7f35a40ba030 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15c10 con 0x55c703b16920 2024-09-10T04:50:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1b2e0 con 0x55c703b16920 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 started sync module instance, tier type = 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.907+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1a780 con 0x55c703b118f0 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.909+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.909+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94313248828576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1a780 con 0x55c703b118f0 2024-09-10T04:50:30.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.909+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1be00 con 0x55c703b0d470 2024-09-10T04:50:30.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.910+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.910+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94313248831760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1c300 con 0x55c703b0d470 2024-09-10T04:50:30.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.910+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1ce20 con 0x55c703b118f0 2024-09-10T04:50:30.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.910+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94313248828576] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.911+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94313248831760] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.911+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.911+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94313248835824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1cde0 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.911+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1d6c0 con 0x7f35a40ba030 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.912+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94313248835824] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.912+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.912+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94313248826064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1cde0 con 0x7f35a40ba030 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.912+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1dd90 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.913+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.913+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94313248839872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1dd90 con 0x55c703b118f0 2024-09-10T04:50:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.913+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1ed00 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.913+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94313248826064] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.914+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94313248839872] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.914+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.914+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94313248842112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1d1e0 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.914+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1f5a0 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.915+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94313248842112] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.915+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.915+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94313248843728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b16920 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.915+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b20710 con 0x7f35a40ba030 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94313248850400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b20fb0 con 0x7f35a40ba030 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=0 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=1 2024-09-10T04:50:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=2 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=3 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=4 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=5 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94313248843728] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=6 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94313248850400] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 20 add_watcher() i=7 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.917+0000 7f35b891f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.918+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1f990 con 0x55c703b0d470 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.918+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.918+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94313248852656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1f990 con 0x55c703b0d470 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.919+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94313248852656] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.919+0000 7f346a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.919+0000 7f35b891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.919+0000 7f35b891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.919+0000 7f35b891f800 5 note: GC not initialized 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f34697e2640 20 reqs_thread_entry: start 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f35b891f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f35b891f800 20 Filter name: none 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f33daffd640 20 reqs_thread_entry: start 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b56890 con 0x55c703b16920 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.920+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b118f0 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.921+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b118f0 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.922+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b118f0 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.923+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b118f0 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.924+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b118f0 2024-09-10T04:50:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.925+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.926+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b0d470 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b118f0 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.927+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.928+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.928+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c703b15400 con 0x7f35a40ba030 2024-09-10T04:50:30.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.928+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.928+0000 7f35b891f800 20 RGWRados::pool_iterate: got myfoo 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.928+0000 7f35b891f800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.929+0000 7f346a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.929+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94313248852656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b0d470 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.930+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94313248852656] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.930+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94313248828576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b14310 con 0x55c703b118f0 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.931+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94313248828576] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.931+0000 7f35b891f800 20 remove_watcher() i=0 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.931+0000 7f35b891f800 2 removed watcher, disabling cache 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.931+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94313248831760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b0d470 2024-09-10T04:50:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.932+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94313248831760] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x55c703b0d470 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.932+0000 7f35b891f800 20 remove_watcher() i=1 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.932+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94313248835824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b118f0 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.933+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94313248835824] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.933+0000 7f35b891f800 20 remove_watcher() i=2 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.933+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94313248826064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x7f35a40ba030 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.934+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94313248826064] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.934+0000 7f35b891f800 20 remove_watcher() i=3 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.934+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94313248839872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b118f0 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.935+0000 7f35b46a2640 1 -- 172.21.15.145:0/609617271 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94313248839872] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35a40c0020 con 0x55c703b118f0 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.935+0000 7f35b891f800 20 remove_watcher() i=4 2024-09-10T04:50:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.935+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94313248842112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b1fe40 con 0x55c703b16920 2024-09-10T04:50:30.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.936+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94313248842112] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.936+0000 7f35b891f800 20 remove_watcher() i=5 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.936+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94313248843728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b54a90 con 0x55c703b16920 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.937+0000 7f35abfff640 1 -- 172.21.15.145:0/609617271 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94313248843728] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f359c009050 con 0x55c703b16920 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.937+0000 7f35b891f800 20 remove_watcher() i=6 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.937+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94313248850400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c703b54a90 con 0x7f35a40ba030 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94313248850400] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ac041040 con 0x7f35a40ba030 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 20 remove_watcher() i=7 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703b118f0 msgr2=0x55c703b13ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703b118f0 0x55c703b13ce0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c703b0d470 msgr2=0x55c703b0f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c703b0d470 0x55c703b0f930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f35a40ba030 msgr2=0x7f35a409e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f35a40ba030 0x7f35a409e500 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c703b16920 msgr2=0x55c703b18d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c703b16920 0x55c703b18d50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348403c780 msgr2=0x7f348403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348403c780 0x7f348403ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f359c00efd0 tx=0x7f359c010000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 msgr2=0x55c703b01f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/609617271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703afaac0 0x55c703b01f10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f35a407b510 tx=0x7f35a4063f60 comp rx=0 tx=0).stop 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 reap_dead start 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b4ea3640 1 -- 172.21.15.145:0/609617271 reap_dead start 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 shutdown_connections 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 >> 172.21.15.145:0/609617271 conn(0x55c703af6ec0 msgr2=0x55c703af50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 shutdown_connections 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/609617271 wait complete. 2024-09-10T04:50:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 msgr2=0x7f348c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 0x7f348c03ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c703adc930 tx=0x7f359c00f000 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 msgr2=0x55c703aee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f35a407b8e0 tx=0x7f35a4052690 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 shutdown_connections 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f348c03c780 0x7f348c03ec40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 --2- 172.21.15.145:0/1150343989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c703aee1e0 0x55c703aee600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 >> 172.21.15.145:0/1150343989 conn(0x55c703ae2590 msgr2=0x55c703ae2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 shutdown_connections 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.938+0000 7f35b891f800 1 -- 172.21.15.145:0/1150343989 wait complete. 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703ad8480 msgr2=0x55c703ada940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c703ad8480 0x55c703ada940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c7039d7020 msgr2=0x55c703ad7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c7039d7020 0x55c703ad7690 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c703addd10 msgr2=0x55c703ae0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c703addd10 0x55c703ae0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f349c03c730 msgr2=0x7f349c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f349c03c730 0x7f349c03ebf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f359c004170 tx=0x7f359c001330 comp rx=0 tx=0).stop 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 msgr2=0x55c703ad0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 --2- 172.21.15.145:0/4116916797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c7039d5de0 0x55c703ad0040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35a4025c20 tx=0x7f35a4002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b4ea3640 1 -- 172.21.15.145:0/4116916797 reap_dead start 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 shutdown_connections 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 >> 172.21.15.145:0/4116916797 conn(0x55c7039d11b0 msgr2=0x55c703abf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 shutdown_connections 2024-09-10T04:50:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:30.939+0000 7f35b891f800 1 -- 172.21.15.145:0/4116916797 wait complete. 2024-09-10T04:50:30.956 INFO:teuthology.orchestra.run.smithi145.stdout:["myfoo"] 2024-09-10T04:50:30.956 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T04:50:30.968 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:30.978 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:30.987 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.033 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-10T04:50:31.061 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.088 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.115 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.115 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:31.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:31.115 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T04:50:31.160 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.160 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.158+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.158+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b3ac2f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fbc04f53f0 0x55fbc04f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b3ac2f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbc03a0e40 con 0x55fbc04f5d30 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b3ac2f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55fbc036b680 con 0x55fbc04f53f0 2024-09-10T04:50:31.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b38720640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fbc04f53f0 0x55fbc04f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b37f1f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55fbc04f5d30 0x55fbc04f61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39162/0 (socket says 172.21.15.145:39162) 2024-09-10T04:50:31.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b37f1f640 1 -- 172.21.15.145:0/202926851 learned_addr learned my addr 172.21.15.145:0/202926851 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:31.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b38720640 1 -- 172.21.15.145:0/202926851 >> v1:172.21.15.98:6789/0 conn(0x55fbc04f5d30 legacy=0x55fbc04f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.159+0000 7f0b38720640 1 -- 172.21.15.145:0/202926851 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc03876b0 con 0x55fbc04f53f0 2024-09-10T04:50:31.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.161+0000 7f0b38720640 1 --2- 172.21.15.145:0/202926851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc04f57f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0b28005fd0 tx=0x7f0b28045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158728d862f8efd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.161+0000 7f0b3771e640 1 -- 172.21.15.145:0/202926851 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28058530 con 0x55fbc04f53f0 2024-09-10T04:50:31.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.161+0000 7f0b3771e640 1 -- 172.21.15.145:0/202926851 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b280586d0 con 0x55fbc04f53f0 2024-09-10T04:50:31.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.161+0000 7f0b3771e640 1 -- 172.21.15.145:0/202926851 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b280589d0 con 0x55fbc04f53f0 2024-09-10T04:50:31.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/202926851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 msgr2=0x55fbc04f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/202926851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc04f57f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0b28005fd0 tx=0x7f0b28045c30 comp rx=0 tx=0).stop 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/202926851 shutdown_connections 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/202926851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc04f57f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/202926851 >> 172.21.15.145:0/202926851 conn(0x55fbc04f11c0 msgr2=0x55fbc04f3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/202926851 shutdown_connections 2024-09-10T04:50:31.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.162+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/202926851 wait complete. 2024-09-10T04:50:31.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b3ac2f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b3ac2f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fbc038fdd0 con 0x55fbc04f53f0 2024-09-10T04:50:31.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55494/0 (socket says 172.21.15.145:55494) 2024-09-10T04:50:31.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b38720640 1 -- 172.21.15.145:0/2406615897 learned_addr learned my addr 172.21.15.145:0/2406615897 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.176+0000 7f0b38720640 1 -- 172.21.15.145:0/2406615897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc03a8e10 con 0x55fbc04f53f0 2024-09-10T04:50:31.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0b38720640 1 --2- 172.21.15.145:0/2406615897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0b28046160 tx=0x7f0b28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602d6b960b308642 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0a2660c640 1 -- 172.21.15.145:0/2406615897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28068070 con 0x55fbc04f53f0 2024-09-10T04:50:31.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0a2660c640 1 -- 172.21.15.145:0/2406615897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28058880 con 0x55fbc04f53f0 2024-09-10T04:50:31.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0a2660c640 1 -- 172.21.15.145:0/2406615897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28058ba0 con 0x55fbc04f53f0 2024-09-10T04:50:31.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2406615897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 msgr2=0x55fbc05e8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.177+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2406615897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0b28046160 tx=0x7f0b28051000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2406615897 shutdown_connections 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2406615897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05e8870 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2406615897 >> 172.21.15.145:0/2406615897 conn(0x55fbc04f11c0 msgr2=0x55fbc05e41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2406615897 shutdown_connections 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2406615897 wait complete. 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b3ac2f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fbc04f6d20 con 0x55fbc04f53f0 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05f0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55500/0 (socket says 172.21.15.145:55500) 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b38720640 1 -- 172.21.15.145:0/1591635980 learned_addr learned my addr 172.21.15.145:0/1591635980 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.178+0000 7f0b38720640 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc05f06c0 con 0x55fbc04f53f0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0b38720640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05f0160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0b28066040 tx=0x7f0b28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0a24e09640 1 -- 172.21.15.145:0/1591635980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28068070 con 0x55fbc04f53f0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0a24e09640 1 -- 172.21.15.145:0/1591635980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28072070 con 0x55fbc04f53f0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0a24e09640 1 -- 172.21.15.145:0/1591635980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28063760 con 0x55fbc04f53f0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc05f0950 con 0x55fbc04f53f0 2024-09-10T04:50:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.179+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc05f12d0 con 0x55fbc04f53f0 2024-09-10T04:50:31.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0a24e09640 1 -- 172.21.15.145:0/1591635980 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0b28063900 con 0x55fbc04f53f0 2024-09-10T04:50:31.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0a24e09640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a2003c780 0x7f0a2003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0a24e09640 1 -- 172.21.15.145:0/1591635980 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0b28097600 con 0x55fbc04f53f0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a2003c780 0x7f0a2003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc04f5d30 0x55fbc05f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc05f1f20 con 0x55fbc04f5d30 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b38f21640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc04f5d30 0x55fbc05f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a2003c780 0x7f0a2003ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001d70 tx=0x7f0b2c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.180+0000 7f0b38f21640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc04f5d30 0x55fbc05f77b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b38f21640 1 -- 172.21.15.145:0/1591635980 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc04f5d30 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc05f8720 0x55fbc05fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc05fb170 con 0x55fbc05f8720 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b38720640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc05f8720 0x55fbc05fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b38720640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc05f8720 0x55fbc05fab10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.181+0000 7f0b38720640 1 -- 172.21.15.145:0/1591635980 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b2806b070 con 0x55fbc05f8720 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc05fca20 con 0x55fbc04f5d30 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b38f21640 1 -- 172.21.15.145:0/1591635980 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc04f5d30 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc05fbc50 con 0x55fbc05f8720 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b38720640 1 -- 172.21.15.145:0/1591635980 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b2806b070 con 0x55fbc05f8720 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fbc05fddd0 0x55fbc06001c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0600700 con 0x55fbc05fddd0 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fbc05fddd0 0x55fbc06001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.182+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fbc05fddd0 0x55fbc06001c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b37f1f640 1 -- 172.21.15.145:0/1591635980 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc05fddd0 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b3ac2f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b3ac2f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fbc03eda00 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55512/0 (socket says 172.21.15.145:55512) 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.183+0000 7f0b38720640 1 -- 172.21.15.145:0/372478724 learned_addr learned my addr 172.21.15.145:0/372478724 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0b38720640 1 -- 172.21.15.145:0/372478724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc060ece0 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0b38720640 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b2804e560 tx=0x7f0b28063ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0a1dffb640 1 -- 172.21.15.145:0/372478724 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2806caa0 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0a1dffb640 1 -- 172.21.15.145:0/372478724 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28069040 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc060f510 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0a1dffb640 1 -- 172.21.15.145:0/372478724 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b280971e0 con 0x55fbc060e280 2024-09-10T04:50:31.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.184+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc060f510 con 0x55fbc060e280 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0a1dffb640 1 -- 172.21.15.145:0/372478724 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0b28094210 con 0x55fbc060e280 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0a1dffb640 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 0x7f0a1003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0a1dffb640 1 -- 172.21.15.145:0/372478724 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0b28087070 con 0x55fbc060e280 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 0x7f0a1003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 0x7f0a1003ebf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00bf40 tx=0x7f0b2c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b3ac2f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.185+0000 7f0b3ac2f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fbc05e9000 con 0x55fbc061a9a0 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55522/0 (socket says 172.21.15.145:55522) 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0b38720640 1 -- 172.21.15.145:0/1509169118 learned_addr learned my addr 172.21.15.145:0/1509169118 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0b38720640 1 -- 172.21.15.145:0/1509169118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc061b370 con 0x55fbc061a9a0 2024-09-10T04:50:31.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0b38720640 1 --2- 172.21.15.145:0/1509169118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0b2804efd0 tx=0x7f0b28081f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51f3c6b56f64725 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0a177fe640 1 -- 172.21.15.145:0/1509169118 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b280ae070 con 0x55fbc061a9a0 2024-09-10T04:50:31.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0a177fe640 1 -- 172.21.15.145:0/1509169118 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2808a8c0 con 0x55fbc061a9a0 2024-09-10T04:50:31.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.186+0000 7f0a177fe640 1 -- 172.21.15.145:0/1509169118 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28097380 con 0x55fbc061a9a0 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1509169118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 msgr2=0x55fbc061ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1509169118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0b2804efd0 tx=0x7f0b28081f10 comp rx=0 tx=0).stop 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1509169118 shutdown_connections 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1509169118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc061ad80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1509169118 >> 172.21.15.145:0/1509169118 conn(0x55fbc0616da0 msgr2=0x55fbc0614fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1509169118 shutdown_connections 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1509169118 wait complete. 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 Processor -- start 2024-09-10T04:50:31.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- start start 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b3ac2f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fbc061b800 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b38720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55538/0 (socket says 172.21.15.145:55538) 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.187+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 learned_addr learned my addr 172.21.15.145:0/2452369373 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc06222c0 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0b38720640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b28064480 tx=0x7f0b2804dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0a15ffb640 1 -- 172.21.15.145:0/2452369373 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b280b8070 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0a15ffb640 1 -- 172.21.15.145:0/2452369373 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2808e170 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc06222c0 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0a15ffb640 1 -- 172.21.15.145:0/2452369373 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b280ae040 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.188+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc0622760 con 0x55fbc061a9a0 2024-09-10T04:50:31.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0a15ffb640 1 -- 172.21.15.145:0/2452369373 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0b280bb070 con 0x55fbc061a9a0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0a15ffb640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a0803c6e0 0x7f0a0803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0a15ffb640 1 -- 172.21.15.145:0/2452369373 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0b280becb0 con 0x55fbc061a9a0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a0803c6e0 0x7f0a0803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc062d1e0 0x55fbc062f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc062fdc0 con 0x55fbc062d1e0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.189+0000 7f0b38f21640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc062d1e0 0x55fbc062f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a0803c6e0 0x7f0a0803eba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00c010 tx=0x7f0b2c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b38f21640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc062d1e0 0x55fbc062f670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc062d1e0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 realm 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc062c570 con 0x55fbc062d1e0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc062d1e0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0630880 con 0x55fbc062d1e0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc062d1e0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc0631440 0x55fbc0633900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.190+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634070 con 0x55fbc0631440 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b38720640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc0631440 0x55fbc0633900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b38720640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc0631440 0x55fbc0633900 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc062d1e0 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 20 searching for the correct realm 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fbc0636680 0x55fbc0638a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.191+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0639140 con 0x55fbc0636680 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fbc0636680 0x55fbc0638a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b37f1f640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fbc0636680 0x55fbc0638a70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0639140 con 0x55fbc0631440 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b38720640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0b280bd070 0x7f0b28064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.192+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0639140 con 0x7f0b280bd070 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0b280bd070 0x7f0b28064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0b280bd070 0x7f0b28064550 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b300083e0 con 0x7f0b280bd070 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b300083e0 con 0x55fbc062d1e0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.193+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.194+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x7f0b280bd070 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x7f0b280bd070 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.195+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.196+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.197+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x7f0b280bd070 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x7f0b280bd070 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.198+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x7f0b280bd070 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0636680 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.199+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0634910 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0635160 con 0x55fbc062d1e0 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.200+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0635550 con 0x55fbc0631440 2024-09-10T04:50:31.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0635970 con 0x7f0b280bd070 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 zone default found 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 4 Realm: () 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 zonegroup default 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0635da0 con 0x7f0b280bd070 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063afb0 con 0x55fbc0636680 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.201+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063b350 con 0x55fbc0636680 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.202+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.202+0000 7f0b3ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.202+0000 7f0b3ac2f800 20 started sync module instance, tier type = 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.202+0000 7f0b3ac2f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.202+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063a450 con 0x55fbc0631440 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.203+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.203+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539752909184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063a450 con 0x55fbc0631440 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.203+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063be70 con 0x55fbc062d1e0 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.204+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.204+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539752909184] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.204+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539752913248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063be30 con 0x55fbc062d1e0 2024-09-10T04:50:31.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.204+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063c910 con 0x55fbc0631440 2024-09-10T04:50:31.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.205+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539752913248] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.205+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.205+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539752906656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063c8e0 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.205+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063d380 con 0x7f0b280bd070 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.206+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539752906656] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.206+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.206+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539752918640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063c8e0 con 0x7f0b280bd070 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.206+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063ddf0 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.207+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539752918640] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.208+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.208+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539752921312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063c8e0 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.208+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063e800 con 0x55fbc0636680 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.209+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539752921312] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.209+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.209+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539752916016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063c850 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.209+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063f570 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.210+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539752916016] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.210+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.210+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539752926704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063fe10 con 0x55fbc0636680 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.210+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc06407d0 con 0x7f0b280bd070 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539752932608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0640f90 con 0x7f0b280bd070 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=0 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=1 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=2 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=3 2024-09-10T04:50:31.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=4 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=5 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539752926704] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.211+0000 7f0b3ac2f800 20 add_watcher() i=6 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539752932608] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b3ac2f800 20 add_watcher() i=7 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b3ac2f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063f960 con 0x55fbc062d1e0 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.212+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539752933920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc063f960 con 0x55fbc062d1e0 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.213+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539752933920] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.213+0000 7f09ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.213+0000 7f0b3ac2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.213+0000 7f0b3ac2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 5 note: GC not initialized 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f09ed7e2640 20 reqs_thread_entry: start 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 20 Filter name: none 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f095effd640 20 reqs_thread_entry: start 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc06771e0 con 0x7f0b280bd070 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.214+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0677a70 con 0x55fbc0636680 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0676490 con 0x7f0b280bd070 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.215+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0679080 con 0x55fbc0636680 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(65 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 4.1 4:83414aaf:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc067aad0 con 0x7f0b280bd070 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 4.26 4:65ff416b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc067d670 con 0x55fbc062d1e0 2024-09-10T04:50:31.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 4.34 4:2cbb4e89:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0680250 con 0x7f0b280bd070 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 4.39 4:9d1a3169:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0682f20 con 0x55fbc0636680 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 4.21 4:873ed889:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0685970 con 0x55fbc0636680 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 4.34 4:2f60b1f5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0682f60 con 0x7f0b280bd070 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc068a6b0 con 0x55fbc0636680 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 4.b 4:d0ab592a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc068cf20 con 0x7f0b280bd070 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(66 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(69 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 4.12 4:49fd84cd:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc068f8d0 con 0x55fbc062d1e0 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(68 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 4.a 4:52f885ea:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0678bd0 con 0x55fbc0631440 2024-09-10T04:50:31.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(70 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 4.23 4:c5314c0f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc067fd10 con 0x55fbc0636680 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(67 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(71 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(76 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.216+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(73 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.217+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(74 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.217+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(75 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.218+0000 7f09ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.218+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539752933920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc062d1e0 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.219+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94539752933920] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.219+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539752909184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc0631440 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.219+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94539752909184] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.219+0000 7f0b3ac2f800 20 remove_watcher() i=0 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.219+0000 7f0b3ac2f800 2 removed watcher, disabling cache 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.220+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539752913248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc062d1e0 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.220+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94539752913248] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x55fbc062d1e0 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.220+0000 7f0b3ac2f800 20 remove_watcher() i=1 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.220+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539752906656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc0631440 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.221+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94539752906656] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.221+0000 7f0b3ac2f800 20 remove_watcher() i=2 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.221+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539752918640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x7f0b280bd070 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.223+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94539752918640] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.223+0000 7f0b3ac2f800 20 remove_watcher() i=3 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.223+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539752921312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc0631440 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.224+0000 7f0b38720640 1 -- 172.21.15.145:0/2452369373 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94539752921312] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b280c4070 con 0x55fbc0631440 2024-09-10T04:50:31.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.224+0000 7f0b3ac2f800 20 remove_watcher() i=4 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.224+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539752916016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc0636680 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.225+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94539752916016] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.225+0000 7f0b3ac2f800 20 remove_watcher() i=5 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.225+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539752926704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x55fbc0636680 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.226+0000 7f0b37f1f640 1 -- 172.21.15.145:0/2452369373 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94539752926704] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c009050 con 0x55fbc0636680 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.226+0000 7f0b3ac2f800 20 remove_watcher() i=6 2024-09-10T04:50:31.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.226+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539752932608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc0674b20 con 0x7f0b280bd070 2024-09-10T04:50:31.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94539752932608] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b30025040 con 0x7f0b280bd070 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 20 remove_watcher() i=7 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc0631440 msgr2=0x55fbc0633900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc0631440 0x55fbc0633900 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc062d1e0 msgr2=0x55fbc062f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc062d1e0 0x55fbc062f670 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0b280bd070 msgr2=0x7f0b28064550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0b280bd070 0x7f0b28064550 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fbc0636680 msgr2=0x55fbc0638a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fbc0636680 0x55fbc0638a70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a0803c6e0 msgr2=0x7f0a0803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a0803c6e0 0x7f0a0803eba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00c010 tx=0x7f0b2c010000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 msgr2=0x55fbc0621d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b38f21640 1 -- 172.21.15.145:0/2452369373 reap_dead start 2024-09-10T04:50:31.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.227+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b28064480 tx=0x7f0b2804dfa0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 shutdown_connections 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/2452369373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc061a9a0 0x55fbc0621d60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 >> 172.21.15.145:0/2452369373 conn(0x55fbc0616da0 msgr2=0x55fbc0614fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 shutdown_connections 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/2452369373 wait complete. 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 msgr2=0x7f0a1003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 0x7f0a1003ebf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00bf40 tx=0x7f0b2c00f000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 msgr2=0x55fbc060e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b2804e560 tx=0x7f0b28063ec0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 shutdown_connections 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a1003c730 0x7f0a1003ebf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/372478724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc060e280 0x55fbc060e6a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 >> 172.21.15.145:0/372478724 conn(0x55fbc0602630 msgr2=0x55fbc0602a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 shutdown_connections 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/372478724 wait complete. 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc05f8720 msgr2=0x55fbc05fab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fbc05f8720 0x55fbc05fab10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc04f5d30 msgr2=0x55fbc05f77b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fbc04f5d30 0x55fbc05f77b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fbc05fddd0 msgr2=0x55fbc06001c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fbc05fddd0 0x55fbc06001c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a2003c780 msgr2=0x7f0a2003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0a2003c780 0x7f0a2003ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001d70 tx=0x7f0b2c0012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 msgr2=0x55fbc05f0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b3ac2f800 1 --2- 172.21.15.145:0/1591635980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fbc04f53f0 0x55fbc05f0160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0b28066040 tx=0x7f0b28003330 comp rx=0 tx=0).stop 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.228+0000 7f0b38f21640 1 -- 172.21.15.145:0/1591635980 reap_dead start 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.229+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 shutdown_connections 2024-09-10T04:50:31.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.229+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 >> 172.21.15.145:0/1591635980 conn(0x55fbc04f11c0 msgr2=0x55fbc05e9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.229+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 shutdown_connections 2024-09-10T04:50:31.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.229+0000 7f0b3ac2f800 1 -- 172.21.15.145:0/1591635980 wait complete. 2024-09-10T04:50:31.243 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T04:50:30.687124Z","creation_time":"2024-09-10T04:50:30.682311Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T04:50:31.244 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:50:30.687124Z', 'creation_time': '2024-09-10T04:50:30.682311Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T04:50:31.244 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T04:50:31.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T04:50:31.244 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T04:50:31.288 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.288 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc672e20800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561203534df0 0x561203535af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc672e20800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612033dfe40 con 0x561203536030 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc672e20800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5612033aa680 con 0x561203534df0 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc670911640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561203534df0 0x561203535af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc66bfff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x561203536030 0x56120353ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39176/0 (socket says 172.21.15.145:39176) 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.287+0000 7fc66bfff640 1 -- 172.21.15.145:0/4282690961 learned_addr learned my addr 172.21.15.145:0/4282690961 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.288+0000 7fc670911640 1 -- 172.21.15.145:0/4282690961 >> v1:172.21.15.98:6789/0 conn(0x561203536030 legacy=0x56120353ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.288+0000 7fc670911640 1 -- 172.21.15.145:0/4282690961 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612033c66b0 con 0x561203534df0 2024-09-10T04:50:31.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.288+0000 7fc66b7fe640 1 -- 172.21.15.145:0/4282690961 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148295508 0 0) 0x5612033dfe40 con 0x561203536030 2024-09-10T04:50:31.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.289+0000 7fc670911640 1 --2- 172.21.15.145:0/4282690961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203535af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4a96a8b6a8699a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.289+0000 7fc66b7fe640 1 -- 172.21.15.145:0/4282690961 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664053570 con 0x561203534df0 2024-09-10T04:50:31.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.289+0000 7fc66b7fe640 1 -- 172.21.15.145:0/4282690961 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc664058070 con 0x561203534df0 2024-09-10T04:50:31.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.289+0000 7fc66b7fe640 1 -- 172.21.15.145:0/4282690961 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664053880 con 0x561203534df0 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 -- 172.21.15.145:0/4282690961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 msgr2=0x561203535af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 --2- 172.21.15.145:0/4282690961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203535af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 -- 172.21.15.145:0/4282690961 shutdown_connections 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 --2- 172.21.15.145:0/4282690961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203535af0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 -- 172.21.15.145:0/4282690961 >> 172.21.15.145:0/4282690961 conn(0x5612035301c0 msgr2=0x561203532620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 -- 172.21.15.145:0/4282690961 shutdown_connections 2024-09-10T04:50:31.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.290+0000 7fc672e20800 1 -- 172.21.15.145:0/4282690961 wait complete. 2024-09-10T04:50:31.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc672e20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc672e20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612033cedd0 con 0x561203534df0 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55552/0 (socket says 172.21.15.145:55552) 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc670911640 1 -- 172.21.15.145:0/2536920189 learned_addr learned my addr 172.21.15.145:0/2536920189 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.305+0000 7fc670911640 1 -- 172.21.15.145:0/2536920189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612033e7e10 con 0x561203534df0 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc670911640 1 --2- 172.21.15.145:0/2536920189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f650957a6fed86c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc55ee05640 1 -- 172.21.15.145:0/2536920189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664053440 con 0x561203534df0 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc55ee05640 1 -- 172.21.15.145:0/2536920189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6640535e0 con 0x561203534df0 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc55ee05640 1 -- 172.21.15.145:0/2536920189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc66405c520 con 0x561203534df0 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- 172.21.15.145:0/2536920189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 msgr2=0x561203624390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 --2- 172.21.15.145:0/2536920189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664051000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- 172.21.15.145:0/2536920189 shutdown_connections 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 --2- 172.21.15.145:0/2536920189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x561203624390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- 172.21.15.145:0/2536920189 >> 172.21.15.145:0/2536920189 conn(0x5612035301c0 msgr2=0x56120361fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- 172.21.15.145:0/2536920189 shutdown_connections 2024-09-10T04:50:31.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- 172.21.15.145:0/2536920189 wait complete. 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x56120362ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc672e20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561203536720 con 0x561203534df0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x56120362ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x56120362ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55560/0 (socket says 172.21.15.145:55560) 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.306+0000 7fc670911640 1 -- 172.21.15.145:0/984298609 learned_addr learned my addr 172.21.15.145:0/984298609 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc670911640 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120362b0e0 con 0x561203534df0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc670911640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x56120362ab80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc55d602640 1 -- 172.21.15.145:0/984298609 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc66405c720 con 0x561203534df0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc55d602640 1 -- 172.21.15.145:0/984298609 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66405c8c0 con 0x561203534df0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56120362b370 con 0x561203534df0 2024-09-10T04:50:31.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc55d602640 1 -- 172.21.15.145:0/984298609 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc66405cba0 con 0x561203534df0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.307+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120362bf80 con 0x561203534df0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc55d602640 1 -- 172.21.15.145:0/984298609 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc664068460 con 0x561203534df0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc55d602640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc55803c780 0x7fc55803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc55d602640 1 -- 172.21.15.145:0/984298609 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc66406f070 con 0x561203534df0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc66bfff640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc55803c780 0x7fc55803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561203536030 0x5612036321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203632710 con 0x561203536030 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc671112640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561203536030 0x5612036321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.308+0000 7fc66bfff640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc55803c780 0x7fc55803ec40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc65c000c00 tx=0x7fc65c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.309+0000 7fc671112640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561203536030 0x5612036321d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.309+0000 7fc671112640 1 -- 172.21.15.145:0/984298609 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc66c00a4d0 con 0x561203536030 2024-09-10T04:50:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.309+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203632fc0 0x561203635480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.309+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203635bf0 con 0x561203632fc0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.309+0000 7fc670911640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203632fc0 0x561203635480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc670911640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203632fc0 0x561203635480 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc670911640 1 -- 172.21.15.145:0/984298609 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc664079020 con 0x561203632fc0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036374f0 con 0x561203536030 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc671112640 1 -- 172.21.15.145:0/984298609 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc66c00a4d0 con 0x561203536030 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203636630 con 0x561203632fc0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc670911640 1 -- 172.21.15.145:0/984298609 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc664079020 con 0x561203632fc0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612036370a0 0x56120363a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.310+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120363b020 con 0x5612036370a0 2024-09-10T04:50:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.311+0000 7fc66bfff640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612036370a0 0x56120363a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.311+0000 7fc66bfff640 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612036370a0 0x56120363a8b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.311+0000 7fc66bfff640 1 -- 172.21.15.145:0/984298609 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc65c00f670 con 0x5612036370a0 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.311+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc672e20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc672e20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56120342ca00 con 0x56120364d060 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55576/0 (socket says 172.21.15.145:55576) 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc670911640 1 -- 172.21.15.145:0/3521951469 learned_addr learned my addr 172.21.15.145:0/3521951469 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc670911640 1 -- 172.21.15.145:0/3521951469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120364dac0 con 0x56120364d060 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc670911640 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc664097810 tx=0x7fc664099340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.312+0000 7fc5567fc640 1 -- 172.21.15.145:0/3521951469 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664097d90 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc5567fc640 1 -- 172.21.15.145:0/3521951469 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc664071370 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56120364dac0 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc5567fc640 1 -- 172.21.15.145:0/3521951469 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664071690 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120364dac0 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc5567fc640 1 -- 172.21.15.145:0/3521951469 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc664067ad0 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.313+0000 7fc5567fc640 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 0x7fc54803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc5567fc640 1 -- 172.21.15.145:0/3521951469 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc664064070 con 0x56120364d060 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 0x7fc54803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 0x7fc54803ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56120362cac0 tx=0x7fc65c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc672e20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc672e20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561203624b80 con 0x5612036595d0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55592/0 (socket says 172.21.15.145:55592) 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc670911640 1 -- 172.21.15.145:0/2480205636 learned_addr learned my addr 172.21.15.145:0/2480205636 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.314+0000 7fc670911640 1 -- 172.21.15.145:0/2480205636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561203659fa0 con 0x5612036595d0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc670911640 1 --2- 172.21.15.145:0/2480205636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc66405c540 tx=0x7fc66406cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698c3731c2c7fd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc547fff640 1 -- 172.21.15.145:0/2480205636 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664090400 con 0x5612036595d0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc547fff640 1 -- 172.21.15.145:0/2480205636 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6640073e0 con 0x5612036595d0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc547fff640 1 -- 172.21.15.145:0/2480205636 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc664067dc0 con 0x5612036595d0 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 -- 172.21.15.145:0/2480205636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 msgr2=0x5612036599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 --2- 172.21.15.145:0/2480205636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc66405c540 tx=0x7fc66406cfc0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 -- 172.21.15.145:0/2480205636 shutdown_connections 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 --2- 172.21.15.145:0/2480205636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036599b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 -- 172.21.15.145:0/2480205636 >> 172.21.15.145:0/2480205636 conn(0x5612036559d0 msgr2=0x561203653c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 -- 172.21.15.145:0/2480205636 shutdown_connections 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.315+0000 7fc672e20800 1 -- 172.21.15.145:0/2480205636 wait complete. 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc672e20800 1 Processor -- start 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc672e20800 1 -- start start 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc672e20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc672e20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56120365a430 con 0x5612036595d0 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc670911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55600/0 (socket says 172.21.15.145:55600) 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 learned_addr learned my addr 172.21.15.145:0/3553816411 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.316+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561203660f20 con 0x5612036595d0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc670911640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036609c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc664087e10 tx=0x7fc664094eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc5467fc640 1 -- 172.21.15.145:0/3553816411 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6640bd070 con 0x5612036595d0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc5467fc640 1 -- 172.21.15.145:0/3553816411 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6640689e0 con 0x5612036595d0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561203660f20 con 0x5612036595d0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc5467fc640 1 -- 172.21.15.145:0/3553816411 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc66405fa50 con 0x5612036595d0 2024-09-10T04:50:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.317+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561203660f20 con 0x5612036595d0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.318+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.318+0000 7fc5467fc640 1 -- 172.21.15.145:0/3553816411 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6640c0070 con 0x5612036595d0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.318+0000 7fc5467fc640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc53c03c730 0x7fc53c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.318+0000 7fc5467fc640 1 -- 172.21.15.145:0/3553816411 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc6640b4030 con 0x5612036595d0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.318+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc53c03c730 0x7fc53c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56120366bfe0 0x56120366e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120366ebc0 con 0x56120366bfe0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc671112640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56120366bfe0 0x56120366e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc53c03c730 0x7fc53c03ebf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56120363b400 tx=0x7fc65c023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc671112640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56120366bfe0 0x56120366e470 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 20 realm 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120366b370 con 0x56120366bfe0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.319+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120366f650 con 0x56120366bfe0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203670210 0x5612036726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203672e40 con 0x561203670210 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc670911640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203670210 0x5612036726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc670911640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203670210 0x5612036726d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.320+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036736e0 con 0x56120366bfe0 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc672e20800 20 searching for the correct realm 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561203675450 0x561203677880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561203675450 0x561203677880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc66bfff640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561203675450 0x561203677880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.321+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc670911640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6640c2060 0x7fc6640523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc671112640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6640c2060 0x7fc6640523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc671112640 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6640c2060 0x7fc6640523a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc66c00a4d0 con 0x7fc6640c2060 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.322+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.323+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c00a4d0 con 0x56120366bfe0 2024-09-10T04:50:31.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x7fc6640c2060 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.324+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc66c030040 con 0x7fc6640c2060 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.325+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.326+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x7fc6640c2060 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x56120366bfe0 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.327+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x7fc6640c2060 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x7fc6640c2060 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc66c030040 con 0x7fc6640c2060 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.328+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203675450 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561203677f50 con 0x561203670210 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.329+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203674060 con 0x56120366bfe0 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc66c030040 con 0x56120366bfe0 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036744e0 con 0x561203670210 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203674900 con 0x7fc6640c2060 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 zone default found 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 4 Realm: () 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 zonegroup default 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.330+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203674900 con 0x7fc6640c2060 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561203679e10 con 0x561203675450 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120367a1b0 con 0x561203675450 2024-09-10T04:50:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 started sync module instance, tier type = 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.331+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036792b0 con 0x561203670210 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.332+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.333+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635366520800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036792b0 con 0x561203670210 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.333+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367acc0 con 0x56120366bfe0 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.334+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635366520800] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.334+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.334+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635366524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367ac80 con 0x56120366bfe0 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.334+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367b770 con 0x561203670210 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.334+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635366524848] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.335+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.335+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635366527552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367b730 con 0x561203670210 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.335+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367b730 con 0x7fc6640c2060 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.336+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635366527552] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.336+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.336+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635366530352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367c200 con 0x7fc6640c2060 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.336+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367cc20 con 0x561203670210 2024-09-10T04:50:31.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.337+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635366530352] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.337+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.337+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635366532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367cbe0 con 0x561203670210 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.337+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367d660 con 0x561203675450 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.338+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635366532880] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.338+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.338+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635366535600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367da50 con 0x561203675450 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.338+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367e450 con 0x561203675450 2024-09-10T04:50:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.339+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.339+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635366541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367f110 con 0x561203675450 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.339+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367fb30 con 0x7fc6640c2060 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.339+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635366535600] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635366544928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367faf0 con 0x7fc6640c2060 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=0 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=1 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=2 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=3 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=4 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=5 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635366541376] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.340+0000 7fc672e20800 20 add_watcher() i=6 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635366544928] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc672e20800 20 add_watcher() i=7 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc672e20800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56120367ec60 con 0x56120366bfe0 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.341+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635366518272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56120367ec60 con 0x56120366bfe0 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635366518272] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc5277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 5 note: GC not initialized 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc5267e4640 20 reqs_thread_entry: start 2024-09-10T04:50:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 20 Filter name: none 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc51f7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.343+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b57f0 con 0x56120366bfe0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b60b0 con 0x56120366bfe0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b70c0 con 0x7fc6640c2060 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.344+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b4970 con 0x7fc6640c2060 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b6e10 con 0x561203675450 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 4.1 4:83414aaf:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b62f0 con 0x7fc6640c2060 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 4.26 4:65ff416b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036bb9c0 con 0x56120366bfe0 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 4.34 4:2cbb4e89:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036be2d0 con 0x7fc6640c2060 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 4.39 4:9d1a3169:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036c0bc0 con 0x561203675450 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 4.21 4:873ed889:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036be2d0 con 0x561203675450 2024-09-10T04:50:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 4.34 4:2f60b1f5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036c5e10 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036c8880 con 0x561203675450 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.345+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 4.b 4:d0ab592a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036cb710 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(67 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(69 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 4.12 4:49fd84cd:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036c0bc0 con 0x56120366bfe0 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:76 4.a 4:52f885ea:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036b8500 con 0x561203670210 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(72 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 4.23 4:c5314c0f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612036c0bc0 con 0x561203675450 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(74 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(75 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(76 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(73 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.346+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(77 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.347+0000 7fc5277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.347+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635366518272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x56120366bfe0 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.348+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94635366518272] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.348+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635366520800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x561203670210 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.349+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94635366520800] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.349+0000 7fc672e20800 20 remove_watcher() i=0 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.349+0000 7fc672e20800 2 removed watcher, disabling cache 2024-09-10T04:50:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.349+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635366524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x56120366bfe0 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.350+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94635366524848] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x56120366bfe0 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.350+0000 7fc672e20800 20 remove_watcher() i=1 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.350+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635366527552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x561203670210 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.351+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94635366527552] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.351+0000 7fc672e20800 20 remove_watcher() i=2 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.351+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635366530352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x7fc6640c2060 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.352+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94635366530352] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.352+0000 7fc672e20800 20 remove_watcher() i=3 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.352+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635366532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x561203670210 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.353+0000 7fc670911640 1 -- 172.21.15.145:0/3553816411 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94635366532880] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6640bf030 con 0x561203670210 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.353+0000 7fc672e20800 20 remove_watcher() i=4 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.353+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635366535600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x561203675450 2024-09-10T04:50:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94635366535600] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc672e20800 20 remove_watcher() i=5 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635366541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x561203675450 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc66bfff640 1 -- 172.21.15.145:0/3553816411 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94635366541376] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc65c037040 con 0x561203675450 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc672e20800 20 remove_watcher() i=6 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.354+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635366544928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612036b36b0 con 0x7fc6640c2060 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.355+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94635366544928] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc66c041040 con 0x7fc6640c2060 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.355+0000 7fc672e20800 20 remove_watcher() i=7 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203670210 msgr2=0x5612036726d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203670210 0x5612036726d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56120366bfe0 msgr2=0x56120366e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56120366bfe0 0x56120366e470 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6640c2060 msgr2=0x7fc6640523a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc6640c2060 0x7fc6640523a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561203675450 msgr2=0x561203677880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561203675450 0x561203677880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc53c03c730 msgr2=0x7fc53c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc53c03c730 0x7fc53c03ebf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56120363b400 tx=0x7fc65c023040 comp rx=0 tx=0).stop 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 msgr2=0x5612036609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3553816411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612036595d0 0x5612036609c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc664087e10 tx=0x7fc664094eb0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 reap_dead start 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc671112640 1 -- 172.21.15.145:0/3553816411 reap_dead start 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 shutdown_connections 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 >> 172.21.15.145:0/3553816411 conn(0x5612036559d0 msgr2=0x561203653be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 shutdown_connections 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3553816411 wait complete. 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 msgr2=0x7fc54803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 0x7fc54803ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56120362cac0 tx=0x7fc65c006000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 msgr2=0x56120364d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc664097810 tx=0x7fc664099340 comp rx=0 tx=0).stop 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 shutdown_connections 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc54803c920 0x7fc54803ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 --2- 172.21.15.145:0/3521951469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56120364d060 0x56120364d480 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 >> 172.21.15.145:0/3521951469 conn(0x56120363d000 msgr2=0x56120363d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 shutdown_connections 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.356+0000 7fc672e20800 1 -- 172.21.15.145:0/3521951469 wait complete. 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203632fc0 msgr2=0x561203635480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561203632fc0 0x561203635480 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561203536030 msgr2=0x5612036321d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561203536030 0x5612036321d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612036370a0 msgr2=0x56120363a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612036370a0 0x56120363a8b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc55803c780 msgr2=0x7fc55803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc55803c780 0x7fc55803ec40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc65c000c00 tx=0x7fc65c0013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 msgr2=0x56120362ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 --2- 172.21.15.145:0/984298609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561203534df0 0x56120362ab80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc66400a470 tx=0x7fc664002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc671112640 1 -- 172.21.15.145:0/984298609 reap_dead start 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 shutdown_connections 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 >> 172.21.15.145:0/984298609 conn(0x5612035301c0 msgr2=0x56120361e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 shutdown_connections 2024-09-10T04:50:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.357+0000 7fc672e20800 1 -- 172.21.15.145:0/984298609 wait complete. 2024-09-10T04:50:31.374 INFO:teuthology.orchestra.run.smithi145.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T04:50:30.687124Z","creation_time":"2024-09-10T04:50:30.682311Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-10T04:50:31.374 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:50:30.687124Z', 'creation_time': '2024-09-10T04:50:30.682311Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T04:50:31.381 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T04:50:31.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:31.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:31.382 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T04:50:31.425 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.426 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f094ae20800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x559600d17200 0x559600d196c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f094ae20800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559600bbce40 con 0x559600d13600 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f094ae20800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x559600b87680 con 0x559600d17200 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f0948911640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x559600d13600 0x559600d159f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39178/0 (socket says 172.21.15.145:39178) 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f0948911640 1 -- 172.21.15.145:0/1379114060 learned_addr learned my addr 172.21.15.145:0/1379114060 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.424+0000 7f0948110640 1 --2- 172.21.15.145:0/1379114060 >> v2:172.21.15.98:3300/0 conn(0x559600d17200 0x559600d196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.425+0000 7f094790f640 1 -- 172.21.15.145:0/1379114060 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509223581 0 0) 0x559600bbce40 con 0x559600d13600 2024-09-10T04:50:31.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.425+0000 7f094790f640 1 -- 172.21.15.145:0/1379114060 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0930001e10 con 0x559600d13600 2024-09-10T04:50:31.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.425+0000 7f0948110640 1 -- 172.21.15.145:0/1379114060 >> v1:172.21.15.98:6789/0 conn(0x559600d13600 legacy=0x559600d159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.425+0000 7f0948110640 1 -- 172.21.15.145:0/1379114060 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600ba36b0 con 0x559600d17200 2024-09-10T04:50:31.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.426+0000 7f0948110640 1 --2- 172.21.15.145:0/1379114060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d17200 0x559600d196c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a470 tx=0x7f093c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08f9a3ea573e793 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094790f640 1 -- 172.21.15.145:0/1379114060 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c059070 con 0x559600d17200 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094790f640 1 -- 172.21.15.145:0/1379114060 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c054570 con 0x559600d17200 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094790f640 1 -- 172.21.15.145:0/1379114060 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c054850 con 0x559600d17200 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 -- 172.21.15.145:0/1379114060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d17200 msgr2=0x559600d196c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 --2- 172.21.15.145:0/1379114060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d17200 0x559600d196c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a470 tx=0x7f093c045920 comp rx=0 tx=0).stop 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 -- 172.21.15.145:0/1379114060 shutdown_connections 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 --2- 172.21.15.145:0/1379114060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d17200 0x559600d196c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 -- 172.21.15.145:0/1379114060 >> 172.21.15.145:0/1379114060 conn(0x559600d0d1c0 msgr2=0x559600d0f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 -- 172.21.15.145:0/1379114060 shutdown_connections 2024-09-10T04:50:31.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.427+0000 7f094ae20800 1 -- 172.21.15.145:0/1379114060 wait complete. 2024-09-10T04:50:31.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f094ae20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f094ae20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559600babdd0 con 0x559600d13600 2024-09-10T04:50:31.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55622/0 (socket says 172.21.15.145:55622) 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.441+0000 7f0948911640 1 -- 172.21.15.145:0/1872549425 learned_addr learned my addr 172.21.15.145:0/1872549425 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.442+0000 7f0948911640 1 -- 172.21.15.145:0/1872549425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600bc4e10 con 0x559600d13600 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.442+0000 7f0948911640 1 --2- 172.21.15.145:0/1872549425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0940001e30 tx=0x7f094000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badcbca1f85839b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.442+0000 7f0836e0d640 1 -- 172.21.15.145:0/1872549425 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940012020 con 0x559600d13600 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.442+0000 7f0836e0d640 1 -- 172.21.15.145:0/1872549425 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094000e470 con 0x559600d13600 2024-09-10T04:50:31.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.442+0000 7f0836e0d640 1 -- 172.21.15.145:0/1872549425 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094000e790 con 0x559600d13600 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- 172.21.15.145:0/1872549425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 msgr2=0x559600e024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 --2- 172.21.15.145:0/1872549425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0940001e30 tx=0x7f094000b780 comp rx=0 tx=0).stop 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- 172.21.15.145:0/1872549425 shutdown_connections 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 --2- 172.21.15.145:0/1872549425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e024c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- 172.21.15.145:0/1872549425 >> 172.21.15.145:0/1872549425 conn(0x559600d0d1c0 msgr2=0x559600dfde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- 172.21.15.145:0/1872549425 shutdown_connections 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- 172.21.15.145:0/1872549425 wait complete. 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e09df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.443+0000 7f094ae20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559600d1a040 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e09df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e09df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55624/0 (socket says 172.21.15.145:55624) 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f0948911640 1 -- 172.21.15.145:0/1023693116 learned_addr learned my addr 172.21.15.145:0/1023693116 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f0948911640 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600e0a350 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f0948911640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e09df0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x559600e03450 tx=0x7f09400040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f083560a640 1 -- 172.21.15.145:0/1023693116 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940012030 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f083560a640 1 -- 172.21.15.145:0/1023693116 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094001a7a0 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559600e0a5e0 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f083560a640 1 -- 172.21.15.145:0/1023693116 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094001aaa0 con 0x559600d13600 2024-09-10T04:50:31.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.444+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559600e0afe0 con 0x559600d13600 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f083560a640 1 -- 172.21.15.145:0/1023693116 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0940015020 con 0x559600d13600 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f083560a640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f083003c730 0x7f083003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f083560a640 1 -- 172.21.15.145:0/1023693116 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0940020070 con 0x559600d13600 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f0948110640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f083003c730 0x7f083003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600d17200 0x559600e11440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.445+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e11980 con 0x559600d17200 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f0949112640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600d17200 0x559600e11440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f0948110640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f083003c730 0x7f083003ebf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x559600c85540 tx=0x7f093c050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f0949112640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600d17200 0x559600e11440 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f0949112640 1 -- 172.21.15.145:0/1023693116 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f093800a4d0 con 0x559600d17200 2024-09-10T04:50:31.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e12230 0x559600e146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e14e40 con 0x559600e12230 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.446+0000 7f0948911640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e12230 0x559600e146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f0948911640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e12230 0x559600e146d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f0948911640 1 -- 172.21.15.145:0/1023693116 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0940018950 con 0x559600e12230 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e166f0 con 0x559600d17200 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f0949112640 1 -- 172.21.15.145:0/1023693116 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f093800a4d0 con 0x559600d17200 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e15920 con 0x559600e12230 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f0948911640 1 -- 172.21.15.145:0/1023693116 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0940018950 con 0x559600e12230 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559600e17aa0 0x559600e19e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.447+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e1a3d0 con 0x559600e17aa0 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.448+0000 7f0948110640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559600e17aa0 0x559600e19e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.448+0000 7f0948110640 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559600e17aa0 0x559600e19e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.448+0000 7f0948110640 1 -- 172.21.15.145:0/1023693116 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f093c061430 con 0x559600e17aa0 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.448+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f094ae20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f094ae20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559600c09a00 con 0x559600e27f20 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55628/0 (socket says 172.21.15.145:55628) 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f0948911640 1 -- 172.21.15.145:0/2236610486 learned_addr learned my addr 172.21.15.145:0/2236610486 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f0948911640 1 -- 172.21.15.145:0/2236610486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600e28980 con 0x559600e27f20 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f0948911640 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0940001770 tx=0x7f094004b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f082e7fc640 1 -- 172.21.15.145:0/2236610486 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940031030 con 0x559600e27f20 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f082e7fc640 1 -- 172.21.15.145:0/2236610486 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094002c900 con 0x559600e27f20 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.449+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559600e291b0 con 0x559600e27f20 2024-09-10T04:50:31.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f082e7fc640 1 -- 172.21.15.145:0/2236610486 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094002cc20 con 0x559600e27f20 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559600e29750 con 0x559600e27f20 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f082e7fc640 1 -- 172.21.15.145:0/2236610486 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0940034070 con 0x559600e27f20 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f082e7fc640 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 0x7f082003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f082e7fc640 1 -- 172.21.15.145:0/2236610486 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0940032070 con 0x559600e27f20 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.450+0000 7f0948110640 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 0x7f082003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948110640 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 0x7f082003ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x559600e0bd00 tx=0x7f093c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f094ae20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f094ae20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559600e02d10 con 0x559600d11600 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55632/0 (socket says 172.21.15.145:55632) 2024-09-10T04:50:31.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948911640 1 -- 172.21.15.145:0/1721853726 learned_addr learned my addr 172.21.15.145:0/1721853726 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948911640 1 -- 172.21.15.145:0/1721853726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600d11ff0 con 0x559600d11600 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.451+0000 7f0948911640 1 --2- 172.21.15.145:0/1721853726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f094004cfd0 tx=0x7f0940048b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f8ba4dd73c1bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f081ffff640 1 -- 172.21.15.145:0/1721853726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940053a50 con 0x559600d11600 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f081ffff640 1 -- 172.21.15.145:0/1721853726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094004b6e0 con 0x559600d11600 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f081ffff640 1 -- 172.21.15.145:0/1721853726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940036410 con 0x559600d11600 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 -- 172.21.15.145:0/1721853726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 msgr2=0x559600d11a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 --2- 172.21.15.145:0/1721853726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f094004cfd0 tx=0x7f0940048b90 comp rx=0 tx=0).stop 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 -- 172.21.15.145:0/1721853726 shutdown_connections 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 --2- 172.21.15.145:0/1721853726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600d11a00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 -- 172.21.15.145:0/1721853726 >> 172.21.15.145:0/1721853726 conn(0x559600e30c40 msgr2=0x559600e2ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 -- 172.21.15.145:0/1721853726 shutdown_connections 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 -- 172.21.15.145:0/1721853726 wait complete. 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.452+0000 7f094ae20800 1 Processor -- start 2024-09-10T04:50:31.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f094ae20800 1 -- start start 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f094ae20800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f094ae20800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559600d124e0 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f0948911640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55638/0 (socket says 172.21.15.145:55638) 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 learned_addr learned my addr 172.21.15.145:0/300932254 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559600e3e390 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f0948911640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f094002cfd0 tx=0x7f094000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f081e7fc640 1 -- 172.21.15.145:0/300932254 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940070070 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f081e7fc640 1 -- 172.21.15.145:0/300932254 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940046450 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f081e7fc640 1 -- 172.21.15.145:0/300932254 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0940053a50 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559600e3e390 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.453+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559600e3e390 con 0x559600d11600 2024-09-10T04:50:31.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.454+0000 7f081e7fc640 1 -- 172.21.15.145:0/300932254 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0940073070 con 0x559600d11600 2024-09-10T04:50:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.454+0000 7f081e7fc640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f081403c6e0 0x7f081403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f081e7fc640 1 -- 172.21.15.145:0/300932254 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f094005c070 con 0x559600d11600 2024-09-10T04:50:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f0948110640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f081403c6e0 0x7f081403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600e493d0 0x559600e4b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e4bfe0 con 0x559600e493d0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f0949112640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600e493d0 0x559600e4b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f0948110640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f081403c6e0 0x7f081403eba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559600e16640 tx=0x7f093c063040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f0949112640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600e493d0 0x559600e4b890 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 20 realm 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.455+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e48700 con 0x559600e493d0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e4ca70 con 0x559600e493d0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e4d850 0x559600e4fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e50270 con 0x559600e4d850 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f0948911640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e4d850 0x559600e4fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.456+0000 7f0948911640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e4d850 0x559600e4fc40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e50b10 con 0x559600e493d0 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 20 searching for the correct realm 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559600e52880 0x559600e54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f0948110640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559600e52880 0x559600e54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.457+0000 7f0948110640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559600e52880 0x559600e54cb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0948911640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0940075060 0x7f094006b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0949112640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0940075060 0x7f094006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0949112640 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0940075060 0x7f094006b400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f093800a4d0 con 0x7f0940075060 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.458+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.459+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093800a4d0 con 0x559600e493d0 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x7f0940075060 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.460+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0938030040 con 0x7f0940075060 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.461+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.462+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e493d0 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.463+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0938030040 con 0x7f0940075060 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.464+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e52880 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559600e55380 con 0x559600e4d850 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.465+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e514c0 con 0x559600e493d0 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0938030040 con 0x559600e493d0 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e51940 con 0x559600e4d850 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e51de0 con 0x7f0940075060 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 zone default found 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 4 Realm: () 2024-09-10T04:50:31.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 zonegroup default 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e55850 con 0x7f0940075060 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.466+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e576f0 con 0x559600e52880 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e57a90 con 0x559600e52880 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 20 started sync module instance, tier type = 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.467+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e56b30 con 0x559600e4d850 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.468+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.468+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102748491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e582e0 con 0x559600e4d850 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.468+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e58b30 con 0x559600e493d0 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.469+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102748491600] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.469+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.469+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102748495408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e58b30 con 0x559600e493d0 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.469+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e595b0 con 0x559600e4d850 2024-09-10T04:50:31.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.470+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102748495408] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.470+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.470+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102748500160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e58b30 con 0x559600e4d850 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.470+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5a070 con 0x7f0940075060 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.471+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102748500160] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.471+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.471+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102748502848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e58b30 con 0x7f0940075060 2024-09-10T04:50:31.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.471+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5aac0 con 0x559600e4d850 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.472+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102748502848] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.472+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.472+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102748505552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e58b30 con 0x559600e4d850 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.473+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5b4d0 con 0x559600e52880 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.473+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.473+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102748505552] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.473+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102748508192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5bd70 con 0x559600e52880 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.473+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e586a0 con 0x559600e52880 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.474+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102748508192] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.475+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.475+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102748512992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5cbb0 con 0x559600e52880 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.475+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5d440 con 0x7f0940075060 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102748516176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5dce0 con 0x7f0940075060 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=0 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=1 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=2 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=3 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=4 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=5 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102748512992] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=6 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102748516176] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 20 add_watcher() i=7 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.476+0000 7f094ae20800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.477+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e5dce0 con 0x559600e493d0 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.477+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.477+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102748518368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e5dc00 con 0x559600e493d0 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102748518368] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f07ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f094ae20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f094ae20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f094ae20800 5 note: GC not initialized 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f07fe7e4640 20 reqs_thread_entry: start 2024-09-10T04:50:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f094ae20800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.478+0000 7f094ae20800 20 Filter name: none 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f07f77fe640 20 reqs_thread_entry: start 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e93da0 con 0x7f0940075060 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e94630 con 0x559600e52880 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.479+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e93050 con 0x7f0940075060 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e95c40 con 0x559600e52880 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(65 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 4.1 4:83414aaf:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e95670 con 0x7f0940075060 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 4.26 4:65ff416b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e9a560 con 0x559600e493d0 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 4.34 4:2cbb4e89:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e9ced0 con 0x7f0940075060 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 4.39 4:9d1a3169:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e9fac0 con 0x559600e52880 2024-09-10T04:50:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 4.21 4:873ed889:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600ea2620 con 0x559600e52880 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 4.34 4:2f60b1f5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600ea4fd0 con 0x7f0940075060 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.480+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(68 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(69 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(66 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600ea4fd0 con 0x559600e52880 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(67 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 4.b 4:d0ab592a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e95100 con 0x7f0940075060 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 4.12 4:49fd84cd:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e98580 con 0x559600e493d0 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 4.a 4:52f885ea:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e9b3f0 con 0x559600e4d850 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(71 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 4.23 4:c5314c0f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559600e9b3f0 con 0x559600e52880 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(70 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(75 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(73 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(76 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.481+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(74 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.482+0000 7f07ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.482+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102748518368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e95100 con 0x559600e493d0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.483+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94102748518368] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.483+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102748491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600ea5030 con 0x559600e4d850 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.484+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94102748491600] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.484+0000 7f094ae20800 20 remove_watcher() i=0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.484+0000 7f094ae20800 2 removed watcher, disabling cache 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.484+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102748495408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e91700 con 0x559600e493d0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.485+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94102748495408] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x559600e493d0 2024-09-10T04:50:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.485+0000 7f094ae20800 20 remove_watcher() i=1 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.485+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102748500160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600ea5030 con 0x559600e4d850 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.486+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94102748500160] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.486+0000 7f094ae20800 20 remove_watcher() i=2 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.486+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102748502848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e91700 con 0x7f0940075060 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.487+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94102748502848] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.487+0000 7f094ae20800 20 remove_watcher() i=3 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.487+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102748505552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600ea5030 con 0x559600e4d850 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.488+0000 7f0948911640 1 -- 172.21.15.145:0/300932254 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94102748505552] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0940072030 con 0x559600e4d850 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.488+0000 7f094ae20800 20 remove_watcher() i=4 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.488+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102748508192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e91700 con 0x559600e52880 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.489+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94102748508192] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.489+0000 7f094ae20800 20 remove_watcher() i=5 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.489+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102748512992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600ea5030 con 0x559600e52880 2024-09-10T04:50:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.490+0000 7f0948110640 1 -- 172.21.15.145:0/300932254 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94102748512992] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c082070 con 0x559600e52880 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.490+0000 7f094ae20800 20 remove_watcher() i=6 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.490+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102748516176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559600e91700 con 0x7f0940075060 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94102748516176] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0938041040 con 0x7f0940075060 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 20 remove_watcher() i=7 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e4d850 msgr2=0x559600e4fc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e4d850 0x559600e4fc40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600e493d0 msgr2=0x559600e4b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600e493d0 0x559600e4b890 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0940075060 msgr2=0x7f094006b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0940075060 0x7f094006b400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559600e52880 msgr2=0x559600e54cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x559600e52880 0x559600e54cb0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f081403c6e0 msgr2=0x7f081403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f081403c6e0 0x7f081403eba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559600e16640 tx=0x7f093c063040 comp rx=0 tx=0).stop 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 msgr2=0x559600e3de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f0949112640 1 -- 172.21.15.145:0/300932254 reap_dead start 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f094002cfd0 tx=0x7f094000de40 comp rx=0 tx=0).stop 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 shutdown_connections 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/300932254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d11600 0x559600e3de30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 >> 172.21.15.145:0/300932254 conn(0x559600e30c40 msgr2=0x559600e2ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 shutdown_connections 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/300932254 wait complete. 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 msgr2=0x7f082003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 0x7f082003ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x559600e0bd00 tx=0x7f093c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 msgr2=0x559600e28340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0940001770 tx=0x7f094004b2e0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 shutdown_connections 2024-09-10T04:50:31.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f082003c780 0x7f082003ec40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 --2- 172.21.15.145:0/2236610486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600e27f20 0x559600e28340 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.491+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 >> 172.21.15.145:0/2236610486 conn(0x559600e1c2d0 msgr2=0x559600e1c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 shutdown_connections 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/2236610486 wait complete. 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e12230 msgr2=0x559600e146d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559600e12230 0x559600e146d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600d17200 msgr2=0x559600e11440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x559600d17200 0x559600e11440 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559600e17aa0 msgr2=0x559600e19e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x559600e17aa0 0x559600e19e90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f083003c730 msgr2=0x7f083003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f083003c730 0x7f083003ebf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x559600c85540 tx=0x7f093c050000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 msgr2=0x559600e09df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 --2- 172.21.15.145:0/1023693116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559600d13600 0x559600e09df0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x559600e03450 tx=0x7f09400040e0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f0949112640 1 -- 172.21.15.145:0/1023693116 reap_dead start 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 shutdown_connections 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 >> 172.21.15.145:0/1023693116 conn(0x559600d0d1c0 msgr2=0x559600e037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 shutdown_connections 2024-09-10T04:50:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.492+0000 7f094ae20800 1 -- 172.21.15.145:0/1023693116 wait complete. 2024-09-10T04:50:31.509 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T04:50:30.687124Z","creation_time":"2024-09-10T04:50:30.682311Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T04:50:31.509 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:50:30.687124Z', 'creation_time': '2024-09-10T04:50:30.682311Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T04:50:31.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T04:50:31.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T04:50:31.510 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-10T04:50:31.594 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.594 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f050bc0e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55887ff3fe00 0x55887ff40b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f050bc0e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55887fdeae40 con 0x55887ff41040 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f050bc0e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55887fdb5680 con 0x55887ff3fe00 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f0507259640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55887ff3fe00 0x55887ff40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f04fea58640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55887ff41040 0x55887ff45da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39194/0 (socket says 172.21.15.145:39194) 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.593+0000 7f04fea58640 1 -- 172.21.15.145:0/4292315625 learned_addr learned my addr 172.21.15.145:0/4292315625 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.594+0000 7f0507259640 1 -- 172.21.15.145:0/4292315625 >> v1:172.21.15.98:6789/0 conn(0x55887ff41040 legacy=0x55887ff45da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.594+0000 7f0507259640 1 -- 172.21.15.145:0/4292315625 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887fdd16b0 con 0x55887ff3fe00 2024-09-10T04:50:31.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.594+0000 7f0506a58640 1 -- 172.21.15.145:0/4292315625 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797912638 0 0) 0x55887fdeae40 con 0x55887ff41040 2024-09-10T04:50:31.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.595+0000 7f0507259640 1 --2- 172.21.15.145:0/4292315625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x55887ff40b00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04f800a470 tx=0x7f04f8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703dc74f8edb06db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f0506a58640 1 -- 172.21.15.145:0/4292315625 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8053570 con 0x55887ff3fe00 2024-09-10T04:50:31.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f0506a58640 1 -- 172.21.15.145:0/4292315625 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8058070 con 0x55887ff3fe00 2024-09-10T04:50:31.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f0506a58640 1 -- 172.21.15.145:0/4292315625 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8053880 con 0x55887ff3fe00 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 -- 172.21.15.145:0/4292315625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 msgr2=0x55887ff40b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 --2- 172.21.15.145:0/4292315625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x55887ff40b00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04f800a470 tx=0x7f04f8045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 -- 172.21.15.145:0/4292315625 shutdown_connections 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 --2- 172.21.15.145:0/4292315625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x55887ff40b00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 -- 172.21.15.145:0/4292315625 >> 172.21.15.145:0/4292315625 conn(0x55887ff3b1d0 msgr2=0x55887ff3d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 -- 172.21.15.145:0/4292315625 shutdown_connections 2024-09-10T04:50:31.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.596+0000 7f050bc0e800 1 -- 172.21.15.145:0/4292315625 wait complete. 2024-09-10T04:50:31.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f050bc0e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f050bc0e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55887fdd9dd0 con 0x55887ff3fe00 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55654/0 (socket says 172.21.15.145:55654) 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.610+0000 7f0507259640 1 -- 172.21.15.145:0/1077313441 learned_addr learned my addr 172.21.15.145:0/1077313441 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.611+0000 7f0507259640 1 -- 172.21.15.145:0/1077313441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887fdf2e10 con 0x55887ff3fe00 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.611+0000 7f0507259640 1 --2- 172.21.15.145:0/1077313441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04f8025c20 tx=0x7f04f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd9fe8dce47f7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.611+0000 7f03f560a640 1 -- 172.21.15.145:0/1077313441 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8053a20 con 0x55887ff3fe00 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.611+0000 7f03f560a640 1 -- 172.21.15.145:0/1077313441 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8063070 con 0x55887ff3fe00 2024-09-10T04:50:31.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.611+0000 7f03f560a640 1 -- 172.21.15.145:0/1077313441 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8053d30 con 0x55887ff3fe00 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- 172.21.15.145:0/1077313441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 msgr2=0x5588800326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 --2- 172.21.15.145:0/1077313441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04f8025c20 tx=0x7f04f8051000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- 172.21.15.145:0/1077313441 shutdown_connections 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 --2- 172.21.15.145:0/1077313441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x5588800326d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- 172.21.15.145:0/1077313441 >> 172.21.15.145:0/1077313441 conn(0x55887ff3b1d0 msgr2=0x558880029c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- 172.21.15.145:0/1077313441 shutdown_connections 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- 172.21.15.145:0/1077313441 wait complete. 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x558880039ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f050bc0e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55887ff41730 con 0x55887ff3fe00 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x558880039ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x558880039ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55670/0 (socket says 172.21.15.145:55670) 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.612+0000 7f0507259640 1 -- 172.21.15.145:0/387909157 learned_addr learned my addr 172.21.15.145:0/387909157 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f0507259640 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888003a430 con 0x55887ff3fe00 2024-09-10T04:50:31.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f0507259640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x558880039ed0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04f8025c20 tx=0x7f04f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f03f3e07640 1 -- 172.21.15.145:0/387909157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8078070 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f03f3e07640 1 -- 172.21.15.145:0/387909157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8073470 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55888003a6c0 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f03f3e07640 1 -- 172.21.15.145:0/387909157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8073750 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.613+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888003b2d0 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f03f3e07640 1 -- 172.21.15.145:0/387909157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f04f807b070 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f03f3e07640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03ec03c780 0x7f03ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f03f3e07640 1 -- 172.21.15.145:0/387909157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04f8097cb0 con 0x55887ff3fe00 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f04fea58640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03ec03c780 0x7f03ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55887ff41040 0x558880041520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888003bc90 con 0x55887ff41040 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.614+0000 7f0507a5a640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55887ff41040 0x558880041520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f04fea58640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03ec03c780 0x7f03ec03ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04f0000c00 tx=0x7f04f00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f0507a5a640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55887ff41040 0x558880041520 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f0507a5a640 1 -- 172.21.15.145:0/387909157 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f050000a4d0 con 0x55887ff41040 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x558880042420 0x558880044810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558880044e00 con 0x558880042420 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f0507259640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x558880042420 0x558880044810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.615+0000 7f0507259640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x558880042420 0x558880044810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f0507259640 1 -- 172.21.15.145:0/387909157 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04f807a030 con 0x558880042420 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800466b0 con 0x55887ff41040 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f0507a5a640 1 -- 172.21.15.145:0/387909157 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f050000a4d0 con 0x55887ff41040 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800458e0 con 0x558880042420 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f0507259640 1 -- 172.21.15.145:0/387909157 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04f807a030 con 0x558880042420 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x558880047a60 0x558880049e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888004a390 con 0x558880047a60 2024-09-10T04:50:31.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.616+0000 7f04fea58640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x558880047a60 0x558880049e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f04fea58640 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x558880047a60 0x558880049e50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f04fea58640 1 -- 172.21.15.145:0/387909157 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04f000f670 con 0x558880047a60 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f050bc0e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.617+0000 7f050bc0e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55887fe37a00 con 0x558880057ee0 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55678/0 (socket says 172.21.15.145:55678) 2024-09-10T04:50:31.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f0507259640 1 -- 172.21.15.145:0/51017335 learned_addr learned my addr 172.21.15.145:0/51017335 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f0507259640 1 -- 172.21.15.145:0/51017335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558880058940 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f0507259640 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f04f8096340 tx=0x7f04f8073e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f03f1602640 1 -- 172.21.15.145:0/51017335 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f80687b0 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f03f1602640 1 -- 172.21.15.145:0/51017335 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f809c070 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558880059170 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f03f1602640 1 -- 172.21.15.145:0/51017335 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f805cc70 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.618+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558880059710 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.619+0000 7f03f1602640 1 -- 172.21.15.145:0/51017335 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f04f805f930 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.619+0000 7f03f1602640 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 0x7f03e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.619+0000 7f03f1602640 1 -- 172.21.15.145:0/51017335 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04f806a080 con 0x558880057ee0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.619+0000 7f04fea58640 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 0x7f03e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f04fea58640 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 0x7f03e003ec40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55888003b580 tx=0x7f04f0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f050bc0e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f050bc0e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558880032ec0 con 0x5588800647e0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55680/0 (socket says 172.21.15.145:55680) 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f0507259640 1 -- 172.21.15.145:0/2302489739 learned_addr learned my addr 172.21.15.145:0/2302489739 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f0507259640 1 -- 172.21.15.145:0/2302489739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588800651b0 con 0x5588800647e0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f0507259640 1 --2- 172.21.15.145:0/2302489739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f04f805d010 tx=0x7f04f805d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3315178a91ed87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.620+0000 7f03eaffd640 1 -- 172.21.15.145:0/2302489739 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f80b1070 con 0x5588800647e0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f03eaffd640 1 -- 172.21.15.145:0/2302489739 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80975c0 con 0x5588800647e0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f03eaffd640 1 -- 172.21.15.145:0/2302489739 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8097400 con 0x5588800647e0 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- 172.21.15.145:0/2302489739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 msgr2=0x558880064bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2302489739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f04f805d010 tx=0x7f04f805d920 comp rx=0 tx=0).stop 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- 172.21.15.145:0/2302489739 shutdown_connections 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2302489739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x558880064bc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- 172.21.15.145:0/2302489739 >> 172.21.15.145:0/2302489739 conn(0x558880060be0 msgr2=0x55888005ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- 172.21.15.145:0/2302489739 shutdown_connections 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- 172.21.15.145:0/2302489739 wait complete. 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 Processor -- start 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.621+0000 7f050bc0e800 1 -- start start 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f050bc0e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x55888006bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f050bc0e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558880065640 con 0x5588800647e0 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x55888006bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f0507259640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x55888006bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55688/0 (socket says 172.21.15.145:55688) 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 learned_addr learned my addr 172.21.15.145:0/2287997098 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888006c1a0 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f0507259640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x55888006bc40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f04f805d010 tx=0x7f04f805ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f03e97fa640 1 -- 172.21.15.145:0/2287997098 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f80c6070 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f03e97fa640 1 -- 172.21.15.145:0/2287997098 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8097a50 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f03e97fa640 1 -- 172.21.15.145:0/2287997098 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f807e450 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.622+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55888006c1a0 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.623+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888006c1a0 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.623+0000 7f03e97fa640 1 -- 172.21.15.145:0/2287997098 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f04f80c9070 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.623+0000 7f03e97fa640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03d003c690 0x7f03d003eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f03e97fa640 1 -- 172.21.15.145:0/2287997098 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04f80bc030 con 0x5588800647e0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f04fea58640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03d003c690 0x7f03d003eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558880077190 0x558880079650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558880079da0 con 0x558880077190 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f0507a5a640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558880077190 0x558880079650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f04fea58640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03d003c690 0x7f03d003eb50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ffd0 tx=0x7f04f0023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f0507a5a640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558880077190 0x558880079650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 20 realm 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.624+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800764c0 con 0x558880077190 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007a830 con 0x558880077190 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55888007b610 0x55888007da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f0507259640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55888007b610 0x55888007da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.625+0000 7f0507259640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55888007b610 0x55888007da00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007e8d0 con 0x558880077190 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 20 searching for the correct realm 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558880080640 0x558880082a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558880083120 con 0x558880080640 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f04fea58640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558880080640 0x558880082a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f04fea58640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558880080640 0x558880082a50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.626+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558880083120 con 0x55888007b610 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507259640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f04f80cb060 0x7f04f8094720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507a5a640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f04f80cb060 0x7f04f8094720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507a5a640 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f04f80cb060 0x7f04f8094720 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f050000a4d0 con 0x7f04f80cb060 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.627+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.628+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f050000a4d0 con 0x558880077190 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x7f04f80cb060 2024-09-10T04:50:31.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.629+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0500030040 con 0x7f04f80cb060 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.630+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.631+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880077190 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.632+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0500030040 con 0x7f04f80cb060 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.633+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x558880080640 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55888007e030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.634+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007f120 con 0x558880077190 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0500030040 con 0x558880077190 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007f510 con 0x55888007b610 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007f510 con 0x7f04f80cb060 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 zone default found 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 4 Realm: () 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 zonegroup default 2024-09-10T04:50:31.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007f930 con 0x7f04f80cb060 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.635+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888007f930 con 0x558880080640 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558880084fe0 con 0x558880080640 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 20 started sync module instance, tier type = 2024-09-10T04:50:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.636+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880084480 con 0x55888007b610 2024-09-10T04:50:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.637+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.637+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94044751940000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880084480 con 0x55888007b610 2024-09-10T04:50:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.637+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880085ad0 con 0x558880077190 2024-09-10T04:50:31.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.638+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94044751940000] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.638+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.638+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94044751943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880084480 con 0x558880077190 2024-09-10T04:50:31.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.638+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880086550 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.639+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94044751943104] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.639+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.639+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94044751945824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880084480 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.639+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880087020 con 0x7f04f80cb060 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.640+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94044751945824] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.640+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.640+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94044751948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880086fe0 con 0x7f04f80cb060 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.640+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880087ad0 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.641+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94044751948560] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.642+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.642+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94044751951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880087a90 con 0x55888007b610 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.642+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800884e0 con 0x558880080640 2024-09-10T04:50:31.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.643+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.643+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94044751951264] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.643+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94044751937488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800888d0 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.643+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880089290 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.644+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94044751937488] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.644+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.644+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94044751953968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880089b30 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.644+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55888008a4f0 con 0x7f04f80cb060 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94044751953968] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94044751962656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880089b30 con 0x7f04f80cb060 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=0 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=1 2024-09-10T04:50:31.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=2 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=3 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=4 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=5 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.645+0000 7f050bc0e800 20 add_watcher() i=6 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.646+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94044751962656] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.646+0000 7f050bc0e800 20 add_watcher() i=7 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.646+0000 7f050bc0e800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.646+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55888008d910 con 0x558880077190 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.647+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.647+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94044751960144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55888008ae60 con 0x558880077190 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94044751960144] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f03bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f050bc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f050bc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f050bc0e800 5 note: GC not initialized 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.648+0000 7f03bcfe1640 20 reqs_thread_entry: start 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 20 Filter name: none 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f03367fc640 20 reqs_thread_entry: start 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c0500 con 0x558880077190 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c1920 con 0x7f04f80cb060 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.649+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c18f0 con 0x558880080640 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 4.1 4:83414aaf:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c33e0 con 0x7f04f80cb060 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 4.26 4:65ff416b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c5ff0 con 0x558880077190 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 4.34 4:2cbb4e89:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c8950 con 0x7f04f80cb060 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 4.39 4:9d1a3169:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800cb1c0 con 0x558880080640 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 4.21 4:873ed889:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800cdaa0 con 0x558880080640 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 4.34 4:2f60b1f5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800d0790 con 0x7f04f80cb060 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800d3120 con 0x558880080640 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 4.b 4:d0ab592a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800d5e70 con 0x7f04f80cb060 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 4.12 4:49fd84cd:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800cdaa0 con 0x558880077190 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.650+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 4.a 4:52f885ea:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800d5e70 con 0x55888007b610 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 4.23 4:c5314c0f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800dac80 con 0x558880080640 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(68 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(69 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(65 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(67 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(74 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(70 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(72 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(73 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(75 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.651+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800c08e0 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.652+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.652+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800c08e0 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f050bc0e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c37c0 con 0x558880077190 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f050bc0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.653+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588800c08e0 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.654+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.654+0000 7f03bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.654+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94044751960144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800c37c0 con 0x558880077190 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.656+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94044751960144] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.656+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94044751940000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880089820 con 0x55888007b610 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.657+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94044751940000] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.657+0000 7f050bc0e800 20 remove_watcher() i=0 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.657+0000 7f050bc0e800 2 removed watcher, disabling cache 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.657+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94044751943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880089820 con 0x558880077190 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.658+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94044751943104] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x558880077190 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.658+0000 7f050bc0e800 20 remove_watcher() i=1 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.658+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94044751945824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800855c0 con 0x55888007b610 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.659+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94044751945824] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.659+0000 7f050bc0e800 20 remove_watcher() i=2 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.659+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94044751948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800855c0 con 0x7f04f80cb060 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.660+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94044751948560] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.660+0000 7f050bc0e800 20 remove_watcher() i=3 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.660+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94044751951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880086b10 con 0x55888007b610 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.661+0000 7f0507259640 1 -- 172.21.15.145:0/2287997098 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94044751951264] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f80c8030 con 0x55888007b610 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.661+0000 7f050bc0e800 20 remove_watcher() i=4 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.661+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94044751937488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588800875a0 con 0x558880080640 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.662+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94044751937488] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.662+0000 7f050bc0e800 20 remove_watcher() i=5 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.662+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94044751953968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880086b10 con 0x558880080640 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.663+0000 7f04fea58640 1 -- 172.21.15.145:0/2287997098 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94044751953968] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04f0037040 con 0x558880080640 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.663+0000 7f050bc0e800 20 remove_watcher() i=6 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.663+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94044751962656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558880088030 con 0x7f04f80cb060 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94044751962656] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0500041040 con 0x7f04f80cb060 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 20 remove_watcher() i=7 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55888007b610 msgr2=0x55888007da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55888007b610 0x55888007da00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558880077190 msgr2=0x558880079650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558880077190 0x558880079650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f04f80cb060 msgr2=0x7f04f8094720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f04f80cb060 0x7f04f8094720 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558880080640 msgr2=0x558880082a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558880080640 0x558880082a50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03d003c690 msgr2=0x7f03d003eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03d003c690 0x7f03d003eb50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ffd0 tx=0x7f04f0023040 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 msgr2=0x55888006bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 --2- 172.21.15.145:0/2287997098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588800647e0 0x55888006bc40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f04f805d010 tx=0x7f04f805ec40 comp rx=0 tx=0).stop 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 reap_dead start 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f0507a5a640 1 -- 172.21.15.145:0/2287997098 reap_dead start 2024-09-10T04:50:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 shutdown_connections 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 >> 172.21.15.145:0/2287997098 conn(0x558880060be0 msgr2=0x55888005edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 shutdown_connections 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.664+0000 7f050bc0e800 1 -- 172.21.15.145:0/2287997098 wait complete. 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 msgr2=0x7f03e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 0x7f03e003ec40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55888003b580 tx=0x7f04f0006000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 msgr2=0x558880058300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f04f8096340 tx=0x7f04f8073e50 comp rx=0 tx=0).stop 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 shutdown_connections 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03e003c780 0x7f03e003ec40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/51017335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558880057ee0 0x558880058300 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 >> 172.21.15.145:0/51017335 conn(0x55888004c290 msgr2=0x55888004c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 shutdown_connections 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/51017335 wait complete. 2024-09-10T04:50:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x558880042420 msgr2=0x558880044810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x558880042420 0x558880044810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55887ff41040 msgr2=0x558880041520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55887ff41040 0x558880041520 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x558880047a60 msgr2=0x558880049e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x558880047a60 0x558880049e50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03ec03c780 msgr2=0x7f03ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f03ec03c780 0x7f03ec03ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04f0000c00 tx=0x7f04f00013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 msgr2=0x558880039ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 --2- 172.21.15.145:0/387909157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55887ff3fe00 0x558880039ed0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04f8025c20 tx=0x7f04f8002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f0507a5a640 1 -- 172.21.15.145:0/387909157 reap_dead start 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 shutdown_connections 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 >> 172.21.15.145:0/387909157 conn(0x55887ff3b1d0 msgr2=0x558880033920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 shutdown_connections 2024-09-10T04:50:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.665+0000 7f050bc0e800 1 -- 172.21.15.145:0/387909157 wait complete. 2024-09-10T04:50:31.683 INFO:teuthology.orchestra.run.smithi145.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-10T04:50:31.654409Z","last_stats_update":"2024-09-10T04:50:31.653329Z"} 2024-09-10T04:50:31.683 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-10T04:50:31.654409Z', 'last_stats_update': '2024-09-10T04:50:31.653329Z'} 2024-09-10T04:50:31.689 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.689 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T04:50:31.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T04:50:31.690 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-10T04:50:31.736 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.736 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46c352c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e44f24fe00 0x55e44f250b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46c352c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e44f0fae40 con 0x55e44f251040 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46c352c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55e44f0c5680 con 0x55e44f24fe00 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46bf2ad640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e44f24fe00 0x55e44f250b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.735+0000 7f46b7fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55e44f251040 0x55e44f255da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39198/0 (socket says 172.21.15.145:39198) 2024-09-10T04:50:31.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.736+0000 7f46b7fff640 1 -- 172.21.15.145:0/4016320884 learned_addr learned my addr 172.21.15.145:0/4016320884 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:31.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.736+0000 7f46bf2ad640 1 -- 172.21.15.145:0/4016320884 >> v1:172.21.15.98:6789/0 conn(0x55e44f251040 legacy=0x55e44f255da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.736+0000 7f46bf2ad640 1 -- 172.21.15.145:0/4016320884 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f0e16b0 con 0x55e44f24fe00 2024-09-10T04:50:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/4016320884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f250b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f46b000a470 tx=0x7f46b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80087335559edda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46beaac640 1 -- 172.21.15.145:0/4016320884 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0053570 con 0x55e44f24fe00 2024-09-10T04:50:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46beaac640 1 -- 172.21.15.145:0/4016320884 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b0058070 con 0x55e44f24fe00 2024-09-10T04:50:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46beaac640 1 -- 172.21.15.145:0/4016320884 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0053880 con 0x55e44f24fe00 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 -- 172.21.15.145:0/4016320884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 msgr2=0x55e44f250b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 --2- 172.21.15.145:0/4016320884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f250b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f46b000a470 tx=0x7f46b0045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 -- 172.21.15.145:0/4016320884 shutdown_connections 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 --2- 172.21.15.145:0/4016320884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f250b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 -- 172.21.15.145:0/4016320884 >> 172.21.15.145:0/4016320884 conn(0x55e44f24b1d0 msgr2=0x55e44f24d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 -- 172.21.15.145:0/4016320884 shutdown_connections 2024-09-10T04:50:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.738+0000 7f46c352c800 1 -- 172.21.15.145:0/4016320884 wait complete. 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.752+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.752+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.752+0000 7f46c352c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.752+0000 7f46c352c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44f0e9dd0 con 0x55e44f24fe00 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55712/0 (socket says 172.21.15.145:55712) 2024-09-10T04:50:31.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f46bf2ad640 1 -- 172.21.15.145:0/1081849693 learned_addr learned my addr 172.21.15.145:0/1081849693 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f46bf2ad640 1 -- 172.21.15.145:0/1081849693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f102e10 con 0x55e44f24fe00 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/1081849693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f46b0025c20 tx=0x7f46b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43512475fb1e37c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f45ad60a640 1 -- 172.21.15.145:0/1081849693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0053a20 con 0x55e44f24fe00 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f45ad60a640 1 -- 172.21.15.145:0/1081849693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b0063070 con 0x55e44f24fe00 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.753+0000 7f45ad60a640 1 -- 172.21.15.145:0/1081849693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0053cf0 con 0x55e44f24fe00 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- 172.21.15.145:0/1081849693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 msgr2=0x55e44f33f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 --2- 172.21.15.145:0/1081849693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f46b0025c20 tx=0x7f46b0051000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- 172.21.15.145:0/1081849693 shutdown_connections 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 --2- 172.21.15.145:0/1081849693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f33f570 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- 172.21.15.145:0/1081849693 >> 172.21.15.145:0/1081849693 conn(0x55e44f24b1d0 msgr2=0x55e44f33aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- 172.21.15.145:0/1081849693 shutdown_connections 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- 172.21.15.145:0/1081849693 wait complete. 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.754+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46c352c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f1c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46c352c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44f251730 con 0x55e44f24fe00 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f1c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f1c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55718/0 (socket says 172.21.15.145:55718) 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46bf2ad640 1 -- 172.21.15.145:0/2769844943 learned_addr learned my addr 172.21.15.145:0/2769844943 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46bf2ad640 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f1c4210 con 0x55e44f24fe00 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f1c3cd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46b0025c20 tx=0x7f46b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.755+0000 7f45abe07640 1 -- 172.21.15.145:0/2769844943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0068660 con 0x55e44f24fe00 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f45abe07640 1 -- 172.21.15.145:0/2769844943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b0068800 con 0x55e44f24fe00 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e44f34cf70 con 0x55e44f24fe00 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f45abe07640 1 -- 172.21.15.145:0/2769844943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0068ae0 con 0x55e44f24fe00 2024-09-10T04:50:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44f34d420 con 0x55e44f24fe00 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f45abe07640 1 -- 172.21.15.145:0/2769844943 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f46b0068c80 con 0x55e44f24fe00 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.756+0000 7f45abe07640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f45a403c780 0x7f45a403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f45abe07640 1 -- 172.21.15.145:0/2769844943 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f46b00981f0 con 0x55e44f24fe00 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46b7fff640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f45a403c780 0x7f45a403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f251040 0x55e44f351390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3519b0 con 0x55e44f251040 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46bfaae640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f251040 0x55e44f351390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46b7fff640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f45a403c780 0x7f45a403ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46a8001d70 tx=0x7f46a80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46bfaae640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f251040 0x55e44f351390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46bfaae640 1 -- 172.21.15.145:0/2769844943 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f251040 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f352740 0x55e44f354b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.757+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f355190 con 0x55e44f352740 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.758+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f352740 0x55e44f354b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.758+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f352740 0x55e44f354b30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.758+0000 7f46bf2ad640 1 -- 172.21.15.145:0/2769844943 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46b0051070 con 0x55e44f352740 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.758+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f356a40 con 0x55e44f251040 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46bfaae640 1 -- 172.21.15.145:0/2769844943 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f251040 2024-09-10T04:50:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f355c70 con 0x55e44f352740 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46bf2ad640 1 -- 172.21.15.145:0/2769844943 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46b0051070 con 0x55e44f352740 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e44f357df0 0x55e44f35a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f35a720 con 0x55e44f357df0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46b7fff640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e44f357df0 0x55e44f35a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.759+0000 7f46b7fff640 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e44f357df0 0x55e44f35a1e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46b7fff640 1 -- 172.21.15.145:0/2769844943 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f357df0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46c352c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46c352c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44f147a00 con 0x55e44f3682b0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55726/0 (socket says 172.21.15.145:55726) 2024-09-10T04:50:31.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.760+0000 7f46bf2ad640 1 -- 172.21.15.145:0/3744944371 learned_addr learned my addr 172.21.15.145:0/3744944371 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f46bf2ad640 1 -- 172.21.15.145:0/3744944371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f368d10 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dd40 tx=0x7f46b0055cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f45a9602640 1 -- 172.21.15.145:0/3744944371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b005ce90 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f45a9602640 1 -- 172.21.15.145:0/3744944371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b005ed10 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e44f369540 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f45a9602640 1 -- 172.21.15.145:0/3744944371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b005e420 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.761+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44f369ae0 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f45a9602640 1 -- 172.21.15.145:0/3744944371 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f46b005e5c0 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f45a9602640 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 0x7f459803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f45a9602640 1 -- 172.21.15.145:0/3744944371 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f46b0099db0 con 0x55e44f3682b0 2024-09-10T04:50:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46b7fff640 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 0x7f459803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46b7fff640 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 0x7f459803ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a800bf40 tx=0x7f46a800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46c352c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.762+0000 7f46c352c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44f33fd60 con 0x55e44f374bd0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55734/0 (socket says 172.21.15.145:55734) 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f46bf2ad640 1 -- 172.21.15.145:0/4213890982 learned_addr learned my addr 172.21.15.145:0/4213890982 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f46bf2ad640 1 -- 172.21.15.145:0/4213890982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f3755a0 con 0x55e44f374bd0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/4213890982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dcc0 tx=0x7f46b0063220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9468f76a9f692c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f45a2ffd640 1 -- 172.21.15.145:0/4213890982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0089420 con 0x55e44f374bd0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f45a2ffd640 1 -- 172.21.15.145:0/4213890982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b005e8b0 con 0x55e44f374bd0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.763+0000 7f45a2ffd640 1 -- 172.21.15.145:0/4213890982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0093d50 con 0x55e44f374bd0 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- 172.21.15.145:0/4213890982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 msgr2=0x55e44f374fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 --2- 172.21.15.145:0/4213890982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dcc0 tx=0x7f46b0063220 comp rx=0 tx=0).stop 2024-09-10T04:50:31.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- 172.21.15.145:0/4213890982 shutdown_connections 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 --2- 172.21.15.145:0/4213890982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f374fb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- 172.21.15.145:0/4213890982 >> 172.21.15.145:0/4213890982 conn(0x55e44f370fd0 msgr2=0x55e44f36f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- 172.21.15.145:0/4213890982 shutdown_connections 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- 172.21.15.145:0/4213890982 wait complete. 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 Processor -- start 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- start start 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46c352c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e44f375a30 con 0x55e44f374bd0 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46bf2ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55742/0 (socket says 172.21.15.145:55742) 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.764+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 learned_addr learned my addr 172.21.15.145:0/525455613 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f37c570 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dcc0 tx=0x7f46b006fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f45a17fa640 1 -- 172.21.15.145:0/525455613 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0061a90 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f45a17fa640 1 -- 172.21.15.145:0/525455613 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b0061c30 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e44f37c570 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f45a17fa640 1 -- 172.21.15.145:0/525455613 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b0063680 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.765+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44f37c570 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f45a17fa640 1 -- 172.21.15.145:0/525455613 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f46b0063820 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f45a17fa640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f458803c730 0x7f458803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f45a17fa640 1 -- 172.21.15.145:0/525455613 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f46b00a9030 con 0x55e44f374bd0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f46b7fff640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f458803c730 0x7f458803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f46b7fff640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f458803c730 0x7f458803ebf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c010 tx=0x7f46a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.766+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f3875a0 0x55e44f389a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38a1b0 con 0x55e44f3875a0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46bfaae640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f3875a0 0x55e44f389a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46bfaae640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f3875a0 0x55e44f389a60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 20 realm 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3868d0 con 0x55e44f3875a0 2024-09-10T04:50:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.767+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38ac40 con 0x55e44f3875a0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f38ba20 0x55e44f38de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38e470 con 0x55e44f38ba20 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f38ba20 0x55e44f38de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f38ba20 0x55e44f38de10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.768+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38ecc0 con 0x55e44f3875a0 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46c352c800 20 searching for the correct realm 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e44f390a30 0x55e44f392e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46b7fff640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e44f390a30 0x55e44f392e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46b7fff640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e44f390a30 0x55e44f392e40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.769+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bf2ad640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f46b0090c20 0x7f46b00a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f46b0090c20 0x7f46b00a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f46b0090c20 0x7f46b00a2430 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46b800a4d0 con 0x7f46b0090c20 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.770+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.771+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b800a4d0 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x7f46b0090c20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.772+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46b8030040 con 0x7f46b0090c20 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.773+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.774+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x7f46b0090c20 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x7f46b0090c20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.775+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x7f46b0090c20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.776+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b8030040 con 0x7f46b0090c20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.776+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.776+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.776+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f390a30 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393510 con 0x55e44f38ba20 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.777+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38f640 con 0x55e44f3875a0 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46b8030040 con 0x55e44f3875a0 2024-09-10T04:50:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38fee0 con 0x55e44f38ba20 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f38f280 con 0x7f46b0090c20 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 zone default found 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 4 Realm: () 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 zonegroup default 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f393990 con 0x7f46b0090c20 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.778+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3957d0 con 0x55e44f390a30 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f395e40 con 0x55e44f390a30 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 20 started sync module instance, tier type = 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.779+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f394c40 con 0x55e44f38ba20 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.780+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.780+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439070060592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f394c40 con 0x55e44f38ba20 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.780+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f396790 con 0x55e44f3875a0 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.781+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439070060592] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.782+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.782+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439070065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f394c40 con 0x55e44f3875a0 2024-09-10T04:50:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.782+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f397210 con 0x55e44f38ba20 2024-09-10T04:50:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.782+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439070065312] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.783+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.783+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439070068000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f394c40 con 0x55e44f38ba20 2024-09-10T04:50:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.783+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f397cb0 con 0x7f46b0090c20 2024-09-10T04:50:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.784+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439070068000] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.784+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.784+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439070070688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f397c70 con 0x7f46b0090c20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.784+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f398720 con 0x55e44f38ba20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.785+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439070070688] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.785+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.785+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439070058384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f398720 con 0x55e44f38ba20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.785+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f399130 con 0x55e44f390a30 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.786+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.786+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439070058384] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.786+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439070076032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f399980 con 0x55e44f390a30 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.786+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f398240 con 0x55e44f390a30 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.787+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439070076032] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.787+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.787+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439070080784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f39a7e0 con 0x55e44f390a30 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.787+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f39b090 con 0x7f46b0090c20 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439070083968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f39b930 con 0x7f46b0090c20 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439070080784] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=0 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=1 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=2 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=3 2024-09-10T04:50:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=4 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=5 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.788+0000 7f46c352c800 20 add_watcher() i=6 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439070083968] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46c352c800 20 add_watcher() i=7 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46c352c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f39a330 con 0x55e44f3875a0 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.789+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439070086192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f39a330 con 0x55e44f3875a0 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439070086192] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f4575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 5 note: GC not initialized 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f4574fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 20 Filter name: none 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f44ee7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.791+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d19f0 con 0x55e44f3875a0 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d1410 con 0x7f46b0090c20 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d5140 con 0x55e44f390a30 2024-09-10T04:50:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.792+0000 7f46c352c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.793+0000 7f46c352c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.793+0000 7f46c352c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.793+0000 7f46c352c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.793+0000 7f46c352c800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.793+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d8880 con 0x7f46b0090c20 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T04:50:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d7870 con 0x7f46b0090c20 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.794+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3dc390 con 0x7f46b0090c20 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46c352c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46c352c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46c352c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:31.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94439070334384 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3d9690 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== watch-notify(notify (1) cookie 94439070080784 notify 137438953473 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55e44f3d5530 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f45a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94439070080784 notifier 4482 bl.length()=338 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f45a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f45a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f45a2ffd640 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4584003ea0 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.795+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(68 notify.6 [notify cookie 94439070334384 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.796+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.796+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 94439070334384 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e44f3d3630 con 0x55e44f390a30 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.796+0000 7f4575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.796+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439070086192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f3875a0 2024-09-10T04:50:31.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.797+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94439070086192] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.797+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439070060592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f38ba20 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.799+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94439070060592] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.799+0000 7f46c352c800 20 remove_watcher() i=0 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.799+0000 7f46c352c800 2 removed watcher, disabling cache 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.799+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439070065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f3875a0 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.800+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94439070065312] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x55e44f3875a0 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.800+0000 7f46c352c800 20 remove_watcher() i=1 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.800+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439070068000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f38ba20 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.800+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94439070068000] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.801+0000 7f46c352c800 20 remove_watcher() i=2 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.801+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439070070688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x7f46b0090c20 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.801+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94439070070688] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.801+0000 7f46c352c800 20 remove_watcher() i=3 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.801+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439070058384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f38ba20 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.802+0000 7f46bf2ad640 1 -- 172.21.15.145:0/525455613 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94439070058384] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b0084070 con 0x55e44f38ba20 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.802+0000 7f46c352c800 20 remove_watcher() i=4 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.802+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439070076032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f390a30 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.803+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94439070076032] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.803+0000 7f46c352c800 20 remove_watcher() i=5 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.803+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439070080784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x55e44f390a30 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.804+0000 7f46b7fff640 1 -- 172.21.15.145:0/525455613 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94439070080784] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8009050 con 0x55e44f390a30 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.804+0000 7f46c352c800 20 remove_watcher() i=6 2024-09-10T04:50:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.804+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439070083968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e44f3cf850 con 0x7f46b0090c20 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94439070083968] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b8041040 con 0x7f46b0090c20 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 20 remove_watcher() i=7 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f38ba20 msgr2=0x55e44f38de10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f38ba20 0x55e44f38de10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f3875a0 msgr2=0x55e44f389a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f3875a0 0x55e44f389a60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f46b0090c20 msgr2=0x7f46b00a2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f46b0090c20 0x7f46b00a2430 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e44f390a30 msgr2=0x55e44f392e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e44f390a30 0x55e44f392e40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f458803c730 msgr2=0x7f458803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f458803c730 0x7f458803ebf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c010 tx=0x7f46a8010000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 msgr2=0x55e44f37c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46bfaae640 1 -- 172.21.15.145:0/525455613 reap_dead start 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dcc0 tx=0x7f46b006fea0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 shutdown_connections 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 --2- 172.21.15.145:0/525455613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f374bd0 0x55e44f37c010 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.805+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 >> 172.21.15.145:0/525455613 conn(0x55e44f370fd0 msgr2=0x55e44f36f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 shutdown_connections 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/525455613 wait complete. 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 msgr2=0x7f459803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 0x7f459803ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a800bf40 tx=0x7f46a800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 msgr2=0x55e44f3686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46b005dd40 tx=0x7f46b0055cf0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 shutdown_connections 2024-09-10T04:50:31.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459803c920 0x7f459803ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/3744944371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f3682b0 0x55e44f3686d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 >> 172.21.15.145:0/3744944371 conn(0x55e44f35c660 msgr2=0x55e44f35ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 shutdown_connections 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/3744944371 wait complete. 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f352740 msgr2=0x55e44f354b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e44f352740 0x55e44f354b30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f251040 msgr2=0x55e44f351390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e44f251040 0x55e44f351390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e44f357df0 msgr2=0x55e44f35a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e44f357df0 0x55e44f35a1e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f45a403c780 msgr2=0x7f45a403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f45a403c780 0x7f45a403ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46a8001d70 tx=0x7f46a80012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 msgr2=0x55e44f1c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 --2- 172.21.15.145:0/2769844943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e44f24fe00 0x55e44f1c3cd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46b0025c20 tx=0x7f46b0002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46bfaae640 1 -- 172.21.15.145:0/2769844943 reap_dead start 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 shutdown_connections 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 >> 172.21.15.145:0/2769844943 conn(0x55e44f24b1d0 msgr2=0x55e44f3396e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 shutdown_connections 2024-09-10T04:50:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.806+0000 7f46c352c800 1 -- 172.21.15.145:0/2769844943 wait complete. 2024-09-10T04:50:31.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T04:50:31.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T04:50:31.827 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T04:50:31.880 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:31.880 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:31.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.878+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.878+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b6f39800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f463c97e30 0x55f463c98b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b6f39800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f463b42e40 con 0x55f463c99070 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b6f39800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f463b0d680 con 0x55f463c97e30 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b2bc7640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f463c97e30 0x55f463c98b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b2bc7640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f463c97e30 0x55f463c98b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55756/0 (socket says 172.21.15.145:55756) 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9aa3c6640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f463c99070 0x55f463c9ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39206/0 (socket says 172.21.15.145:39206) 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/720344081 learned_addr learned my addr 172.21.15.145:0/720344081 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/720344081 >> v1:172.21.15.98:6789/0 conn(0x55f463c99070 legacy=0x55f463c9ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.879+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/720344081 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463b296b0 con 0x55f463c97e30 2024-09-10T04:50:31.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/720344081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463c98b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400a6b0 tx=0x7fe9a4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15a6b7609233538 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b23c6640 1 -- 172.21.15.145:0/720344081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a400a200 con 0x55f463c97e30 2024-09-10T04:50:31.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b23c6640 1 -- 172.21.15.145:0/720344081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a400a3a0 con 0x55f463c97e30 2024-09-10T04:50:31.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b23c6640 1 -- 172.21.15.145:0/720344081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a4008700 con 0x55f463c97e30 2024-09-10T04:50:31.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b6f39800 1 -- 172.21.15.145:0/720344081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 msgr2=0x55f463c98b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.881+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/720344081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463c98b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400a6b0 tx=0x7fe9a4047e30 comp rx=0 tx=0).stop 2024-09-10T04:50:31.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.882+0000 7fe9b6f39800 1 -- 172.21.15.145:0/720344081 shutdown_connections 2024-09-10T04:50:31.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.882+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/720344081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463c98b30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.882+0000 7fe9b6f39800 1 -- 172.21.15.145:0/720344081 >> 172.21.15.145:0/720344081 conn(0x55f463c93200 msgr2=0x55f463c95660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.882+0000 7fe9b6f39800 1 -- 172.21.15.145:0/720344081 shutdown_connections 2024-09-10T04:50:31.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.882+0000 7fe9b6f39800 1 -- 172.21.15.145:0/720344081 wait complete. 2024-09-10T04:50:31.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.895+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.895+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b6f39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b6f39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f463b31dd0 con 0x55f463c97e30 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55762/0 (socket says 172.21.15.145:55762) 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/1797047836 learned_addr learned my addr 172.21.15.145:0/1797047836 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/1797047836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463b4ae10 con 0x55f463c97e30 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/1797047836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4027c60 tx=0x7fe9a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11db22324bd80e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.896+0000 7fe8a0e09640 1 -- 172.21.15.145:0/1797047836 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a40086c0 con 0x55f463c97e30 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe8a0e09640 1 -- 172.21.15.145:0/1797047836 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a4008880 con 0x55f463c97e30 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe8a0e09640 1 -- 172.21.15.145:0/1797047836 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a4008ba0 con 0x55f463c97e30 2024-09-10T04:50:31.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 -- 172.21.15.145:0/1797047836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 msgr2=0x55f463d86510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/1797047836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4027c60 tx=0x7fe9a4051000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 -- 172.21.15.145:0/1797047836 shutdown_connections 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/1797047836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d86510 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 -- 172.21.15.145:0/1797047836 >> 172.21.15.145:0/1797047836 conn(0x55f463c93200 msgr2=0x55f463d81e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 -- 172.21.15.145:0/1797047836 shutdown_connections 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.897+0000 7fe9b6f39800 1 -- 172.21.15.145:0/1797047836 wait complete. 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b6f39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d92190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b6f39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f463c99760 con 0x55f463c97e30 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d92190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d92190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55778/0 (socket says 172.21.15.145:55778) 2024-09-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/196985198 learned_addr learned my addr 172.21.15.145:0/196985198 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463d926f0 con 0x55f463c97e30 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d92190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4062040 tx=0x7fe9a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe89f606640 1 -- 172.21.15.145:0/196985198 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a406e070 con 0x55f463c97e30 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe89f606640 1 -- 172.21.15.145:0/196985198 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a404f4c0 con 0x55f463c97e30 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f463d92980 con 0x55f463c97e30 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.898+0000 7fe89f606640 1 -- 172.21.15.145:0/196985198 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a404f7e0 con 0x55f463c97e30 2024-09-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.899+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f463d93590 con 0x55f463c97e30 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.899+0000 7fe89f606640 1 -- 172.21.15.145:0/196985198 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9a4071070 con 0x55f463c97e30 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.899+0000 7fe89f606640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe89803c780 0x7fe89803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe89f606640 1 -- 172.21.15.145:0/196985198 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe9a4065020 con 0x55f463c97e30 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe89803c780 0x7fe89803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463c99070 0x55f463d997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463d99d20 con 0x55f463c99070 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463c99070 0x55f463d997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe89803c780 0x7fe89803ec40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe99c001e30 tx=0x7fe99c001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463c99070 0x55f463d997e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b33c8640 1 -- 172.21.15.145:0/196985198 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463c99070 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.900+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463d9a5d0 0x55f463d9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.901+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463d9d1d0 con 0x55f463d9a5d0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.901+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463d9a5d0 0x55f463d9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.901+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463d9a5d0 0x55f463d9ca60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.901+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/196985198 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9a4070030 con 0x55f463d9a5d0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.901+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463d9ea80 con 0x55f463c99070 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9b33c8640 1 -- 172.21.15.145:0/196985198 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463c99070 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463d9dcb0 con 0x55f463d9a5d0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/196985198 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9a4070030 con 0x55f463d9a5d0 2024-09-10T04:50:31.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f463d9fe30 0x55f463da2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463da2760 con 0x55f463d9fe30 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f463d9fe30 0x55f463da2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.902+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f463d9fe30 0x55f463da2220 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/196985198 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe99c00bd50 con 0x55f463d9fe30 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b6f39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b6f39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f463b8fa00 con 0x55f463db02f0 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55794/0 (socket says 172.21.15.145:55794) 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.903+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2581263568 learned_addr learned my addr 172.21.15.145:0/2581263568 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2581263568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463db0d50 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4095d90 tx=0x7fe9a4007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe89ce01640 1 -- 172.21.15.145:0/2581263568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a408f180 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe89ce01640 1 -- 172.21.15.145:0/2581263568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a40971b0 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe89ce01640 1 -- 172.21.15.145:0/2581263568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a40974d0 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f463db1580 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.904+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f463db1b20 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe89ce01640 1 -- 172.21.15.145:0/2581263568 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9a4067030 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe89ce01640 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 0x7fe88c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe89ce01640 1 -- 172.21.15.145:0/2581263568 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe9a405d040 con 0x55f463db02f0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 0x7fe88c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 0x7fe88c03ebf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55f463d9ea10 tx=0x7fe99c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.905+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b6f39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b6f39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f463d86ca0 con 0x55f463dbcb70 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55800/0 (socket says 172.21.15.145:55800) 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/3345215378 learned_addr learned my addr 172.21.15.145:0/3345215378 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/3345215378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463dbd560 con 0x55f463dbcb70 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/3345215378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4074850 tx=0x7fe9a4074940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a234f30bfbc6aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe8967fc640 1 -- 172.21.15.145:0/3345215378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a40694e0 con 0x55f463dbcb70 2024-09-10T04:50:31.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe8967fc640 1 -- 172.21.15.145:0/3345215378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a40567a0 con 0x55f463dbcb70 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.906+0000 7fe8967fc640 1 -- 172.21.15.145:0/3345215378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a4069730 con 0x55f463dbcb70 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- 172.21.15.145:0/3345215378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 msgr2=0x55f463dbcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/3345215378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4074850 tx=0x7fe9a4074940 comp rx=0 tx=0).stop 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- 172.21.15.145:0/3345215378 shutdown_connections 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/3345215378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dbcf70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- 172.21.15.145:0/3345215378 >> 172.21.15.145:0/3345215378 conn(0x55f463db8f70 msgr2=0x55f463db71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- 172.21.15.145:0/3345215378 shutdown_connections 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- 172.21.15.145:0/3345215378 wait complete. 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 Processor -- start 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- start start 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b6f39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f463dbd9d0 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b2bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55814/0 (socket says 172.21.15.145:55814) 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.907+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 learned_addr learned my addr 172.21.15.145:0/2611839656 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f463dc4500 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406ab00 tx=0x7fe9a40949d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe894ff9640 1 -- 172.21.15.145:0/2611839656 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a4069730 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe894ff9640 1 -- 172.21.15.145:0/2611839656 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a4088a50 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f463dc4500 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe894ff9640 1 -- 172.21.15.145:0/2611839656 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9a40698d0 con 0x55f463dbcb70 2024-09-10T04:50:31.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.908+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f463dc4500 con 0x55f463dbcb70 2024-09-10T04:50:31.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.909+0000 7fe894ff9640 1 -- 172.21.15.145:0/2611839656 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9a40b4070 con 0x55f463dbcb70 2024-09-10T04:50:31.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.909+0000 7fe894ff9640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe87c03c730 0x7fe87c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.909+0000 7fe894ff9640 1 -- 172.21.15.145:0/2611839656 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe9a40b1070 con 0x55f463dbcb70 2024-09-10T04:50:31.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.909+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe87c03c730 0x7fe87c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe87c03c730 0x7fe87c03ebf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00fe70 tx=0x7fe99c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463dcf3c0 0x55f463dd1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd1fd0 con 0x55f463dcf3c0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463dcf3c0 0x55f463dd1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463dcf3c0 0x55f463dd1880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.910+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 realm 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dce6f0 con 0x55f463dcf3c0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd2a60 con 0x55f463dcf3c0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463dd3840 0x55f463dd5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd6290 con 0x55f463dd3840 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463dd3840 0x55f463dd5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.911+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463dd3840 0x55f463dd5c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd6ae0 con 0x55f463dcf3c0 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 20 searching for the correct realm 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f463dd8850 0x55f463ddac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f463dd8850 0x55f463ddac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.912+0000 7fe9aa3c6640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f463dd8850 0x55f463ddac80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9b2bc7640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe9a40a2040 0x7fe9a40942d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:31.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe9a40a2040 0x7fe9a40942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.913+0000 7fe9b33c8640 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe9a40a2040 0x7fe9a40942d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x7fe9a40a2040 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.914+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac00a4d0 con 0x55f463dcf3c0 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.915+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x7fe9a40a2040 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe9ac030040 con 0x7fe9a40a2040 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.916+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.917+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x7fe9a40a2040 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.918+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dcf3c0 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x7fe9a40a2040 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x7fe9a40a2040 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ac030040 con 0x7fe9a40a2040 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.919+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd8850 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.920+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb350 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd7490 con 0x55f463dcf3c0 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9ac030040 con 0x55f463dcf3c0 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd7d30 con 0x55f463dd3840 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.921+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dd70d0 con 0x7fe9a40a2040 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 zone default found 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 4 Realm: () 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:31.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 zonegroup default 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddb7d0 con 0x7fe9a40a2040 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddd630 con 0x55f463dd8850 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.922+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463dddba0 con 0x55f463dd8850 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.923+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.923+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.923+0000 7fe9b6f39800 20 started sync module instance, tier type = 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.923+0000 7fe9b6f39800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.923+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.924+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.924+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94508135862208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.924+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463dde660 con 0x55f463dcf3c0 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.925+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94508135862208] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.925+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.925+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94508135866736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x55f463dcf3c0 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.925+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddf0d0 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.926+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94508135866736] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.926+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.926+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94508135869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x55f463dd3840 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.926+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddfb90 con 0x7fe9a40a2040 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.927+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94508135869376] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.927+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.927+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94508135872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x7fe9a40a2040 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.927+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de05e0 con 0x55f463dd3840 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.928+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94508135872096] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.928+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.928+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94508135874800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463ddcaa0 con 0x55f463dd3840 2024-09-10T04:50:31.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.928+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de1020 con 0x55f463dd8850 2024-09-10T04:50:31.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.929+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.929+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94508135877488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de1870 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.929+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de2310 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.929+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94508135874800] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.930+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94508135877488] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.930+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.930+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94508135882208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de2700 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.931+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de2f50 con 0x7fe9a40a2040 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94508135882208] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94508135884544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de3340 con 0x7fe9a40a2040 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=0 2024-09-10T04:50:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=1 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=2 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=3 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=4 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=5 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=6 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94508135884544] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 20 add_watcher() i=7 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.932+0000 7fe9b6f39800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.933+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463de6370 con 0x55f463dcf3c0 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.933+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.933+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94508135886064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463de38b0 con 0x55f463dcf3c0 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.934+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94508135886064] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.934+0000 7fe8697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.934+0000 7fe9b6f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.934+0000 7fe9b6f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 5 note: GC not initialized 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe7e3fff640 20 reqs_thread_entry: start 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 20 Filter name: none 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe7e1ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:31.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463e19540 con 0x7fe9a40a2040 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 20 rados->read ofs=0 len=0 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.935+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17be0 con 0x55f463dd8850 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.936+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e184b0 con 0x7fe9a40a2040 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b6f39800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b6f39800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b6f39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94508136103936 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463e1ce80 con 0x55f463dd8850 2024-09-10T04:50:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== watch-notify(notify (1) cookie 94508135877488 notify 137438953474 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7fe99c018040 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe8967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94508135877488 notifier 4489 bl.length()=556 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe8967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe8967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(65 notify.5 [notify cookie 94508136103936 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe8967fc640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe878003ea0 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 94508136103936 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe99c009050 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.937+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e18000 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.938+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.938+0000 7fe9b6f39800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.938+0000 7fe9b6f39800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.938+0000 7fe9b6f39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.938+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94508136103936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f463e1ce80 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94508135869376 notify 137438953495 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f463db1580 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe8967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94508135869376 notifier 4489 bl.length()=177 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe8967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe8967fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe8967fc640 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe878003ea0 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [notify cookie 94508136103936 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.939+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94508136103936 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f463db0d50 con 0x55f463dd3840 2024-09-10T04:50:31.956 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T04:50:31.937918Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:31.937908Z","tags":[],"group_ids":[]} 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.940+0000 7fe8697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.940+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94508135886064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dcf3c0 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.941+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94508135886064] v32'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.941+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94508135862208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dd3840 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.942+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94508135862208] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.942+0000 7fe9b6f39800 20 remove_watcher() i=0 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.942+0000 7fe9b6f39800 2 removed watcher, disabling cache 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.942+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94508135866736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dcf3c0 2024-09-10T04:50:31.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.943+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94508135866736] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x55f463dcf3c0 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.943+0000 7fe9b6f39800 20 remove_watcher() i=1 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.943+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94508135869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dd3840 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.944+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94508135869376] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.944+0000 7fe9b6f39800 20 remove_watcher() i=2 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.944+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94508135872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x7fe9a40a2040 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.945+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94508135872096] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.945+0000 7fe9b6f39800 20 remove_watcher() i=3 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.945+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94508135874800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dd3840 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.946+0000 7fe9b2bc7640 1 -- 172.21.15.145:0/2611839656 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94508135874800] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9a40bb020 con 0x55f463dd3840 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.946+0000 7fe9b6f39800 20 remove_watcher() i=4 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.946+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94508135877488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dd8850 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.947+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94508135877488] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.947+0000 7fe9b6f39800 20 remove_watcher() i=5 2024-09-10T04:50:31.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.947+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94508135882208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x55f463dd8850 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.948+0000 7fe9aa3c6640 1 -- 172.21.15.145:0/2611839656 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94508135882208] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe99c037040 con 0x55f463dd8850 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.948+0000 7fe9b6f39800 20 remove_watcher() i=6 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.948+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94508135884544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f463e17350 con 0x7fe9a40a2040 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94508135884544] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ac041040 con 0x7fe9a40a2040 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 20 remove_watcher() i=7 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463dd3840 msgr2=0x55f463dd5c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463dd3840 0x55f463dd5c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463dcf3c0 msgr2=0x55f463dd1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463dcf3c0 0x55f463dd1880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe9a40a2040 msgr2=0x7fe9a40942d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe9a40a2040 0x7fe9a40942d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f463dd8850 msgr2=0x55f463ddac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f463dd8850 0x55f463ddac80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe87c03c730 msgr2=0x7fe87c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe87c03c730 0x7fe87c03ebf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00fe70 tx=0x7fe99c010000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 msgr2=0x55f463dc3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b33c8640 1 -- 172.21.15.145:0/2611839656 reap_dead start 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe9a406ab00 tx=0x7fe9a40949d0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 shutdown_connections 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2611839656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463dbcb70 0x55f463dc3fa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 >> 172.21.15.145:0/2611839656 conn(0x55f463db8f70 msgr2=0x55f463db7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 shutdown_connections 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.949+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2611839656 wait complete. 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 msgr2=0x7fe88c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 0x7fe88c03ebf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55f463d9ea10 tx=0x7fe99c00f000 comp rx=0 tx=0).stop 2024-09-10T04:50:31.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 msgr2=0x55f463db0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4095d90 tx=0x7fe9a4007490 comp rx=0 tx=0).stop 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 shutdown_connections 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe88c03c730 0x7fe88c03ebf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/2581263568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463db02f0 0x55f463db0710 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 >> 172.21.15.145:0/2581263568 conn(0x55f463da46a0 msgr2=0x55f463da4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 shutdown_connections 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/2581263568 wait complete. 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463d9a5d0 msgr2=0x55f463d9ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f463d9a5d0 0x55f463d9ca60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463c99070 msgr2=0x55f463d997e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f463c99070 0x55f463d997e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f463d9fe30 msgr2=0x55f463da2220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f463d9fe30 0x55f463da2220 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe89803c780 msgr2=0x7fe89803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe89803c780 0x7fe89803ec40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe99c001e30 tx=0x7fe99c001390 comp rx=0 tx=0).stop 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 msgr2=0x55f463d92190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 --2- 172.21.15.145:0/196985198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f463c97e30 0x55f463d92190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4062040 tx=0x7fe9a4002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b33c8640 1 -- 172.21.15.145:0/196985198 reap_dead start 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 shutdown_connections 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 >> 172.21.15.145:0/196985198 conn(0x55f463c93200 msgr2=0x55f463d876d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 shutdown_connections 2024-09-10T04:50:31.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:31.950+0000 7fe9b6f39800 1 -- 172.21.15.145:0/196985198 wait complete. 2024-09-10T04:50:31.968 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T04:50:31.937918Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:31.937908Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:31.973 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T04:50:31.977 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:31.978 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-10T04:50:31.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-10T04:50:31.978 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-10T04:50:32.021 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.021 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8fd3a800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55bd29d2bfc0 0x55bd29d34ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8fd3a800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd29bd5e40 con 0x55bd29d2a4a0 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8fd3a800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55bd29ba0680 con 0x55bd29d2bfc0 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8b280640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55bd29d2bfc0 0x55bd29d34ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8ba81640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55bd29d2a4a0 0x55bd29d2a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39220/0 (socket says 172.21.15.145:39220) 2024-09-10T04:50:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.020+0000 7f8e8ba81640 1 -- 172.21.15.145:0/4182425992 learned_addr learned my addr 172.21.15.145:0/4182425992 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.021+0000 7f8e8b280640 1 -- 172.21.15.145:0/4182425992 >> v1:172.21.15.98:6789/0 conn(0x55bd29d2a4a0 legacy=0x55bd29d2a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.021+0000 7f8e8aa7f640 1 -- 172.21.15.145:0/4182425992 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810505944 0 0) 0x55bd29bd5e40 con 0x55bd29d2a4a0 2024-09-10T04:50:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.021+0000 7f8e8b280640 1 -- 172.21.15.145:0/4182425992 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29bbc6b0 con 0x55bd29d2bfc0 2024-09-10T04:50:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.022+0000 7f8e8b280640 1 --2- 172.21.15.145:0/4182425992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2bfc0 0x55bd29d34ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400a470 tx=0x7f8e74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed7df90e1ce3434 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8aa7f640 1 -- 172.21.15.145:0/4182425992 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e74053570 con 0x55bd29d2bfc0 2024-09-10T04:50:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8aa7f640 1 -- 172.21.15.145:0/4182425992 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e74058070 con 0x55bd29d2bfc0 2024-09-10T04:50:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8aa7f640 1 -- 172.21.15.145:0/4182425992 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e74053880 con 0x55bd29d2bfc0 2024-09-10T04:50:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/4182425992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2bfc0 msgr2=0x55bd29d34ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/4182425992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2bfc0 0x55bd29d34ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400a470 tx=0x7f8e74045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/4182425992 shutdown_connections 2024-09-10T04:50:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/4182425992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2bfc0 0x55bd29d34ae0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/4182425992 >> 172.21.15.145:0/4182425992 conn(0x55bd29d261f0 msgr2=0x55bd29d28630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/4182425992 shutdown_connections 2024-09-10T04:50:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.023+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/4182425992 wait complete. 2024-09-10T04:50:32.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8fd3a800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8fd3a800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd29bc4dd0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55824/0 (socket says 172.21.15.145:55824) 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.037+0000 7f8e8ba81640 1 -- 172.21.15.145:0/379145682 learned_addr learned my addr 172.21.15.145:0/379145682 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.038+0000 7f8e8ba81640 1 -- 172.21.15.145:0/379145682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29bdde10 con 0x55bd29d2a4a0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.038+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/379145682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e84006fa0 tx=0x7f8e84001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5474653e79759ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.038+0000 7f8d79e0b640 1 -- 172.21.15.145:0/379145682 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84003450 con 0x55bd29d2a4a0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.038+0000 7f8d79e0b640 1 -- 172.21.15.145:0/379145682 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84003610 con 0x55bd29d2a4a0 2024-09-10T04:50:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.038+0000 7f8d79e0b640 1 -- 172.21.15.145:0/379145682 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84003970 con 0x55bd29d2a4a0 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/379145682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 msgr2=0x55bd29e1d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/379145682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e84006fa0 tx=0x7f8e84001b00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/379145682 shutdown_connections 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/379145682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e1d690 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/379145682 >> 172.21.15.145:0/379145682 conn(0x55bd29d261f0 msgr2=0x55bd29e19010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/379145682 shutdown_connections 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/379145682 wait complete. 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e24fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8fd3a800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd29d352f0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e24fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e24fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55836/0 (socket says 172.21.15.145:55836) 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.039+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3115698745 learned_addr learned my addr 172.21.15.145:0/3115698745 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29e25510 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e24fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001330 tx=0x7f8e84001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8d73fff640 1 -- 172.21.15.145:0/3115698745 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84014a10 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8d73fff640 1 -- 172.21.15.145:0/3115698745 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84014bb0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd29e257a0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8d73fff640 1 -- 172.21.15.145:0/3115698745 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e8401e3f0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.040+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd29e261a0 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8d73fff640 1 -- 172.21.15.145:0/3115698745 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e84010070 con 0x55bd29d2a4a0 2024-09-10T04:50:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8d73fff640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d7403c780 0x7f8d7403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8d73fff640 1 -- 172.21.15.145:0/3115698745 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e84018070 con 0x55bd29d2a4a0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d7403c780 0x7f8d7403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29d2bfc0 0x55bd29e2c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e2cb40 con 0x55bd29d2bfc0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.041+0000 7f8e8c282640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29d2bfc0 0x55bd29e2c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d7403c780 0x7f8d7403ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e74057000 tx=0x7f8e74052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8c282640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29d2bfc0 0x55bd29e2c600 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8c282640 1 -- 172.21.15.145:0/3115698745 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29d2bfc0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e2d3f0 0x55bd29e2f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e2fff0 con 0x55bd29e2d3f0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e2d3f0 0x55bd29e2f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.042+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e2d3f0 0x55bd29e2f880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3115698745 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e8401b070 con 0x55bd29e2d3f0 2024-09-10T04:50:32.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e318a0 con 0x55bd29d2bfc0 2024-09-10T04:50:32.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8c282640 1 -- 172.21.15.145:0/3115698745 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29d2bfc0 2024-09-10T04:50:32.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e30ad0 con 0x55bd29e2d3f0 2024-09-10T04:50:32.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3115698745 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e8401b070 con 0x55bd29e2d3f0 2024-09-10T04:50:32.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bd29e32c50 0x55bd29e35040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e35580 con 0x55bd29e32c50 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.043+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bd29e32c50 0x55bd29e35040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bd29e32c50 0x55bd29e35040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8b280640 1 -- 172.21.15.145:0/3115698745 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e74051070 con 0x55bd29e32c50 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8fd3a800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.044+0000 7f8e8fd3a800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd29c22a00 con 0x55bd29e430d0 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55848/0 (socket says 172.21.15.145:55848) 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3890316319 learned_addr learned my addr 172.21.15.145:0/3890316319 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8ba81640 1 -- 172.21.15.145:0/3890316319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29e43b30 con 0x55bd29e430d0 2024-09-10T04:50:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e84014ff0 tx=0x7f8e84028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8d717fa640 1 -- 172.21.15.145:0/3890316319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84012cc0 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8d717fa640 1 -- 172.21.15.145:0/3890316319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84037070 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd29e44360 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8d717fa640 1 -- 172.21.15.145:0/3890316319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e8404af00 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.045+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd29e44900 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.046+0000 7f8d717fa640 1 -- 172.21.15.145:0/3890316319 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e84045030 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.046+0000 7f8d717fa640 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 0x7f8d6403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.046+0000 7f8d717fa640 1 -- 172.21.15.145:0/3890316319 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e84007000 con 0x55bd29e430d0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.046+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 0x7f8d6403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8b280640 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 0x7f8d6403ebf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55bd29e26ea0 tx=0x7f8e74005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8fd3a800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8fd3a800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd29e1dee0 con 0x55bd29e4fb70 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55854/0 (socket says 172.21.15.145:55854) 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2988813420 learned_addr learned my addr 172.21.15.145:0/2988813420 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2988813420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29e50560 con 0x55bd29e4fb70 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/2988813420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8e840146d0 tx=0x7f8e84021d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7cb9299ad18528 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8d6affd640 1 -- 172.21.15.145:0/2988813420 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84063070 con 0x55bd29e4fb70 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8d6affd640 1 -- 172.21.15.145:0/2988813420 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e8403c460 con 0x55bd29e4fb70 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.047+0000 7f8d6affd640 1 -- 172.21.15.145:0/2988813420 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e8401de30 con 0x55bd29e4fb70 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2988813420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 msgr2=0x55bd29e4ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2988813420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8e840146d0 tx=0x7f8e84021d50 comp rx=0 tx=0).stop 2024-09-10T04:50:32.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2988813420 shutdown_connections 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2988813420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e4ff70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2988813420 >> 172.21.15.145:0/2988813420 conn(0x55bd29e4bf70 msgr2=0x55bd29e4a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2988813420 shutdown_connections 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2988813420 wait complete. 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 Processor -- start 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- start start 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8fd3a800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd29e509d0 con 0x55bd29e4fb70 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.048+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8ba81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55860/0 (socket says 172.21.15.145:55860) 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 learned_addr learned my addr 172.21.15.145:0/2384252345 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29e57530 con 0x55bd29e4fb70 2024-09-10T04:50:32.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e84061040 tx=0x7f8e84018eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8d697fa640 1 -- 172.21.15.145:0/2384252345 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e84063040 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8d697fa640 1 -- 172.21.15.145:0/2384252345 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e8404bb40 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8d697fa640 1 -- 172.21.15.145:0/2384252345 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e8401de30 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd29e57530 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.049+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd29e57530 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8d697fa640 1 -- 172.21.15.145:0/2384252345 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e84066070 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8d697fa640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403c780 0x7f8d5403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8d697fa640 1 -- 172.21.15.145:0/2384252345 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8e84071c90 con 0x55bd29e4fb70 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8e8b280640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403c780 0x7f8d5403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29e62560 0x55bd29e64a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.050+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e65170 con 0x55bd29e62560 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8c282640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29e62560 0x55bd29e64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8b280640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403c780 0x7f8d5403ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000c00 tx=0x7f8e74053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8c282640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29e62560 0x55bd29e64a20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29e62560 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 realm 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e61890 con 0x55bd29e62560 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29e62560 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e65c30 con 0x55bd29e62560 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29e62560 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e66a10 0x55bd29e68e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.051+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69430 con 0x55bd29e66a10 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e66a10 0x55bd29e68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e66a10 0x55bd29e68e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8fd3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29e62560 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.052+0000 7f8e8fd3a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8fd3a800 20 searching for the correct realm 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bd29e6ba40 0x55bd29e6de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6e520 con 0x55bd29e6ba40 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8b280640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bd29e6ba40 0x55bd29e6de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8b280640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bd29e6ba40 0x55bd29e6de50 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6e520 con 0x55bd29e66a10 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8ba81640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e840327a0 0x7f8e840367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.053+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6e520 con 0x7f8e840327a0 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e840327a0 0x7f8e840367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e840327a0 0x7f8e840367f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e7c0083e0 con 0x7f8e840327a0 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c0083e0 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.054+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.055+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x7f8e840327a0 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.056+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x7f8e840327a0 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.057+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.058+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x7f8e840327a0 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.059+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x7f8e840327a0 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x7f8e840327a0 2024-09-10T04:50:32.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.060+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e6ba40 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e69cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.061+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6a520 con 0x55bd29e62560 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6a910 con 0x55bd29e66a10 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6ad30 con 0x7f8e840327a0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 zone default found 2024-09-10T04:50:32.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 4 Realm: () 2024-09-10T04:50:32.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 zonegroup default 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.062+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6b160 con 0x7f8e840327a0 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e703e0 con 0x55bd29e6ba40 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e70780 con 0x55bd29e6ba40 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 started sync module instance, tier type = 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.063+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6f880 con 0x55bd29e66a10 2024-09-10T04:50:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.064+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.065+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94270940183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6f880 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.065+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e71220 con 0x55bd29e62560 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.065+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94270940183968] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.066+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.066+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94270940187952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6f880 con 0x55bd29e62560 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.066+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e71cd0 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.067+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94270940187952] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.067+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.067+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94270940181456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e71c90 con 0x55bd29e66a10 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.067+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e72740 con 0x7f8e840327a0 2024-09-10T04:50:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.068+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94270940181456] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.068+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.068+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94270940193312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e71c90 con 0x7f8e840327a0 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.068+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e73190 con 0x55bd29e66a10 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.069+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94270940193312] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.069+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.069+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94270940196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e71c90 con 0x55bd29e66a10 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.069+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e73ba0 con 0x55bd29e6ba40 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.070+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.070+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94270940198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e74440 con 0x55bd29e6ba40 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.070+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e74f30 con 0x55bd29e6ba40 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.070+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94270940196000] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.071+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.071+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94270940198640] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.071+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94270940203520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e717e0 con 0x55bd29e6ba40 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.071+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e75940 con 0x7f8e840327a0 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94270940206224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e75d60 con 0x7f8e840327a0 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=0 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=1 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=2 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=3 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=4 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=5 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94270940203520] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.072+0000 7f8e8fd3a800 20 add_watcher() i=6 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.073+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94270940206224] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.073+0000 7f8e8fd3a800 20 add_watcher() i=7 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.073+0000 7f8e8fd3a800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.073+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e73f90 con 0x55bd29e62560 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.074+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.074+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94270940207280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e73f90 con 0x55bd29e62560 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.075+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94270940207280] v32'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.075+0000 7f8d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.075+0000 7f8e8fd3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.075+0000 7f8e8fd3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.075+0000 7f8e8fd3a800 5 note: GC not initialized 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8d40fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8fd3a800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8fd3a800 20 Filter name: none 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8cba7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8fd3a800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bd29eab8b0 con 0x7f8e840327a0 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.076+0000 7f8e8fd3a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.077+0000 7f8d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.077+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94270940207280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e76240 con 0x55bd29e62560 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94270940207280] v32'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94270940183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e5fc00 con 0x55bd29e66a10 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94270940183968] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8fd3a800 20 remove_watcher() i=0 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8fd3a800 2 removed watcher, disabling cache 2024-09-10T04:50:32.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.079+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94270940187952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e6fd80 con 0x55bd29e62560 2024-09-10T04:50:32.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.080+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94270940187952] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x55bd29e62560 2024-09-10T04:50:32.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.080+0000 7f8e8fd3a800 20 remove_watcher() i=1 2024-09-10T04:50:32.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.080+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94270940181456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e70d30 con 0x55bd29e66a10 2024-09-10T04:50:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.082+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94270940181456] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.082+0000 7f8e8fd3a800 20 remove_watcher() i=2 2024-09-10T04:50:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.082+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94270940193312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e70d30 con 0x7f8e840327a0 2024-09-10T04:50:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.083+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94270940193312] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.083+0000 7f8e8fd3a800 20 remove_watcher() i=3 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.083+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94270940196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e72220 con 0x55bd29e66a10 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.084+0000 7f8e8ba81640 1 -- 172.21.15.145:0/2384252345 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94270940196000] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e84077070 con 0x55bd29e66a10 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.084+0000 7f8e8fd3a800 20 remove_watcher() i=4 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.084+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94270940198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e70d30 con 0x55bd29e6ba40 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.084+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94270940198640] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.085+0000 7f8e8fd3a800 20 remove_watcher() i=5 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.085+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94270940203520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e72ca0 con 0x55bd29e6ba40 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.085+0000 7f8e8b280640 1 -- 172.21.15.145:0/2384252345 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94270940203520] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7407c040 con 0x55bd29e6ba40 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.085+0000 7f8e8fd3a800 20 remove_watcher() i=6 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.085+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94270940206224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bd29e72220 con 0x7f8e840327a0 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.086+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94270940206224] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e7c025040 con 0x7f8e840327a0 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.086+0000 7f8e8fd3a800 20 remove_watcher() i=7 2024-09-10T04:50:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e66a10 msgr2=0x55bd29e68e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e66a10 0x55bd29e68e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29e62560 msgr2=0x55bd29e64a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29e62560 0x55bd29e64a20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e840327a0 msgr2=0x7f8e840367f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8e840327a0 0x7f8e840367f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bd29e6ba40 msgr2=0x55bd29e6de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55bd29e6ba40 0x55bd29e6de50 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403c780 msgr2=0x7f8d5403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403c780 0x7f8d5403ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000c00 tx=0x7f8e74053000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 msgr2=0x55bd29e56fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e84061040 tx=0x7f8e84018eb0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8c282640 1 -- 172.21.15.145:0/2384252345 reap_dead start 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 shutdown_connections 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/2384252345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e4fb70 0x55bd29e56fd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 >> 172.21.15.145:0/2384252345 conn(0x55bd29e4bf70 msgr2=0x55bd29e4a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 shutdown_connections 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/2384252345 wait complete. 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 msgr2=0x7f8d6403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 0x7f8d6403ebf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55bd29e26ea0 tx=0x7f8e74005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 msgr2=0x55bd29e434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e84014ff0 tx=0x7f8e84028ea0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 shutdown_connections 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d6403c730 0x7f8d6403ebf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3890316319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29e430d0 0x55bd29e434f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 >> 172.21.15.145:0/3890316319 conn(0x55bd29e37480 msgr2=0x55bd29e37860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 shutdown_connections 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.087+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3890316319 wait complete. 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e2d3f0 msgr2=0x55bd29e2f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55bd29e2d3f0 0x55bd29e2f880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29d2bfc0 msgr2=0x55bd29e2c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55bd29d2bfc0 0x55bd29e2c600 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bd29e32c50 msgr2=0x55bd29e35040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55bd29e32c50 0x55bd29e35040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d7403c780 msgr2=0x7f8d7403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d7403c780 0x7f8d7403ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e74057000 tx=0x7f8e74052000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 msgr2=0x55bd29e24fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 --2- 172.21.15.145:0/3115698745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd29d2a4a0 0x55bd29e24fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001330 tx=0x7f8e84001250 comp rx=0 tx=0).stop 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8c282640 1 -- 172.21.15.145:0/3115698745 reap_dead start 2024-09-10T04:50:32.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 shutdown_connections 2024-09-10T04:50:32.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 >> 172.21.15.145:0/3115698745 conn(0x55bd29d261f0 msgr2=0x55bd29e1e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 shutdown_connections 2024-09-10T04:50:32.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.088+0000 7f8e8fd3a800 1 -- 172.21.15.145:0/3115698745 wait complete. 2024-09-10T04:50:32.103 INFO:teuthology.orchestra.run.smithi145.stdout:{"key":"bucket:myfoo","ver":{"tag":"_kFLQ7sTQ7MA6IuW_fH31Pyg","ver":2},"mtime":"2024-09-10T04:50:31.796256Z","data":{"bucket":{"name":"myfoo","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","bucket_id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-10T04:50:30.682311Z","linked":false,"has_bucket_info":false}} 2024-09-10T04:50:32.104 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_kFLQ7sTQ7MA6IuW_fH31Pyg', 'ver': 2}, 'mtime': '2024-09-10T04:50:31.796256Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'bucket_id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-10T04:50:30.682311Z', 'linked': False, 'has_bucket_info': False}} 2024-09-10T04:50:32.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1'] 2024-09-10T04:50:32.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1'] 2024-09-10T04:50:32.104 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:32.193 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.193 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.191+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.191+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.191+0000 7f5c08e14800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a216b31e10 0x55a216b32b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.191+0000 7f5c08e14800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2169dce40 con 0x55a216b33050 2024-09-10T04:50:32.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5c08e14800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a2169a7680 con 0x55a216b31e10 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5c044cb640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a216b31e10 0x55a216b32b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5bfbcca640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55a216b33050 0x55a216b37db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39236/0 (socket says 172.21.15.145:39236) 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3728580376 learned_addr learned my addr 172.21.15.145:0/3728580376 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5c044cb640 1 -- 172.21.15.145:0/3728580376 >> v1:172.21.15.98:6789/0 conn(0x55a216b33050 legacy=0x55a216b37db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5c03cca640 1 -- 172.21.15.145:0/3728580376 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778586948 0 0) 0x55a2169dce40 con 0x55a216b33050 2024-09-10T04:50:32.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.193+0000 7f5c044cb640 1 -- 172.21.15.145:0/3728580376 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2169c36b0 con 0x55a216b31e10 2024-09-10T04:50:32.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.195+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3728580376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216b32b10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889eeaafd009fce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.195+0000 7f5c03cca640 1 -- 172.21.15.145:0/3728580376 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4053570 con 0x55a216b31e10 2024-09-10T04:50:32.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.195+0000 7f5c03cca640 1 -- 172.21.15.145:0/3728580376 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4058070 con 0x55a216b31e10 2024-09-10T04:50:32.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.195+0000 7f5c03cca640 1 -- 172.21.15.145:0/3728580376 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4053880 con 0x55a216b31e10 2024-09-10T04:50:32.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 -- 172.21.15.145:0/3728580376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 msgr2=0x55a216b32b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3728580376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216b32b10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 -- 172.21.15.145:0/3728580376 shutdown_connections 2024-09-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3728580376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216b32b10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 -- 172.21.15.145:0/3728580376 >> 172.21.15.145:0/3728580376 conn(0x55a216b2d1e0 msgr2=0x55a216b2f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 -- 172.21.15.145:0/3728580376 shutdown_connections 2024-09-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.196+0000 7f5c08e14800 1 -- 172.21.15.145:0/3728580376 wait complete. 2024-09-10T04:50:32.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.209+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.209+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c08e14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c08e14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a2169cbdd0 con 0x55a216b31e10 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55876/0 (socket says 172.21.15.145:55876) 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c044cb640 1 -- 172.21.15.145:0/2203102606 learned_addr learned my addr 172.21.15.145:0/2203102606 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c044cb640 1 -- 172.21.15.145:0/2203102606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2169e4e10 con 0x55a216b31e10 2024-09-10T04:50:32.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5c044cb640 1 --2- 172.21.15.145:0/2203102606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4025c20 tx=0x7f5bf4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7706cc70e2c0fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5af260c640 1 -- 172.21.15.145:0/2203102606 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405e2c0 con 0x55a216b31e10 2024-09-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.210+0000 7f5af260c640 1 -- 172.21.15.145:0/2203102606 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf405e8b0 con 0x55a216b31e10 2024-09-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5af260c640 1 -- 172.21.15.145:0/2203102606 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405ebd0 con 0x55a216b31e10 2024-09-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 -- 172.21.15.145:0/2203102606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 msgr2=0x55a216c21490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 --2- 172.21.15.145:0/2203102606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4025c20 tx=0x7f5bf4051000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 -- 172.21.15.145:0/2203102606 shutdown_connections 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 --2- 172.21.15.145:0/2203102606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b31e10 0x55a216c21490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 -- 172.21.15.145:0/2203102606 >> 172.21.15.145:0/2203102606 conn(0x55a216b2d1e0 msgr2=0x55a216c1ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 -- 172.21.15.145:0/2203102606 shutdown_connections 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.211+0000 7f5c08e14800 1 -- 172.21.15.145:0/2203102606 wait complete. 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c08e14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 0x55a216c27dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c08e14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a216b33740 con 0x55a216b33050 2024-09-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 0x55a216c27dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 0x55a216c27dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55886/0 (socket says 172.21.15.145:55886) 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c044cb640 1 -- 172.21.15.145:0/4035753404 learned_addr learned my addr 172.21.15.145:0/4035753404 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c044cb640 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a216c28330 con 0x55a216b33050 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.212+0000 7f5c044cb640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 0x55a216c27dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5af0e09640 1 -- 172.21.15.145:0/4035753404 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405eb90 con 0x55a216b33050 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5af0e09640 1 -- 172.21.15.145:0/4035753404 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4075070 con 0x55a216b33050 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a216c285c0 con 0x55a216b33050 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5af0e09640 1 -- 172.21.15.145:0/4035753404 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405c520 con 0x55a216b33050 2024-09-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a216c28fc0 con 0x55a216b33050 2024-09-10T04:50:32.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.213+0000 7f5af0e09640 1 -- 172.21.15.145:0/4035753404 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5bf405c6c0 con 0x55a216b33050 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5af0e09640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5aec03c780 0x7f5aec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5af0e09640 1 -- 172.21.15.145:0/4035753404 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5bf4064070 con 0x55a216b33050 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5aec03c780 0x7f5aec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c29ad0 0x55a216c2f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c2fa40 con 0x55a216c29ad0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c29ad0 0x55a216c2f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5aec03c780 0x7f5aec03ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000c00 tx=0x7f5bec0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c29ad0 0x55a216c2f420 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c04ccc640 1 -- 172.21.15.145:0/4035753404 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c29ad0 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.214+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c30810 0x55a216c32c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.215+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c33230 con 0x55a216c30810 2024-09-10T04:50:32.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.215+0000 7f5c044cb640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c30810 0x55a216c32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.215+0000 7f5c044cb640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c30810 0x55a216c32c00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.215+0000 7f5c044cb640 1 -- 172.21.15.145:0/4035753404 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bf4051070 con 0x55a216c30810 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.215+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c34ae0 con 0x55a216c29ad0 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5c04ccc640 1 -- 172.21.15.145:0/4035753404 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c29ad0 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c33d10 con 0x55a216c30810 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5c044cb640 1 -- 172.21.15.145:0/4035753404 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bf4051070 con 0x55a216c30810 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a216c35e90 0x55a216c38280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c387c0 con 0x55a216c35e90 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a216c35e90 0x55a216c38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.216+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a216c35e90 0x55a216c38280 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5bfbcca640 1 -- 172.21.15.145:0/4035753404 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bec00f670 con 0x55a216c35e90 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c08e14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c08e14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a216a29a00 con 0x55a216c46310 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55898/0 (socket says 172.21.15.145:55898) 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.217+0000 7f5c044cb640 1 -- 172.21.15.145:0/1755489621 learned_addr learned my addr 172.21.15.145:0/1755489621 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5c044cb640 1 -- 172.21.15.145:0/1755489621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a216c46d70 con 0x55a216c46310 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5c044cb640 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4097660 tx=0x7f5bf4070a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5ae9ffb640 1 -- 172.21.15.145:0/1755489621 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf406f550 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5ae9ffb640 1 -- 172.21.15.145:0/1755489621 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4090080 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a216c475a0 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5ae9ffb640 1 -- 172.21.15.145:0/1755489621 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405c9b0 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.218+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a216c47b40 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5ae9ffb640 1 -- 172.21.15.145:0/1755489621 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5bf405cb50 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5ae9ffb640 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 0x7f5adc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5ae9ffb640 1 -- 172.21.15.145:0/1755489621 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5bf409cc60 con 0x55a216c46310 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 0x7f5adc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.219+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 0x7f5adc03ec40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a216c293f0 tx=0x7f5bec006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c08e14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c08e14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a216c21c20 con 0x55a216c52bb0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55900/0 (socket says 172.21.15.145:55900) 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c044cb640 1 -- 172.21.15.145:0/3198252856 learned_addr learned my addr 172.21.15.145:0/3198252856 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c044cb640 1 -- 172.21.15.145:0/3198252856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a216c53580 con 0x55a216c52bb0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3198252856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40707d0 tx=0x7f5bf4083c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64d3990b6ca9f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5ae37fe640 1 -- 172.21.15.145:0/3198252856 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf40a0040 con 0x55a216c52bb0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5ae37fe640 1 -- 172.21.15.145:0/3198252856 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4083e40 con 0x55a216c52bb0 2024-09-10T04:50:32.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.220+0000 7f5ae37fe640 1 -- 172.21.15.145:0/3198252856 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf40839b0 con 0x55a216c52bb0 2024-09-10T04:50:32.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- 172.21.15.145:0/3198252856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 msgr2=0x55a216c52f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3198252856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40707d0 tx=0x7f5bf4083c10 comp rx=0 tx=0).stop 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- 172.21.15.145:0/3198252856 shutdown_connections 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3198252856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c52f90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- 172.21.15.145:0/3198252856 >> 172.21.15.145:0/3198252856 conn(0x55a216c4efb0 msgr2=0x55a216c4d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- 172.21.15.145:0/3198252856 shutdown_connections 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- 172.21.15.145:0/3198252856 wait complete. 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 Processor -- start 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- start start 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.221+0000 7f5c08e14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a216c53a10 con 0x55a216c52bb0 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c044cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55908/0 (socket says 172.21.15.145:55908) 2024-09-10T04:50:32.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 learned_addr learned my addr 172.21.15.145:0/3118681500 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a216c5a550 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5bf409ced0 tx=0x7f5bf406de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5ae1ffb640 1 -- 172.21.15.145:0/3118681500 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf40b3040 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5ae1ffb640 1 -- 172.21.15.145:0/3118681500 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf40be070 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a216c5a550 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5ae1ffb640 1 -- 172.21.15.145:0/3118681500 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf40a0040 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.222+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a216c5a550 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.223+0000 7f5ae1ffb640 1 -- 172.21.15.145:0/3118681500 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5bf4079410 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.223+0000 7f5ae1ffb640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ad403c780 0x7f5ad403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.223+0000 7f5ae1ffb640 1 -- 172.21.15.145:0/3118681500 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5bf4062130 con 0x55a216c52bb0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.223+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ad403c780 0x7f5ad403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ad403c780 0x7f5ad403ec40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00ffd0 tx=0x7f5bec023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c653c0 0x55a216c67880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c67fd0 con 0x55a216c653c0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c653c0 0x55a216c67880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c653c0 0x55a216c67880 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.224+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 realm 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c646f0 con 0x55a216c653c0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c68a60 con 0x55a216c653c0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c69840 0x55a216c6bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c6c290 con 0x55a216c69840 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c69840 0x55a216c6bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.225+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c69840 0x55a216c6bc30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c6cae0 con 0x55a216c653c0 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 20 searching for the correct realm 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a216c6e850 0x55a216c70c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a216c6e850 0x55a216c70c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.226+0000 7f5bfbcca640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a216c6e850 0x55a216c70c80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5c044cb640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5bf409b020 0x7f5bf40aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5bf409b020 0x7f5bf40aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.227+0000 7f5c04ccc640 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5bf409b020 0x7f5bf40aea30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf409b020 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.228+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x55a216c653c0 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.229+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x7f5bf409b020 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bfc030040 con 0x7f5bf409b020 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.230+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.231+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x7f5bf409b020 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.232+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c653c0 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x7f5bf409b020 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x7f5bf409b020 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc030040 con 0x7f5bf409b020 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.233+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c6e850 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.234+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71350 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c6d460 con 0x55a216c653c0 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc030040 con 0x55a216c653c0 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c6dd00 con 0x55a216c69840 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c6d0a0 con 0x7f5bf409b020 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 zone default found 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 4 Realm: () 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 zonegroup default 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.235+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c71810 con 0x7f5bf409b020 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c73670 con 0x55a216c6e850 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c73bb0 con 0x55a216c6e850 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 started sync module instance, tier type = 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.236+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c72ae0 con 0x55a216c69840 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.238+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.238+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94154655215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c744c0 con 0x55a216c69840 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.238+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c74d10 con 0x55a216c653c0 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.239+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94154655215312] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.239+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.239+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94154655219728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c74960 con 0x55a216c653c0 2024-09-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.239+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c75480 con 0x55a216c69840 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.240+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.240+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94154655223632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c75440 con 0x55a216c69840 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.240+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c76410 con 0x7f5bf409b020 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.240+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94154655219728] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.241+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.241+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94154655227680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c76410 con 0x7f5bf409b020 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.241+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c76e20 con 0x55a216c69840 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.241+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94154655223632] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.242+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94154655227680] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.242+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.242+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94154655220784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c76970 con 0x55a216c69840 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.242+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c776c0 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.243+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94154655220784] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.243+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.243+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94154655232528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c76970 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.243+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c78080 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.244+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94154655232528] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.245+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.245+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94154655225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c78920 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.245+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c792e0 con 0x7f5bf409b020 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94154655225792] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94154655237712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c792e0 con 0x7f5bf409b020 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=0 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=1 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=2 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=3 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=4 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=5 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.246+0000 7f5c08e14800 20 add_watcher() i=6 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94154655237712] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c08e14800 20 add_watcher() i=7 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c08e14800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216c7c6e0 con 0x55a216c653c0 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.247+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94154655240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216c79c30 con 0x55a216c653c0 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.248+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94154655240192] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5aba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 5 note: GC not initialized 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5ab97e2640 20 reqs_thread_entry: start 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 20 Filter name: none 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5a2affd640 20 reqs_thread_entry: start 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.249+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216caf790 con 0x7f5bf409b020 2024-09-10T04:50:32.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb1720 con 0x7f5bf409b020 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:32.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb3170 con 0x55a216c6e850 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.250+0000 7f5c08e14800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.251+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb77a0 con 0x7f5bf409b020 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.251+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.251+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cbd520 con 0x55a216c6e850 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c08e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c08e14800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c08e14800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c08e14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94154655479856 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb7bd0 con 0x55a216c653c0 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== watch-notify(notify (1) cookie 94154655219728 notify 137438953473 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f5bfc010c30 con 0x55a216c653c0 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5ae37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94154655219728 notifier 4503 bl.length()=760 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5ae37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5ae37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5ae37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(67 notify.1 [notify cookie 94154655479856 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.253+0000 7f5ae37fe640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ac8003ea0 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== watch-notify(notify_complete (2) cookie 94154655479856 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5bfc00d610 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c08e14800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c08e14800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c08e14800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c08e14800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.254+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb3810 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.255+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.255+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cb3810 con 0x7f5bf409b020 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5c08e14800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5c08e14800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5c08e14800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94154655479824 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a216cbc370 con 0x55a216c6e850 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== watch-notify(notify (1) cookie 94154655225792 notify 137438953475 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55a216cb26e0 con 0x55a216c6e850 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5ae37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94154655225792 notifier 4503 bl.length()=314 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5ae37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5ae37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5ae37fe640 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ac8003ea0 con 0x55a216c6e850 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 notify.6 [notify cookie 94154655479824 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.256+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 94154655479824 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5bec018040 con 0x55a216c6e850 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.257+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.257+0000 7f5aba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.257+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94154655240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c653c0 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.258+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94154655240192] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.258+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94154655215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c69840 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.259+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94154655215312] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.259+0000 7f5c08e14800 20 remove_watcher() i=0 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.259+0000 7f5c08e14800 2 removed watcher, disabling cache 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.259+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94154655219728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c653c0 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.260+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94154655219728] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x55a216c653c0 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.260+0000 7f5c08e14800 20 remove_watcher() i=1 2024-09-10T04:50:32.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.260+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94154655223632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c69840 2024-09-10T04:50:32.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.261+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94154655223632] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.261+0000 7f5c08e14800 20 remove_watcher() i=2 2024-09-10T04:50:32.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.261+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94154655227680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x7f5bf409b020 2024-09-10T04:50:32.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.262+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94154655227680] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.262+0000 7f5c08e14800 20 remove_watcher() i=3 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.262+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94154655220784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c69840 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.264+0000 7f5c044cb640 1 -- 172.21.15.145:0/3118681500 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94154655220784] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40a2070 con 0x55a216c69840 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.264+0000 7f5c08e14800 20 remove_watcher() i=4 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.264+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94154655232528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c6e850 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.265+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94154655232528] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.265+0000 7f5c08e14800 20 remove_watcher() i=5 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.265+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94154655225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x55a216c6e850 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.266+0000 7f5bfbcca640 1 -- 172.21.15.145:0/3118681500 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94154655225792] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bec037040 con 0x55a216c6e850 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.266+0000 7f5c08e14800 20 remove_watcher() i=6 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.266+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94154655237712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a216cad630 con 0x7f5bf409b020 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94154655237712] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc041040 con 0x7f5bf409b020 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 20 remove_watcher() i=7 2024-09-10T04:50:32.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c69840 msgr2=0x55a216c6bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c69840 0x55a216c6bc30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c653c0 msgr2=0x55a216c67880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c653c0 0x55a216c67880 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5bf409b020 msgr2=0x7f5bf40aea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5bf409b020 0x7f5bf40aea30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a216c6e850 msgr2=0x55a216c70c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a216c6e850 0x55a216c70c80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ad403c780 msgr2=0x7f5ad403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5ad403c780 0x7f5ad403ec40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00ffd0 tx=0x7f5bec023040 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 msgr2=0x55a216c59ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5bf409ced0 tx=0x7f5bf406de90 comp rx=0 tx=0).stop 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c04ccc640 1 -- 172.21.15.145:0/3118681500 reap_dead start 2024-09-10T04:50:32.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 shutdown_connections 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/3118681500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c52bb0 0x55a216c59ff0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 >> 172.21.15.145:0/3118681500 conn(0x55a216c4efb0 msgr2=0x55a216c4d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 shutdown_connections 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/3118681500 wait complete. 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 msgr2=0x7f5adc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 0x7f5adc03ec40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a216c293f0 tx=0x7f5bec006000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 msgr2=0x55a216c46730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4097660 tx=0x7f5bf4070a50 comp rx=0 tx=0).stop 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 shutdown_connections 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5adc03c780 0x7f5adc03ec40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 --2- 172.21.15.145:0/1755489621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216c46310 0x55a216c46730 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.267+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 >> 172.21.15.145:0/1755489621 conn(0x55a216c3a6c0 msgr2=0x55a216c3aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 shutdown_connections 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/1755489621 wait complete. 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c30810 msgr2=0x55a216c32c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a216c30810 0x55a216c32c00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c29ad0 msgr2=0x55a216c2f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a216c29ad0 0x55a216c2f420 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a216c35e90 msgr2=0x55a216c38280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a216c35e90 0x55a216c38280 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5aec03c780 msgr2=0x7f5aec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5aec03c780 0x7f5aec03ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000c00 tx=0x7f5bec0013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 msgr2=0x55a216c27dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 --2- 172.21.15.145:0/4035753404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a216b33050 0x55a216c27dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c04ccc640 1 -- 172.21.15.145:0/4035753404 reap_dead start 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 shutdown_connections 2024-09-10T04:50:32.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 >> 172.21.15.145:0/4035753404 conn(0x55a216b2d1e0 msgr2=0x55a216c226d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 shutdown_connections 2024-09-10T04:50:32.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.268+0000 7f5c08e14800 1 -- 172.21.15.145:0/4035753404 wait complete. 2024-09-10T04:50:32.281 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:32.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:32.282 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T04:50:32.326 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.326 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.325+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.325+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0327b19800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ed606b2300 0x55ed606b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0327b19800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed6055ce40 con 0x55ed606b2d30 2024-09-10T04:50:32.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0327b19800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55ed60527680 con 0x55ed606b2300 2024-09-10T04:50:32.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0325603640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ed606b2300 0x55ed606b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0324e02640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55ed606b2d30 0x55ed606b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39242/0 (socket says 172.21.15.145:39242) 2024-09-10T04:50:32.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0324e02640 1 -- 172.21.15.145:0/4125741541 learned_addr learned my addr 172.21.15.145:0/4125741541 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0325603640 1 -- 172.21.15.145:0/4125741541 >> v1:172.21.15.98:6789/0 conn(0x55ed606b2d30 legacy=0x55ed606b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.326+0000 7f0325603640 1 -- 172.21.15.145:0/4125741541 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed605436b0 con 0x55ed606b2300 2024-09-10T04:50:32.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.328+0000 7f0325603640 1 --2- 172.21.15.145:0/4125741541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed606b2700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f031800a470 tx=0x7f0318045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491de54ceefc00db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.328+0000 7f0317fff640 1 -- 172.21.15.145:0/4125741541 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318053570 con 0x55ed606b2300 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.328+0000 7f0317fff640 1 -- 172.21.15.145:0/4125741541 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318058070 con 0x55ed606b2300 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.328+0000 7f0317fff640 1 -- 172.21.15.145:0/4125741541 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318053880 con 0x55ed606b2300 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 -- 172.21.15.145:0/4125741541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 msgr2=0x55ed606b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 --2- 172.21.15.145:0/4125741541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed606b2700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f031800a470 tx=0x7f0318045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 -- 172.21.15.145:0/4125741541 shutdown_connections 2024-09-10T04:50:32.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 --2- 172.21.15.145:0/4125741541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed606b2700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 -- 172.21.15.145:0/4125741541 >> 172.21.15.145:0/4125741541 conn(0x55ed606ac920 msgr2=0x55ed606aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 -- 172.21.15.145:0/4125741541 shutdown_connections 2024-09-10T04:50:32.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.329+0000 7f0327b19800 1 -- 172.21.15.145:0/4125741541 wait complete. 2024-09-10T04:50:32.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.342+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0327b19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0327b19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ed6054bdd0 con 0x55ed606b2300 2024-09-10T04:50:32.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55930/0 (socket says 172.21.15.145:55930) 2024-09-10T04:50:32.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0325603640 1 -- 172.21.15.145:0/244645472 learned_addr learned my addr 172.21.15.145:0/244645472 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.343+0000 7f0325603640 1 -- 172.21.15.145:0/244645472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed60564e10 con 0x55ed606b2300 2024-09-10T04:50:32.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0325603640 1 --2- 172.21.15.145:0/244645472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0318025c20 tx=0x7f0318051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287ce0401ada3f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0213606640 1 -- 172.21.15.145:0/244645472 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318053a20 con 0x55ed606b2300 2024-09-10T04:50:32.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0213606640 1 -- 172.21.15.145:0/244645472 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318063070 con 0x55ed606b2300 2024-09-10T04:50:32.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0213606640 1 -- 172.21.15.145:0/244645472 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318053cf0 con 0x55ed606b2300 2024-09-10T04:50:32.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0327b19800 1 -- 172.21.15.145:0/244645472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 msgr2=0x55ed607a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0327b19800 1 --2- 172.21.15.145:0/244645472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0318025c20 tx=0x7f0318051000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0327b19800 1 -- 172.21.15.145:0/244645472 shutdown_connections 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.344+0000 7f0327b19800 1 --2- 172.21.15.145:0/244645472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a0450 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 -- 172.21.15.145:0/244645472 >> 172.21.15.145:0/244645472 conn(0x55ed606ac920 msgr2=0x55ed6079bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 -- 172.21.15.145:0/244645472 shutdown_connections 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 -- 172.21.15.145:0/244645472 wait complete. 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0327b19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ed606b0d70 con 0x55ed606b2300 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55940/0 (socket says 172.21.15.145:55940) 2024-09-10T04:50:32.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0325603640 1 -- 172.21.15.145:0/344636876 learned_addr learned my addr 172.21.15.145:0/344636876 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.345+0000 7f0325603640 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed607a8310 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0325603640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a7db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0318025c20 tx=0x7f0318002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0211e03640 1 -- 172.21.15.145:0/344636876 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318068660 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0211e03640 1 -- 172.21.15.145:0/344636876 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318068800 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0211e03640 1 -- 172.21.15.145:0/344636876 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318068ae0 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed607a85a0 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.346+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed607a91b0 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0211e03640 1 -- 172.21.15.145:0/344636876 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0318068c80 con 0x55ed606b2300 2024-09-10T04:50:32.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0211e03640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020c03c780 0x7f020c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0211e03640 1 -- 172.21.15.145:0/344636876 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f03180982b0 con 0x55ed606b2300 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0324e02640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020c03c780 0x7f020c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed606b2d30 0x55ed607af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607a9b70 con 0x55ed606b2d30 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0325e04640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed606b2d30 0x55ed607af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0324e02640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020c03c780 0x7f020c03ec40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f031c001d70 tx=0x7f031c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.347+0000 7f0325e04640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed606b2d30 0x55ed607af400 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0325e04640 1 -- 172.21.15.145:0/344636876 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed606b2d30 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607b0370 0x55ed607b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607b2dc0 con 0x55ed607b0370 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0325603640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607b0370 0x55ed607b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0325603640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607b0370 0x55ed607b2760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0325603640 1 -- 172.21.15.145:0/344636876 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0318051070 con 0x55ed607b0370 2024-09-10T04:50:32.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.348+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607b4670 con 0x55ed606b2d30 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0325e04640 1 -- 172.21.15.145:0/344636876 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed606b2d30 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607b38a0 con 0x55ed607b0370 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0325603640 1 -- 172.21.15.145:0/344636876 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0318051070 con 0x55ed607b0370 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ed607b5a20 0x55ed607b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607b8350 con 0x55ed607b5a20 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0324e02640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ed607b5a20 0x55ed607b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.349+0000 7f0324e02640 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ed607b5a20 0x55ed607b7e10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0324e02640 1 -- 172.21.15.145:0/344636876 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f031c009050 con 0x55ed607b5a20 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0327b19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0327b19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ed605a9a00 con 0x55ed607ca300 2024-09-10T04:50:32.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.350+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55946/0 (socket says 172.21.15.145:55946) 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0325603640 1 -- 172.21.15.145:0/2521610725 learned_addr learned my addr 172.21.15.145:0/2521610725 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0325603640 1 -- 172.21.15.145:0/2521610725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed607cad60 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0325603640 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f031805db10 tx=0x7f0318074f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f020affd640 1 -- 172.21.15.145:0/2521610725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031808d020 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f020affd640 1 -- 172.21.15.145:0/2521610725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318082070 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f020affd640 1 -- 172.21.15.145:0/2521610725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031805eb00 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed607cb590 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.351+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed607cbb30 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f020affd640 1 -- 172.21.15.145:0/2521610725 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f031805eca0 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f020affd640 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 0x7f020003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f020affd640 1 -- 172.21.15.145:0/2521610725 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0318099db0 con 0x55ed607ca300 2024-09-10T04:50:32.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f0324e02640 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 0x7f020003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.352+0000 7f0324e02640 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 0x7f020003ec40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f031c00bf40 tx=0x7f031c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0327b19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0327b19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ed607a0c40 con 0x55ed607d6ca0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55954/0 (socket says 172.21.15.145:55954) 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0325603640 1 -- 172.21.15.145:0/986714583 learned_addr learned my addr 172.21.15.145:0/986714583 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0325603640 1 -- 172.21.15.145:0/986714583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed607d7670 con 0x55ed607d6ca0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0325603640 1 --2- 172.21.15.145:0/986714583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f03180888b0 tx=0x7f03180883e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e7ea46e3efd8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0208ff9640 1 -- 172.21.15.145:0/986714583 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318089480 con 0x55ed607d6ca0 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0208ff9640 1 -- 172.21.15.145:0/986714583 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318002000 con 0x55ed607d6ca0 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.353+0000 7f0208ff9640 1 -- 172.21.15.145:0/986714583 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318089620 con 0x55ed607d6ca0 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- 172.21.15.145:0/986714583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 msgr2=0x55ed607d7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 --2- 172.21.15.145:0/986714583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f03180888b0 tx=0x7f03180883e0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- 172.21.15.145:0/986714583 shutdown_connections 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 --2- 172.21.15.145:0/986714583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607d7080 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- 172.21.15.145:0/986714583 >> 172.21.15.145:0/986714583 conn(0x55ed607d30a0 msgr2=0x55ed607d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- 172.21.15.145:0/986714583 shutdown_connections 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- 172.21.15.145:0/986714583 wait complete. 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 Processor -- start 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- start start 2024-09-10T04:50:32.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.354+0000 7f0327b19800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ed607d7b00 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0325603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55958/0 (socket says 172.21.15.145:55958) 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 learned_addr learned my addr 172.21.15.145:0/194549808 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed607de660 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0325603640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f031809bfb0 tx=0x7f0318096f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f01f6ffd640 1 -- 172.21.15.145:0/194549808 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03180969f0 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f01f6ffd640 1 -- 172.21.15.145:0/194549808 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318096b90 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed607de660 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f01f6ffd640 1 -- 172.21.15.145:0/194549808 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318088a30 con 0x55ed607d6ca0 2024-09-10T04:50:32.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.355+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed607de660 con 0x55ed607d6ca0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.356+0000 7f01f6ffd640 1 -- 172.21.15.145:0/194549808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f03180be020 con 0x55ed607d6ca0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.356+0000 7f01f6ffd640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f01f003c780 0x7f01f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.356+0000 7f01f6ffd640 1 -- 172.21.15.145:0/194549808 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f03180bc020 con 0x55ed607d6ca0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.356+0000 7f0324e02640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f01f003c780 0x7f01f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0324e02640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f01f003c780 0x7f01f003ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c010 tx=0x7f031c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed607e9690 0x55ed607ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607ec2a0 con 0x55ed607e9690 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0325e04640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed607e9690 0x55ed607ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.357+0000 7f0325e04640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed607e9690 0x55ed607ebb50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 realm 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607e89c0 con 0x55ed607e9690 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607ecd30 con 0x55ed607e9690 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607edb10 0x55ed607eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f0560 con 0x55ed607edb10 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.358+0000 7f0325603640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607edb10 0x55ed607eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0325603640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607edb10 0x55ed607eff00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f0db0 con 0x55ed607e9690 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 20 searching for the correct realm 2024-09-10T04:50:32.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ed607f2b20 0x55ed607f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.359+0000 7f0324e02640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ed607f2b20 0x55ed607f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0324e02640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ed607f2b20 0x55ed607f4f50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0325603640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f031805f040 0x7f031805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.360+0000 7f0325e04640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f031805f040 0x7f031805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f031805f040 0x7f031805c5e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f032000a4d0 con 0x7f031805f040 2024-09-10T04:50:32.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.361+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.362+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032000a4d0 con 0x55ed607e9690 2024-09-10T04:50:32.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x7f031805f040 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0320030040 con 0x7f031805f040 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.363+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.364+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.365+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x7f031805f040 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x7f031805f040 2024-09-10T04:50:32.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.366+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x7f031805f040 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0320030040 con 0x7f031805f040 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607f2b20 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.367+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5620 con 0x55ed607edb10 2024-09-10T04:50:32.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f1730 con 0x55ed607e9690 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0320030040 con 0x55ed607e9690 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f1fd0 con 0x55ed607edb10 2024-09-10T04:50:32.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.368+0000 7f0327b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f1370 con 0x7f031805f040 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 zone default found 2024-09-10T04:50:32.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 4 Realm: () 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 zonegroup default 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f5aa0 con 0x7f031805f040 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f7590 con 0x55ed607f2b20 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f7ab0 con 0x55ed607f2b20 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 started sync module instance, tier type = 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.369+0000 7f0327b19800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.370+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f6930 con 0x55ed607edb10 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.371+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.371+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478014574128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f6930 con 0x55ed607edb10 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.371+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f8570 con 0x55ed607e9690 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.372+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.372+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478014578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f8540 con 0x55ed607e9690 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.372+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f9540 con 0x55ed607edb10 2024-09-10T04:50:32.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.372+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94478014574128] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.373+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94478014578816] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.373+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.373+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478014581136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f9500 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.373+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f9e10 con 0x7f031805f040 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.374+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.374+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478014585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fa230 con 0x7f031805f040 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.374+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607faa80 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.374+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94478014581136] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.377+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94478014585184] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.377+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.377+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478014586240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fa650 con 0x55ed607edb10 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.377+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607faea0 con 0x55ed607f2b20 2024-09-10T04:50:32.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.378+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94478014586240] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.378+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.378+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478014587296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fb240 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.378+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fbc90 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.379+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94478014587296] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.379+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.379+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478014589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fc530 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.380+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcef0 con 0x7f031805f040 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.380+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94478014589088] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478014597696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fd310 con 0x7f031805f040 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=0 2024-09-10T04:50:32.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=1 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=2 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=3 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=4 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=5 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=6 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94478014597696] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 20 add_watcher() i=7 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.381+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed608005f0 con 0x55ed607e9690 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.382+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.382+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478014599120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fd8a0 con 0x55ed607e9690 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.383+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94478014599120] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.383+0000 7f01db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.383+0000 7f0327b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.383+0000 7f0327b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.383+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607ffdb0 con 0x55ed607edb10 2024-09-10T04:50:32.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.384+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'44 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.384+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607ffd70 con 0x7f031805f040 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.385+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.385+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed608096b0 con 0x55ed607f2b20 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.386+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.386+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed60809b60 con 0x55ed607e9690 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.388+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'119 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.388+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed60809f80 con 0x55ed607edb10 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.389+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.389+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed60809f80 con 0x55ed607f2b20 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.390+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'33 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.390+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080a530 con 0x55ed607edb10 2024-09-10T04:50:32.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.391+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.391+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080a510 con 0x55ed607e9690 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.392+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.392+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080ab80 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.393+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.393+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080ab80 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.394+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.394+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080ab80 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.395+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.395+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080ab80 con 0x55ed607f2b20 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.396+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.396+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080afc0 con 0x55ed607edb10 2024-09-10T04:50:32.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.397+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.397+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080ae90 con 0x55ed607e9690 2024-09-10T04:50:32.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.398+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.398+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b440 con 0x55ed607e9690 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.399+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'120 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.399+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b420 con 0x55ed607edb10 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.400+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.400+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b420 con 0x55ed607edb10 2024-09-10T04:50:32.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.401+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.401+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b420 con 0x55ed607f2b20 2024-09-10T04:50:32.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.402+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.403+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b420 con 0x55ed607edb10 2024-09-10T04:50:32.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.404+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.404+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b420 con 0x55ed607e9690 2024-09-10T04:50:32.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.405+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'121 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.405+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b400 con 0x55ed607edb10 2024-09-10T04:50:32.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.406+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.406+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b400 con 0x55ed607edb10 2024-09-10T04:50:32.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.407+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.407+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b440 con 0x55ed607f2b20 2024-09-10T04:50:32.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.408+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.408+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b510 con 0x55ed607edb10 2024-09-10T04:50:32.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.409+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.409+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b510 con 0x55ed607f2b20 2024-09-10T04:50:32.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.410+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.410+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b600 con 0x55ed607f2b20 2024-09-10T04:50:32.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.410+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.411+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b5c0 con 0x55ed607f2b20 2024-09-10T04:50:32.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.411+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.412+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b5e0 con 0x55ed607edb10 2024-09-10T04:50:32.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.412+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.412+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b5e0 con 0x55ed607e9690 2024-09-10T04:50:32.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.413+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.413+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b600 con 0x55ed607edb10 2024-09-10T04:50:32.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.414+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.414+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b620 con 0x55ed607e9690 2024-09-10T04:50:32.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.415+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'41 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.415+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed6080b620 con 0x7f031805f040 2024-09-10T04:50:32.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.416+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.416+0000 7f01da7e4640 20 reqs_thread_entry: start 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.416+0000 7f0327b19800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 20 Filter name: none 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f014bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed60836560 con 0x7f031805f040 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ed60838ae0 con 0x55ed607e9690 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.417+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.418+0000 7f01db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.418+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478014599120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607e5810 con 0x55ed607e9690 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.420+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94478014599120] v32'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.420+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478014574128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcfd0 con 0x55ed607edb10 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.421+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94478014574128] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.421+0000 7f0327b19800 20 remove_watcher() i=0 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.421+0000 7f0327b19800 2 removed watcher, disabling cache 2024-09-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.421+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478014578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcfd0 con 0x55ed607e9690 2024-09-10T04:50:32.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.422+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94478014578816] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x55ed607e9690 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.422+0000 7f0327b19800 20 remove_watcher() i=1 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.422+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478014581136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f8080 con 0x55ed607edb10 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.423+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94478014581136] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.423+0000 7f0327b19800 20 remove_watcher() i=2 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.423+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478014585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcfd0 con 0x7f031805f040 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.424+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94478014585184] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.424+0000 7f0327b19800 20 remove_watcher() i=3 2024-09-10T04:50:32.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.424+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478014586240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f8080 con 0x55ed607edb10 2024-09-10T04:50:32.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.425+0000 7f0325603640 1 -- 172.21.15.145:0/194549808 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94478014586240] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031808f020 con 0x55ed607edb10 2024-09-10T04:50:32.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.425+0000 7f0327b19800 20 remove_watcher() i=4 2024-09-10T04:50:32.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.425+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478014587296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcfd0 con 0x55ed607f2b20 2024-09-10T04:50:32.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.426+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94478014587296] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.426+0000 7f0327b19800 20 remove_watcher() i=5 2024-09-10T04:50:32.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.426+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478014589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607f8080 con 0x55ed607f2b20 2024-09-10T04:50:32.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.427+0000 7f0324e02640 1 -- 172.21.15.145:0/194549808 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94478014589088] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031c009050 con 0x55ed607f2b20 2024-09-10T04:50:32.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.427+0000 7f0327b19800 20 remove_watcher() i=6 2024-09-10T04:50:32.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.427+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478014597696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ed607fcfd0 con 0x7f031805f040 2024-09-10T04:50:32.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.427+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94478014597696] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0320041040 con 0x7f031805f040 2024-09-10T04:50:32.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.427+0000 7f0327b19800 20 remove_watcher() i=7 2024-09-10T04:50:32.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607edb10 msgr2=0x55ed607eff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607edb10 0x55ed607eff00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed607e9690 msgr2=0x55ed607ebb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed607e9690 0x55ed607ebb50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f031805f040 msgr2=0x7f031805c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f031805f040 0x7f031805c5e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ed607f2b20 msgr2=0x55ed607f4f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ed607f2b20 0x55ed607f4f50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f01f003c780 msgr2=0x7f01f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f01f003c780 0x7f01f003ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c010 tx=0x7f031c010000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 msgr2=0x55ed607de100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0325e04640 1 -- 172.21.15.145:0/194549808 reap_dead start 2024-09-10T04:50:32.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f031809bfb0 tx=0x7f0318096f70 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 shutdown_connections 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/194549808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607d6ca0 0x55ed607de100 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 >> 172.21.15.145:0/194549808 conn(0x55ed607d30a0 msgr2=0x55ed607d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 shutdown_connections 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/194549808 wait complete. 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 msgr2=0x7f020003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 0x7f020003ec40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f031c00bf40 tx=0x7f031c00f000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 msgr2=0x55ed607ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f031805db10 tx=0x7f0318074f60 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 shutdown_connections 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020003c780 0x7f020003ec40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 --2- 172.21.15.145:0/2521610725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed607ca300 0x55ed607ca720 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 >> 172.21.15.145:0/2521610725 conn(0x55ed607ba2a0 msgr2=0x55ed607ba680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 shutdown_connections 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.428+0000 7f0327b19800 1 -- 172.21.15.145:0/2521610725 wait complete. 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607b0370 msgr2=0x55ed607b2760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ed607b0370 0x55ed607b2760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed606b2d30 msgr2=0x55ed607af400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ed606b2d30 0x55ed607af400 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ed607b5a20 msgr2=0x55ed607b7e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ed607b5a20 0x55ed607b7e10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020c03c780 msgr2=0x7f020c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f020c03c780 0x7f020c03ec40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f031c001d70 tx=0x7f031c0012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 msgr2=0x55ed607a7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 --2- 172.21.15.145:0/344636876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ed606b2300 0x55ed607a7db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0318025c20 tx=0x7f0318002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0325e04640 1 -- 172.21.15.145:0/344636876 reap_dead start 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 shutdown_connections 2024-09-10T04:50:32.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 >> 172.21.15.145:0/344636876 conn(0x55ed606ac920 msgr2=0x55ed6079a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 shutdown_connections 2024-09-10T04:50:32.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.429+0000 7f0327b19800 1 -- 172.21.15.145:0/344636876 wait complete. 2024-09-10T04:50:32.438 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T04:50:32.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T04:50:32.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T04:50:32.439 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-10T04:50:32.486 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.486 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.485+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.485+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa0ee10800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556a3c821210 0x556a3c826db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa0ee10800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a3c6cae40 con 0x556a3c81fe00 2024-09-10T04:50:32.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa0ee10800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x556a3c695680 con 0x556a3c821210 2024-09-10T04:50:32.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa03fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556a3c821210 0x556a3c826db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa0a5bc640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x556a3c81fe00 0x556a3c820b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39256/0 (socket says 172.21.15.145:39256) 2024-09-10T04:50:32.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/422481261 learned_addr learned my addr 172.21.15.145:0/422481261 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa03fff640 1 -- 172.21.15.145:0/422481261 >> v1:172.21.15.98:6789/0 conn(0x556a3c81fe00 legacy=0x556a3c820b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.486+0000 7ffa03fff640 1 -- 172.21.15.145:0/422481261 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c6b16b0 con 0x556a3c821210 2024-09-10T04:50:32.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.488+0000 7ffa03fff640 1 --2- 172.21.15.145:0/422481261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c821210 0x556a3c826db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400a470 tx=0x7ff9f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca68d65e28037148 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.488+0000 7ffa09dbb640 1 -- 172.21.15.145:0/422481261 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4053570 con 0x556a3c821210 2024-09-10T04:50:32.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.488+0000 7ffa09dbb640 1 -- 172.21.15.145:0/422481261 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f4058070 con 0x556a3c821210 2024-09-10T04:50:32.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.488+0000 7ffa09dbb640 1 -- 172.21.15.145:0/422481261 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4053880 con 0x556a3c821210 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 -- 172.21.15.145:0/422481261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c821210 msgr2=0x556a3c826db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/422481261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c821210 0x556a3c826db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400a470 tx=0x7ff9f4045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 -- 172.21.15.145:0/422481261 shutdown_connections 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/422481261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c821210 0x556a3c826db0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 -- 172.21.15.145:0/422481261 >> 172.21.15.145:0/422481261 conn(0x556a3c81b1d0 msgr2=0x556a3c81d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 -- 172.21.15.145:0/422481261 shutdown_connections 2024-09-10T04:50:32.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.489+0000 7ffa0ee10800 1 -- 172.21.15.145:0/422481261 wait complete. 2024-09-10T04:50:32.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0ee10800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0ee10800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3c6b9dd0 con 0x556a3c81fe00 2024-09-10T04:50:32.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55976/0 (socket says 172.21.15.145:55976) 2024-09-10T04:50:32.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/3925725281 learned_addr learned my addr 172.21.15.145:0/3925725281 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.503+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/3925725281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c6d2e10 con 0x556a3c81fe00 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.504+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/3925725281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc001e40 tx=0x7ff9fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2496b0f4b01ced01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.504+0000 7ff8f8608640 1 -- 172.21.15.145:0/3925725281 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc012020 con 0x556a3c81fe00 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.504+0000 7ff8f8608640 1 -- 172.21.15.145:0/3925725281 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00e5a0 con 0x556a3c81fe00 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.504+0000 7ff8f8608640 1 -- 172.21.15.145:0/3925725281 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc00e8a0 con 0x556a3c81fe00 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3925725281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 msgr2=0x556a3c90f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/3925725281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc001e40 tx=0x7ff9fc001e70 comp rx=0 tx=0).stop 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3925725281 shutdown_connections 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/3925725281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c90f560 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3925725281 >> 172.21.15.145:0/3925725281 conn(0x556a3c81b1d0 msgr2=0x556a3c90aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3925725281 shutdown_connections 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3925725281 wait complete. 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c793d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0ee10800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3c821900 con 0x556a3c81fe00 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c793d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c793d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55978/0 (socket says 172.21.15.145:55978) 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.505+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1523655111 learned_addr learned my addr 172.21.15.145:0/1523655111 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c7942d0 con 0x556a3c81fe00 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c793d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00c010 tx=0x7ff9fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ff8f6e05640 1 -- 172.21.15.145:0/1523655111 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc012030 con 0x556a3c81fe00 2024-09-10T04:50:32.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ff8f6e05640 1 -- 172.21.15.145:0/1523655111 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0014a0 con 0x556a3c81fe00 2024-09-10T04:50:32.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3c91ac80 con 0x556a3c81fe00 2024-09-10T04:50:32.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ff8f6e05640 1 -- 172.21.15.145:0/1523655111 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc01a7a0 con 0x556a3c81fe00 2024-09-10T04:50:32.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.506+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3c91b240 con 0x556a3c81fe00 2024-09-10T04:50:32.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ff8f6e05640 1 -- 172.21.15.145:0/1523655111 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff9fc015020 con 0x556a3c81fe00 2024-09-10T04:50:32.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ff8f6e05640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8f003c780 0x7ff8f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ff8f6e05640 1 -- 172.21.15.145:0/1523655111 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff9fc020030 con 0x556a3c81fe00 2024-09-10T04:50:32.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8f003c780 0x7ff8f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c821210 0x556a3c91f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c91f7b0 con 0x556a3c821210 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c821210 0x556a3c91f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.507+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8f003c780 0x7ff8f003ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4057000 tx=0x7ff9f4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c821210 0x556a3c91f1b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0adbd640 1 -- 172.21.15.145:0/1523655111 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c821210 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c920580 0x556a3c922970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c922fb0 con 0x556a3c920580 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c920580 0x556a3c922970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.508+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c920580 0x556a3c922970 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1523655111 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9fc0187b0 con 0x556a3c920580 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c924860 con 0x556a3c821210 2024-09-10T04:50:32.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0adbd640 1 -- 172.21.15.145:0/1523655111 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c821210 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c923a90 con 0x556a3c920580 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1523655111 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9fc0187b0 con 0x556a3c920580 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556a3c925c10 0x556a3c928000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c928540 con 0x556a3c925c10 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.509+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556a3c925c10 0x556a3c928000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.510+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556a3c925c10 0x556a3c928000 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.510+0000 7ffa03fff640 1 -- 172.21.15.145:0/1523655111 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9f4051070 con 0x556a3c925c10 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.510+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.510+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0ee10800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0ee10800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3c717a00 con 0x556a3c9360c0 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:55990/0 (socket says 172.21.15.145:55990) 2024-09-10T04:50:32.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1311947036 learned_addr learned my addr 172.21.15.145:0/1311947036 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/1311947036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c936b20 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc051f50 tx=0x7ff9fc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ff8effff640 1 -- 172.21.15.145:0/1311947036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc017e40 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ff8effff640 1 -- 172.21.15.145:0/1311947036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc045040 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3c937350 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ff8effff640 1 -- 172.21.15.145:0/1311947036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc018430 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.511+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3c9378f0 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.512+0000 7ff8effff640 1 -- 172.21.15.145:0/1311947036 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff9fc00cbd0 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.512+0000 7ff8effff640 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 0x7ff8e403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.512+0000 7ff8effff640 1 -- 172.21.15.145:0/1311947036 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff9fc050e90 con 0x556a3c9360c0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.512+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 0x7ff8e403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa03fff640 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 0x7ff8e403ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556a3c91c5d0 tx=0x7ff9f4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0ee10800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0ee10800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3c90fdb0 con 0x556a3c916c10 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56002/0 (socket says 172.21.15.145:56002) 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/3377525548 learned_addr learned my addr 172.21.15.145:0/3377525548 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/3377525548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c917600 con 0x556a3c916c10 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.513+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/3377525548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0499a0 tx=0x7ff9fc00d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48dc5ae9d2939c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ff8edffb640 1 -- 172.21.15.145:0/3377525548 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc00f070 con 0x556a3c916c10 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ff8edffb640 1 -- 172.21.15.145:0/3377525548 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc02d3f0 con 0x556a3c916c10 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ff8edffb640 1 -- 172.21.15.145:0/3377525548 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc00d7d0 con 0x556a3c916c10 2024-09-10T04:50:32.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3377525548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 msgr2=0x556a3c917010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/3377525548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0499a0 tx=0x7ff9fc00d5f0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3377525548 shutdown_connections 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/3377525548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c917010 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3377525548 >> 172.21.15.145:0/3377525548 conn(0x556a3c93ed10 msgr2=0x556a3c93cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3377525548 shutdown_connections 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- 172.21.15.145:0/3377525548 wait complete. 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 Processor -- start 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.514+0000 7ffa0ee10800 1 -- start start 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0ee10800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0ee10800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3c917af0 con 0x556a3c916c10 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0a5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56006/0 (socket says 172.21.15.145:56006) 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 learned_addr learned my addr 172.21.15.145:0/2370341135 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3c94c540 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0499a0 tx=0x7ff9fc00fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ff8dbfff640 1 -- 172.21.15.145:0/2370341135 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc00d7d0 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ff8dbfff640 1 -- 172.21.15.145:0/2370341135 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc049400 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ff8dbfff640 1 -- 172.21.15.145:0/2370341135 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc0495b0 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3c94c540 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.515+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3c94c540 con 0x556a3c916c10 2024-09-10T04:50:32.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.516+0000 7ff8dbfff640 1 -- 172.21.15.145:0/2370341135 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff9fc00f9b0 con 0x556a3c916c10 2024-09-10T04:50:32.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.516+0000 7ff8dbfff640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8d403c690 0x7ff8d403eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ff8dbfff640 1 -- 172.21.15.145:0/2370341135 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff9fc063070 con 0x556a3c916c10 2024-09-10T04:50:32.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa03fff640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8d403c690 0x7ff8d403eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa03fff640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8d403c690 0x7ff8d403eb50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c957590 0x556a3c959a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95a1a0 con 0x556a3c957590 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c957590 0x556a3c959a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.517+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c957590 0x556a3c959a50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 realm 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9568c0 con 0x556a3c957590 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95ac30 con 0x556a3c957590 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c95ba10 0x556a3c95de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95e460 con 0x556a3c95ba10 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.518+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c95ba10 0x556a3c95de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c95ba10 0x556a3c95de00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95ecb0 con 0x556a3c957590 2024-09-10T04:50:32.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 20 searching for the correct realm 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556a3c960a20 0x556a3c962e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.519+0000 7ffa03fff640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556a3c960a20 0x556a3c962e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa03fff640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556a3c960a20 0x556a3c962e50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa0a5bc640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff9fc017050 0x7ff9fc069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.520+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff9fc017050 0x7ff9fc069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff9fc017050 0x7ff9fc069480 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa0400a4d0 con 0x7ff9fc017050 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.521+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0400a4d0 con 0x556a3c957590 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.522+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x7ff9fc017050 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa04030040 con 0x7ff9fc017050 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.523+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.524+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x7ff9fc017050 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.525+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c957590 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x7ff9fc017050 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x7ff9fc017050 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa04030040 con 0x7ff9fc017050 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.526+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c960a20 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556a3c963520 con 0x556a3c95ba10 2024-09-10T04:50:32.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.527+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95f660 con 0x556a3c957590 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa04030040 con 0x556a3c957590 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95ff00 con 0x556a3c95ba10 2024-09-10T04:50:32.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c95f2a0 con 0x7ff9fc017050 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 zone default found 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 4 Realm: () 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 zonegroup default 2024-09-10T04:50:32.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9639e0 con 0x7ff9fc017050 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.528+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c965840 con 0x556a3c960a20 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c965d50 con 0x556a3c960a20 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 started sync module instance, tier type = 2024-09-10T04:50:32.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.529+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c964cb0 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.530+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.530+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914771378640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c964cb0 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.530+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c966810 con 0x556a3c957590 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.531+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.531+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914771383072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9667e0 con 0x556a3c957590 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.531+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914771378640] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.531+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c964840 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.532+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914771383072] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.532+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.532+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914771385344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c964840 con 0x556a3c95ba10 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.532+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c967da0 con 0x7ff9fc017050 2024-09-10T04:50:32.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.533+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.533+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914771385344] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.533+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914771388656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9681c0 con 0x7ff9fc017050 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.533+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c967310 con 0x556a3c95ba10 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.534+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914771388656] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.535+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.535+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914771389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c968130 con 0x556a3c95ba10 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.535+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c969140 con 0x556a3c960a20 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.536+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914771389712] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.536+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.536+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914771392432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9694e0 con 0x556a3c960a20 2024-09-10T04:50:32.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.536+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c969f30 con 0x556a3c960a20 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.537+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.537+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914771397152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c96a800 con 0x556a3c960a20 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.537+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c96b2b0 con 0x7ff9fc017050 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.537+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914771392432] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914771393488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c96b270 con 0x7ff9fc017050 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=0 2024-09-10T04:50:32.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=1 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=2 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=3 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=4 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=5 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914771397152] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.538+0000 7ffa0ee10800 20 add_watcher() i=6 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914771393488] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0ee10800 20 add_watcher() i=7 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0ee10800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c96a350 con 0x556a3c957590 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.539+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914771402176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c96a350 con 0x556a3c957590 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.540+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914771402176] v32'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.540+0000 7ff8c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.540+0000 7ffa0ee10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.540+0000 7ffa0ee10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 5 note: GC not initialized 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ff8bb7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 20 Filter name: none 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ff8b97fa640 20 reqs_thread_entry: start 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a1360 con 0x7ff9fc017050 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.541+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a32f0 con 0x7ff9fc017050 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a4cb0 con 0x556a3c960a20 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.542+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a83d0 con 0x556a3c957590 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.543+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T04:50:32.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a73c0 con 0x7ff9fc017050 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.544+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9abea0 con 0x7ff9fc017050 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa0ee10800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa0ee10800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa0ee10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93914771650752 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556a3c9a91a0 con 0x556a3c960a20 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== watch-notify(notify (1) cookie 93914771397152 notify 137438953476 ret 0) ==== 380+0+0 (crc 0 0 0) 0x556a3c9a50a0 con 0x556a3c960a20 2024-09-10T04:50:32.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ff8edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93914771397152 notifier 4517 bl.length()=338 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ff8edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ff8edffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ff8edffb640 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff8d0003ea0 con 0x556a3c960a20 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.545+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(68 notify.6 [notify cookie 93914771650752 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.546+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.546+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 93914771650752 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556a3c9a4220 con 0x556a3c960a20 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.546+0000 7ff8c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.546+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914771402176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c957590 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.548+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93914771402176] v32'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.548+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914771378640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c95ba10 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.549+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93914771378640] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.549+0000 7ffa0ee10800 20 remove_watcher() i=0 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.549+0000 7ffa0ee10800 2 removed watcher, disabling cache 2024-09-10T04:50:32.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.549+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914771383072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c957590 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.550+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93914771383072] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x556a3c957590 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.550+0000 7ffa0ee10800 20 remove_watcher() i=1 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.550+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914771385344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c95ba10 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.551+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93914771385344] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.551+0000 7ffa0ee10800 20 remove_watcher() i=2 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.551+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914771388656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x7ff9fc017050 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.552+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93914771388656] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.552+0000 7ffa0ee10800 20 remove_watcher() i=3 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.552+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914771389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c95ba10 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.553+0000 7ffa0a5bc640 1 -- 172.21.15.145:0/2370341135 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93914771389712] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc047070 con 0x556a3c95ba10 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.553+0000 7ffa0ee10800 20 remove_watcher() i=4 2024-09-10T04:50:32.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.553+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914771392432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c960a20 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.554+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93914771392432] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.554+0000 7ffa0ee10800 20 remove_watcher() i=5 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.554+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914771397152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x556a3c960a20 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.555+0000 7ffa03fff640 1 -- 172.21.15.145:0/2370341135 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93914771397152] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f407c040 con 0x556a3c960a20 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.555+0000 7ffa0ee10800 20 remove_watcher() i=6 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.555+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914771393488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556a3c99f220 con 0x7ff9fc017050 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93914771393488] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa04041040 con 0x7ff9fc017050 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 20 remove_watcher() i=7 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c95ba10 msgr2=0x556a3c95de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c95ba10 0x556a3c95de00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c957590 msgr2=0x556a3c959a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c957590 0x556a3c959a50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff9fc017050 msgr2=0x7ff9fc069480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff9fc017050 0x7ff9fc069480 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556a3c960a20 msgr2=0x556a3c962e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556a3c960a20 0x556a3c962e50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8d403c690 msgr2=0x7ff8d403eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8d403c690 0x7ff8d403eb50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4053000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 msgr2=0x556a3c94bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0499a0 tx=0x7ff9fc00fef0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0adbd640 1 -- 172.21.15.145:0/2370341135 reap_dead start 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 shutdown_connections 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/2370341135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c916c10 0x556a3c94bfe0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 >> 172.21.15.145:0/2370341135 conn(0x556a3c93ed10 msgr2=0x556a3c93cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 shutdown_connections 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.556+0000 7ffa0ee10800 1 -- 172.21.15.145:0/2370341135 wait complete. 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 msgr2=0x7ff8e403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 0x7ff8e403ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556a3c91c5d0 tx=0x7ff9f4005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 msgr2=0x556a3c9364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc051f50 tx=0x7ff9fc00cb60 comp rx=0 tx=0).stop 2024-09-10T04:50:32.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 shutdown_connections 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8e403c730 0x7ff8e403ebf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1311947036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c9360c0 0x556a3c9364e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 >> 172.21.15.145:0/1311947036 conn(0x556a3c92a470 msgr2=0x556a3c92a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 shutdown_connections 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1311947036 wait complete. 2024-09-10T04:50:32.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c920580 msgr2=0x556a3c922970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556a3c920580 0x556a3c922970 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c821210 msgr2=0x556a3c91f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556a3c821210 0x556a3c91f1b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556a3c925c10 msgr2=0x556a3c928000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556a3c925c10 0x556a3c928000 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8f003c780 msgr2=0x7ff8f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7ff8f003c780 0x7ff8f003ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4057000 tx=0x7ff9f4052000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 msgr2=0x556a3c793d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 --2- 172.21.15.145:0/1523655111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3c81fe00 0x556a3c793d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00c010 tx=0x7ff9fc000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0adbd640 1 -- 172.21.15.145:0/1523655111 reap_dead start 2024-09-10T04:50:32.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 shutdown_connections 2024-09-10T04:50:32.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 >> 172.21.15.145:0/1523655111 conn(0x556a3c81b1d0 msgr2=0x556a3c910840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 shutdown_connections 2024-09-10T04:50:32.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.557+0000 7ffa0ee10800 1 -- 172.21.15.145:0/1523655111 wait complete. 2024-09-10T04:50:32.576 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1'] 2024-09-10T04:50:32.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1'] 2024-09-10T04:50:32.576 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:32.625 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.625 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.624+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.624+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.624+0000 7f3b54d21800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563289a89220 0x563289a8b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.624+0000 7f3b54d21800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56328992ee40 con 0x563289a856b0 2024-09-10T04:50:32.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.624+0000 7f3b54d21800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5632898f9680 con 0x563289a89220 2024-09-10T04:50:32.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.625+0000 7f3b5020b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563289a89220 0x563289a8b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.625+0000 7f3b50a0c640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x563289a856b0 0x563289a87aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39260/0 (socket says 172.21.15.145:39260) 2024-09-10T04:50:32.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.625+0000 7f3b50a0c640 1 -- 172.21.15.145:0/165571488 learned_addr learned my addr 172.21.15.145:0/165571488 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.625+0000 7f3b5020b640 1 -- 172.21.15.145:0/165571488 >> v1:172.21.15.98:6789/0 conn(0x563289a856b0 legacy=0x563289a87aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.625+0000 7f3b5020b640 1 -- 172.21.15.145:0/165571488 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632899156b0 con 0x563289a89220 2024-09-10T04:50:32.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b5020b640 1 --2- 172.21.15.145:0/165571488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a89220 0x563289a8b6e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400a470 tx=0x7f3b44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad8733fc58cd6c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b4fa0a640 1 -- 172.21.15.145:0/165571488 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b44053570 con 0x563289a89220 2024-09-10T04:50:32.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b4fa0a640 1 -- 172.21.15.145:0/165571488 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b44058070 con 0x563289a89220 2024-09-10T04:50:32.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b4fa0a640 1 -- 172.21.15.145:0/165571488 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b44053880 con 0x563289a89220 2024-09-10T04:50:32.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b54d21800 1 -- 172.21.15.145:0/165571488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a89220 msgr2=0x563289a8b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b54d21800 1 --2- 172.21.15.145:0/165571488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a89220 0x563289a8b6e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400a470 tx=0x7f3b44045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b54d21800 1 -- 172.21.15.145:0/165571488 shutdown_connections 2024-09-10T04:50:32.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b54d21800 1 --2- 172.21.15.145:0/165571488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a89220 0x563289a8b6e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.627+0000 7f3b54d21800 1 -- 172.21.15.145:0/165571488 >> 172.21.15.145:0/165571488 conn(0x563289a7f210 msgr2=0x563289a81650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.628+0000 7f3b54d21800 1 -- 172.21.15.145:0/165571488 shutdown_connections 2024-09-10T04:50:32.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.628+0000 7f3b54d21800 1 -- 172.21.15.145:0/165571488 wait complete. 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.641+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.641+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.641+0000 7f3b54d21800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.641+0000 7f3b54d21800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56328991ddd0 con 0x563289a856b0 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56030/0 (socket says 172.21.15.145:56030) 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3b50a0c640 1 -- 172.21.15.145:0/3776402550 learned_addr learned my addr 172.21.15.145:0/3776402550 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3b50a0c640 1 -- 172.21.15.145:0/3776402550 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563289936e10 con 0x563289a856b0 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/3776402550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3b40001800 tx=0x7f3b40001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6fab3708e875eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3a3ee0d640 1 -- 172.21.15.145:0/3776402550 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40004520 con 0x563289a856b0 2024-09-10T04:50:32.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3a3ee0d640 1 -- 172.21.15.145:0/3776402550 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b400046c0 con 0x563289a856b0 2024-09-10T04:50:32.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.642+0000 7f3a3ee0d640 1 -- 172.21.15.145:0/3776402550 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b400049e0 con 0x563289a856b0 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 -- 172.21.15.145:0/3776402550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 msgr2=0x563289a84e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 --2- 172.21.15.145:0/3776402550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3b40001800 tx=0x7f3b40001cc0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 -- 172.21.15.145:0/3776402550 shutdown_connections 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 --2- 172.21.15.145:0/3776402550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289a84e20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 -- 172.21.15.145:0/3776402550 >> 172.21.15.145:0/3776402550 conn(0x563289a7f210 msgr2=0x563289b700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 -- 172.21.15.145:0/3776402550 shutdown_connections 2024-09-10T04:50:32.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 -- 172.21.15.145:0/3776402550 wait complete. 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.643+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b54d21800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289b7e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b54d21800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563289a8c060 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289b7e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289b7e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56040/0 (socket says 172.21.15.145:56040) 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b50a0c640 1 -- 172.21.15.145:0/422657531 learned_addr learned my addr 172.21.15.145:0/422657531 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b50a0c640 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563289b7e800 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289b7e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3b40000f80 tx=0x7f3b40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.644+0000 7f3a3d60a640 1 -- 172.21.15.145:0/422657531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40022020 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.645+0000 7f3a3d60a640 1 -- 172.21.15.145:0/422657531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b40014890 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.645+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563289b7ea90 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.645+0000 7f3a3d60a640 1 -- 172.21.15.145:0/422657531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40014bb0 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.645+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563289b7f490 con 0x563289a856b0 2024-09-10T04:50:32.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.645+0000 7f3a3d60a640 1 -- 172.21.15.145:0/422657531 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b40025020 con 0x563289a856b0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3a3d60a640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a3803c780 0x7f3a3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3a3d60a640 1 -- 172.21.15.145:0/422657531 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3b40018030 con 0x563289a856b0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b5020b640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a3803c780 0x7f3a3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289a89220 0x563289b858f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289b85e30 con 0x563289a89220 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b5120d640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289a89220 0x563289b858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b5020b640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a3803c780 0x7f3a3803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b44057000 tx=0x7f3b44052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b5120d640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289a89220 0x563289b858f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b5120d640 1 -- 172.21.15.145:0/422657531 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289a89220 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289b866e0 0x563289b88ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.646+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289b89310 con 0x563289b866e0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.647+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289b866e0 0x563289b88ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.647+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289b866e0 0x563289b88ba0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.647+0000 7f3b50a0c640 1 -- 172.21.15.145:0/422657531 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b4001b070 con 0x563289b866e0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.647+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289b8abc0 con 0x563289a89220 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.647+0000 7f3b5120d640 1 -- 172.21.15.145:0/422657531 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b4800a560 con 0x563289a89220 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289b89df0 con 0x563289b866e0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b50a0c640 1 -- 172.21.15.145:0/422657531 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b4001b070 con 0x563289b866e0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563289b8bf70 0x563289b8e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289b8e8a0 con 0x563289b8bf70 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b5020b640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563289b8bf70 0x563289b8e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b5020b640 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563289b8bf70 0x563289b8e360 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.648+0000 7f3b5020b640 1 -- 172.21.15.145:0/422657531 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b44051070 con 0x563289b8bf70 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b54d21800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b54d21800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56328997ba00 con 0x563289b9c420 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56056/0 (socket says 172.21.15.145:56056) 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b50a0c640 1 -- 172.21.15.145:0/2815217360 learned_addr learned my addr 172.21.15.145:0/2815217360 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.649+0000 7f3b50a0c640 1 -- 172.21.15.145:0/2815217360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563289b9ce80 con 0x563289b9c420 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006530 tx=0x7f3b40010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3a367fc640 1 -- 172.21.15.145:0/2815217360 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40045070 con 0x563289b9c420 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3a367fc640 1 -- 172.21.15.145:0/2815217360 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b40034030 con 0x563289b9c420 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563289b9d6b0 con 0x563289b9c420 2024-09-10T04:50:32.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3a367fc640 1 -- 172.21.15.145:0/2815217360 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b4004adb0 con 0x563289b9c420 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.650+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563289b9dc50 con 0x563289b9c420 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3a367fc640 1 -- 172.21.15.145:0/2815217360 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b40010070 con 0x563289b9c420 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3a367fc640 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 0x7f3a2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3a367fc640 1 -- 172.21.15.145:0/2815217360 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3b4003ac80 con 0x563289b9c420 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b5020b640 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 0x7f3a2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b5020b640 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 0x7f3a2803ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x563289b801d0 tx=0x7f3b44005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b54d21800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.651+0000 7f3b54d21800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563289a836c0 con 0x563289ba8d60 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56060/0 (socket says 172.21.15.145:56060) 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3b50a0c640 1 -- 172.21.15.145:0/2185646612 learned_addr learned my addr 172.21.15.145:0/2185646612 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3b50a0c640 1 -- 172.21.15.145:0/2185646612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563289ba9750 con 0x563289ba8d60 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/2185646612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b4001ea80 tx=0x7f3b4004baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df98af9443ff3445 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3a27fff640 1 -- 172.21.15.145:0/2185646612 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40063070 con 0x563289ba8d60 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3a27fff640 1 -- 172.21.15.145:0/2185646612 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b40046040 con 0x563289ba8d60 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.652+0000 7f3a27fff640 1 -- 172.21.15.145:0/2185646612 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b4004b510 con 0x563289ba8d60 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- 172.21.15.145:0/2185646612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 msgr2=0x563289ba9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2185646612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3b4001ea80 tx=0x7f3b4004baa0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- 172.21.15.145:0/2185646612 shutdown_connections 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2185646612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289ba9160 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- 172.21.15.145:0/2185646612 >> 172.21.15.145:0/2185646612 conn(0x563289ba5160 msgr2=0x563289ba33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- 172.21.15.145:0/2185646612 shutdown_connections 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- 172.21.15.145:0/2185646612 wait complete. 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 Processor -- start 2024-09-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- start start 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289bb0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b54d21800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563289ba9bc0 con 0x563289ba8d60 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289bb0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.653+0000 7f3b50a0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289bb0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56064/0 (socket says 172.21.15.145:56064) 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 learned_addr learned my addr 172.21.15.145:0/425044600 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563289bb06d0 con 0x563289ba8d60 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289bb0170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3b4003b000 tx=0x7f3b4004ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3a267fc640 1 -- 172.21.15.145:0/425044600 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40079070 con 0x563289ba8d60 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563289bb06d0 con 0x563289ba8d60 2024-09-10T04:50:32.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3a267fc640 1 -- 172.21.15.145:0/425044600 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b40028990 con 0x563289ba8d60 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3a267fc640 1 -- 172.21.15.145:0/425044600 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b40028e20 con 0x563289ba8d60 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.654+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563289bb06d0 con 0x563289ba8d60 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.655+0000 7f3a267fc640 1 -- 172.21.15.145:0/425044600 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b4007c070 con 0x563289ba8d60 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.655+0000 7f3a267fc640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a1c03c730 0x7f3a1c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.655+0000 7f3a267fc640 1 -- 172.21.15.145:0/425044600 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3b4007fca0 con 0x563289ba8d60 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.655+0000 7f3b5020b640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a1c03c730 0x7f3a1c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b5020b640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a1c03c730 0x7f3a1c03ebf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289bbb700 0x563289bbdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bbe310 con 0x563289bbb700 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b5120d640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289bbb700 0x563289bbdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.656+0000 7f3b5120d640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289bbb700 0x563289bbdbc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 realm 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bbaa30 con 0x563289bbb700 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bbeda0 con 0x563289bbb700 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289bbfb80 0x563289bc1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2600 con 0x563289bbfb80 2024-09-10T04:50:32.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.657+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289bbfb80 0x563289bc1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289bbfb80 0x563289bc1f70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b4007b030 con 0x563289bbfb80 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2e50 con 0x563289bbb700 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 20 searching for the correct realm 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563289bc4bc0 0x563289bc6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc76c0 con 0x563289bc4bc0 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.658+0000 7f3b5020b640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563289bc4bc0 0x563289bc6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b5020b640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563289bc4bc0 0x563289bc6ff0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc76c0 con 0x563289bbfb80 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4007b030 con 0x563289bbfb80 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b50a0c640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3b4007e060 0x7f3b4003d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc76c0 con 0x7f3b4007e060 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b5120d640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3b4007e060 0x7f3b4003d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.659+0000 7f3b5120d640 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3b4007e060 0x7f3b4003d7e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2e50 con 0x563289bbb700 2024-09-10T04:50:32.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2e50 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2e50 con 0x563289bc4bc0 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.660+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563289bc2e50 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.661+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x7f3b4007e060 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x7f3b4007e060 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.662+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bc4bc0 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bc4bc0 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.663+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bc4bc0 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.664+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x7f3b4007e060 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x7f3b4007e060 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bc4bc0 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x7f3b4007e060 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.665+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bc4bc0 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.666+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3b48026040 con 0x563289bbfb80 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc3300 con 0x563289bbb700 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc36f0 con 0x563289bbfb80 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc3b10 con 0x7f3b4007e060 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 zone default found 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 4 Realm: () 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 zonegroup default 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.667+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc3ff0 con 0x7f3b4007e060 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc9530 con 0x563289bc4bc0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bc98d0 con 0x563289bc4bc0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 started sync module instance, tier type = 2024-09-10T04:50:32.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.668+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bc89d0 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.669+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.669+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775059189184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca120 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.669+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca970 con 0x563289bbb700 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.670+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775059189184] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.670+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.670+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775059192944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca540 con 0x563289bbb700 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.670+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcb020 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.671+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775059192944] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.671+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.671+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775059196720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca540 con 0x563289bbfb80 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.672+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcbab0 con 0x7f3b4007e060 2024-09-10T04:50:32.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.672+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775059196720] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.673+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.673+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775059199360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca540 con 0x7f3b4007e060 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.673+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcc500 con 0x563289bbfb80 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.674+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.674+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775059202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcc940 con 0x563289bbfb80 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.674+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcd450 con 0x563289bc4bc0 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.674+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775059199360] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.674+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775059202064] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.675+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.675+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775059203120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bca090 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.675+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcde10 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.676+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775059203120] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.676+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.676+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775059208544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bce230 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.676+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcea80 con 0x7f3b4007e060 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775059208544] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775059210112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bce990 con 0x7f3b4007e060 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=0 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=1 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=2 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=3 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=4 2024-09-10T04:50:32.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=5 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.677+0000 7f3b54d21800 20 add_watcher() i=6 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775059210112] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b54d21800 20 add_watcher() i=7 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b54d21800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289bd1f60 con 0x563289bbb700 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.678+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775059211296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289bcf4b0 con 0x563289bbb700 2024-09-10T04:50:32.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.679+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775059211296] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.679+0000 7f3a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 5 note: GC not initialized 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3a05fe3640 20 reqs_thread_entry: start 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 20 Filter name: none 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f39777fe640 20 reqs_thread_entry: start 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.680+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289c05060 con 0x563289bbb700 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289c06ff0 con 0x7f3b4007e060 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289c08850 con 0x563289bc4bc0 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.681+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.682+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c0cf20 con 0x563289bbb700 2024-09-10T04:50:32.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.683+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.683+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c12c80 con 0x563289bc4bc0 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b54d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b54d21800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b54d21800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b54d21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94775059451664 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289c0d350 con 0x563289bbb700 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== watch-notify(notify (1) cookie 94775059192944 notify 137438953474 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f3b48008de0 con 0x563289bbb700 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94775059192944 notifier 4524 bl.length()=760 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3a27fff640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3a14003ea0 con 0x563289bbb700 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.684+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(67 notify.1 [notify cookie 94775059451664 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== watch-notify(notify_complete (2) cookie 94775059451664 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3b48027560 con 0x563289bbb700 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b54d21800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b54d21800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b54d21800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b54d21800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.685+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c11640 con 0x7f3b4007e060 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.686+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.686+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c08f10 con 0x7f3b4007e060 2024-09-10T04:50:32.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b54d21800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b54d21800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b54d21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94775059451664 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563289c11af0 con 0x563289bc4bc0 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== watch-notify(notify (1) cookie 94775059208544 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x563289c07d90 con 0x563289bc4bc0 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3a277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94775059208544 notifier 4524 bl.length()=314 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3a277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3a277fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3a277fe640 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3984003400 con 0x563289bc4bc0 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 notify.6 [notify cookie 94775059451664 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.687+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.688+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== watch-notify(notify_complete (2) cookie 94775059451664 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632899156b0 con 0x563289bc4bc0 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.688+0000 7f3a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.688+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775059211296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bbb700 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.690+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94775059211296] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.690+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775059189184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bbfb80 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.691+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94775059189184] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.691+0000 7f3b54d21800 20 remove_watcher() i=0 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.691+0000 7f3b54d21800 2 removed watcher, disabling cache 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.691+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775059192944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bbb700 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.691+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94775059192944] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x563289bbb700 2024-09-10T04:50:32.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.692+0000 7f3b54d21800 20 remove_watcher() i=1 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.692+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775059196720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bbfb80 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.693+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94775059196720] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.693+0000 7f3b54d21800 20 remove_watcher() i=2 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.693+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775059199360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x7f3b4007e060 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.694+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94775059199360] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.694+0000 7f3b54d21800 20 remove_watcher() i=3 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.694+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775059202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bbfb80 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.695+0000 7f3b50a0c640 1 -- 172.21.15.145:0/425044600 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94775059202064] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4008d040 con 0x563289bbfb80 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.695+0000 7f3b54d21800 20 remove_watcher() i=4 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.695+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775059203120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bc4bc0 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.696+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94775059203120] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.696+0000 7f3b54d21800 20 remove_watcher() i=5 2024-09-10T04:50:32.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.696+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775059208544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x563289bc4bc0 2024-09-10T04:50:32.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.697+0000 7f3b5020b640 1 -- 172.21.15.145:0/425044600 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94775059208544] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4407c040 con 0x563289bc4bc0 2024-09-10T04:50:32.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.697+0000 7f3b54d21800 20 remove_watcher() i=6 2024-09-10T04:50:32.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.697+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775059210112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563289c02f00 con 0x7f3b4007e060 2024-09-10T04:50:32.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94775059210112] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b4800a560 con 0x7f3b4007e060 2024-09-10T04:50:32.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 20 remove_watcher() i=7 2024-09-10T04:50:32.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289bbfb80 msgr2=0x563289bc1f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289bbfb80 0x563289bc1f70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289bbb700 msgr2=0x563289bbdbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289bbb700 0x563289bbdbc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3b4007e060 msgr2=0x7f3b4003d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3b4007e060 0x7f3b4003d7e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563289bc4bc0 msgr2=0x563289bc6ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563289bc4bc0 0x563289bc6ff0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a1c03c730 msgr2=0x7f3a1c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a1c03c730 0x7f3a1c03ebf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44053000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 msgr2=0x563289bb0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 --2- 172.21.15.145:0/425044600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289ba8d60 0x563289bb0170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3b4003b000 tx=0x7f3b4004ac00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 reap_dead start 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b5120d640 1 -- 172.21.15.145:0/425044600 reap_dead start 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 shutdown_connections 2024-09-10T04:50:32.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 >> 172.21.15.145:0/425044600 conn(0x563289ba5160 msgr2=0x563289ba3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 shutdown_connections 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.698+0000 7f3b54d21800 1 -- 172.21.15.145:0/425044600 wait complete. 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 msgr2=0x7f3a2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 0x7f3a2803ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x563289b801d0 tx=0x7f3b44005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 msgr2=0x563289b9c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006530 tx=0x7f3b40010e80 comp rx=0 tx=0).stop 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 shutdown_connections 2024-09-10T04:50:32.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a2803c780 0x7f3a2803ec40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/2815217360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289b9c420 0x563289b9c840 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 >> 172.21.15.145:0/2815217360 conn(0x563289b907d0 msgr2=0x563289b90bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 shutdown_connections 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/2815217360 wait complete. 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289b866e0 msgr2=0x563289b88ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563289b866e0 0x563289b88ba0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289a89220 msgr2=0x563289b858f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563289a89220 0x563289b858f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563289b8bf70 msgr2=0x563289b8e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563289b8bf70 0x563289b8e360 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a3803c780 msgr2=0x7f3a3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3a3803c780 0x7f3a3803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b44057000 tx=0x7f3b44052000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 msgr2=0x563289b7e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 --2- 172.21.15.145:0/422657531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563289a856b0 0x563289b7e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3b40000f80 tx=0x7f3b40001250 comp rx=0 tx=0).stop 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b5120d640 1 -- 172.21.15.145:0/422657531 reap_dead start 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 shutdown_connections 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 >> 172.21.15.145:0/422657531 conn(0x563289a7f210 msgr2=0x563289b6fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 shutdown_connections 2024-09-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.699+0000 7f3b54d21800 1 -- 172.21.15.145:0/422657531 wait complete. 2024-09-10T04:50:32.714 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:32.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T04:50:32.714 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T04:50:32.759 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.759 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.758+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.758+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.758+0000 7eff8ce0f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56446029f210 0x5644602a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.758+0000 7eff8ce0f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564460148e40 con 0x56446029de00 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.758+0000 7eff8ce0f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x564460113680 con 0x56446029f210 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.759+0000 7eff83fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56446029f210 0x5644602a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.759+0000 7eff8a8f9640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x56446029de00 0x56446029eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39276/0 (socket says 172.21.15.145:39276) 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.759+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1766881875 learned_addr learned my addr 172.21.15.145:0/1766881875 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.759+0000 7eff83fff640 1 -- 172.21.15.145:0/1766881875 >> v1:172.21.15.98:6789/0 conn(0x56446029de00 legacy=0x56446029eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.759+0000 7eff83fff640 1 -- 172.21.15.145:0/1766881875 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446012f6b0 con 0x56446029f210 2024-09-10T04:50:32.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.761+0000 7eff83fff640 1 --2- 172.21.15.145:0/1766881875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029f210 0x5644602a4db0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7eff7400a470 tx=0x7eff74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718713edf040497e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.761+0000 7eff8a0f8640 1 -- 172.21.15.145:0/1766881875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff74053570 con 0x56446029f210 2024-09-10T04:50:32.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.761+0000 7eff8a0f8640 1 -- 172.21.15.145:0/1766881875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff74058070 con 0x56446029f210 2024-09-10T04:50:32.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.761+0000 7eff8a0f8640 1 -- 172.21.15.145:0/1766881875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff74053880 con 0x56446029f210 2024-09-10T04:50:32.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1766881875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029f210 msgr2=0x5644602a4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1766881875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029f210 0x5644602a4db0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7eff7400a470 tx=0x7eff74045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:32.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1766881875 shutdown_connections 2024-09-10T04:50:32.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1766881875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029f210 0x5644602a4db0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1766881875 >> 172.21.15.145:0/1766881875 conn(0x5644602991f0 msgr2=0x56446029b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1766881875 shutdown_connections 2024-09-10T04:50:32.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.762+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1766881875 wait complete. 2024-09-10T04:50:32.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.775+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.775+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.775+0000 7eff8ce0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.775+0000 7eff8ce0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564460137dd0 con 0x56446029de00 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56088/0 (socket says 172.21.15.145:56088) 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2422964747 learned_addr learned my addr 172.21.15.145:0/2422964747 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2422964747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564460150e10 con 0x56446029de00 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/2422964747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff7c001e40 tx=0x7eff7c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a332b0e01d35b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7efe78e09640 1 -- 172.21.15.145:0/2422964747 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c012020 con 0x56446029de00 2024-09-10T04:50:32.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.776+0000 7efe78e09640 1 -- 172.21.15.145:0/2422964747 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c00e5a0 con 0x56446029de00 2024-09-10T04:50:32.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7efe78e09640 1 -- 172.21.15.145:0/2422964747 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c00e8a0 con 0x56446029de00 2024-09-10T04:50:32.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2422964747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 msgr2=0x5644602125d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2422964747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff7c001e40 tx=0x7eff7c001e70 comp rx=0 tx=0).stop 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2422964747 shutdown_connections 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2422964747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x5644602125d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2422964747 >> 172.21.15.145:0/2422964747 conn(0x5644602991f0 msgr2=0x564460388ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2422964747 shutdown_connections 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.777+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2422964747 wait complete. 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8ce0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x564460395fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8ce0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56446029f900 con 0x56446029de00 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x564460395fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x564460395fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56092/0 (socket says 172.21.15.145:56092) 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2747274953 learned_addr learned my addr 172.21.15.145:0/2747274953 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564460396500 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.778+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x564460395fa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c010 tx=0x7eff7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.779+0000 7efe77606640 1 -- 172.21.15.145:0/2747274953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c012030 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.779+0000 7efe77606640 1 -- 172.21.15.145:0/2747274953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c0014a0 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.779+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564460396790 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.779+0000 7efe77606640 1 -- 172.21.15.145:0/2747274953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c01a7a0 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.779+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564460397190 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7efe77606640 1 -- 172.21.15.145:0/2747274953 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7eff7c015020 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7efe77606640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe7003c780 0x7efe7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7efe77606640 1 -- 172.21.15.145:0/2747274953 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff7c020030 con 0x56446029de00 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff83fff640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe7003c780 0x7efe7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56446029f210 0x56446039d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460397d40 con 0x56446029f210 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56446029f210 0x56446039d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff83fff640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe7003c780 0x7efe7003ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff74057000 tx=0x7eff74052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.780+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56446029f210 0x56446039d5f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8b0fa640 1 -- 172.21.15.145:0/2747274953 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x56446029f210 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56446039e520 0x5644603a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603a0f40 con 0x56446039e520 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56446039e520 0x5644603a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56446039e520 0x5644603a0910 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2747274953 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff7c0187b0 con 0x56446039e520 2024-09-10T04:50:32.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.781+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603a27f0 con 0x56446029f210 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff8b0fa640 1 -- 172.21.15.145:0/2747274953 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff8400a4d0 con 0x56446029f210 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603a1a20 con 0x56446039e520 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2747274953 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff7c0187b0 con 0x56446039e520 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5644603a3ba0 0x5644603a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603a64d0 con 0x5644603a3ba0 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff83fff640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5644603a3ba0 0x5644603a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.782+0000 7eff83fff640 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5644603a3ba0 0x5644603a5f90 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff83fff640 1 -- 172.21.15.145:0/2747274953 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff74051070 con 0x5644603a3ba0 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8ce0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8ce0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564460195a00 con 0x5644603b4050 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56094/0 (socket says 172.21.15.145:56094) 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.783+0000 7eff8a8f9640 1 -- 172.21.15.145:0/3561433197 learned_addr learned my addr 172.21.15.145:0/3561433197 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7eff8a8f9640 1 -- 172.21.15.145:0/3561433197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644603b4ab0 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7eff7c051f50 tx=0x7eff7c017f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7efe74e01640 1 -- 172.21.15.145:0/3561433197 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c018430 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7efe74e01640 1 -- 172.21.15.145:0/3561433197 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c045070 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644603b52e0 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7efe74e01640 1 -- 172.21.15.145:0/3561433197 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c00c790 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.784+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644603b5880 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7efe74e01640 1 -- 172.21.15.145:0/3561433197 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7eff7c053040 con 0x5644603b4050 2024-09-10T04:50:32.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7efe74e01640 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 0x7efe6403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7efe74e01640 1 -- 172.21.15.145:0/3561433197 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff7c050e90 con 0x5644603b4050 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff83fff640 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 0x7efe6403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff83fff640 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 0x7efe6403ec40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564460397590 tx=0x7eff74005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff8ce0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.785+0000 7eff8ce0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5644603912f0 con 0x56446038d1d0 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56096/0 (socket says 172.21.15.145:56096) 2024-09-10T04:50:32.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2064144994 learned_addr learned my addr 172.21.15.145:0/2064144994 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8a8f9640 1 -- 172.21.15.145:0/2064144994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446038dbc0 con 0x56446038d1d0 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/2064144994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01a6f0 tx=0x7eff7c024900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694841c4e88c862f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7efe6e7fc640 1 -- 172.21.15.145:0/2064144994 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c064070 con 0x56446038d1d0 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7efe6e7fc640 1 -- 172.21.15.145:0/2064144994 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c05b040 con 0x56446038d1d0 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7efe6e7fc640 1 -- 172.21.15.145:0/2064144994 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c05a050 con 0x56446038d1d0 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.786+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2064144994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 msgr2=0x56446038d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2064144994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01a6f0 tx=0x7eff7c024900 comp rx=0 tx=0).stop 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2064144994 shutdown_connections 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2064144994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x56446038d5d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2064144994 >> 172.21.15.145:0/2064144994 conn(0x5644603bcd60 msgr2=0x5644603bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2064144994 shutdown_connections 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2064144994 wait complete. 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 Processor -- start 2024-09-10T04:50:32.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- start start 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x5644603c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8ce0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56446038e0b0 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x5644603c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x5644603c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56098/0 (socket says 172.21.15.145:56098) 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.787+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 learned_addr learned my addr 172.21.15.145:0/1487307890 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644603ca530 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x5644603c9fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0247d0 tx=0x7eff7c03de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7efe6cff9640 1 -- 172.21.15.145:0/1487307890 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c06d020 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7efe6cff9640 1 -- 172.21.15.145:0/1487307890 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c0163b0 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644603ca530 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7efe6cff9640 1 -- 172.21.15.145:0/1487307890 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c064040 con 0x56446038d1d0 2024-09-10T04:50:32.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.788+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644603ca530 con 0x56446038d1d0 2024-09-10T04:50:32.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.789+0000 7efe6cff9640 1 -- 172.21.15.145:0/1487307890 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7eff7c070020 con 0x56446038d1d0 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.789+0000 7efe6cff9640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe5403c780 0x7efe5403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.789+0000 7efe6cff9640 1 -- 172.21.15.145:0/1487307890 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff7c073c60 con 0x56446038d1d0 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.789+0000 7eff83fff640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe5403c780 0x7efe5403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff83fff640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe5403c780 0x7efe5403ec40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff74000c00 tx=0x7eff74053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5644603d5520 0x5644603d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603d8130 con 0x5644603d5520 2024-09-10T04:50:32.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5644603d5520 0x5644603d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5644603d5520 0x5644603d79e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 20 realm 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.790+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603d4850 con 0x5644603d5520 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603d8bc0 con 0x5644603d5520 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5644603d99a0 0x5644603dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603dc3f0 con 0x5644603d99a0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5644603d99a0 0x5644603dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.791+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5644603d99a0 0x5644603dbd90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603dcc40 con 0x5644603d5520 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 20 searching for the correct realm 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5644603de9b0 0x5644603e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff83fff640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5644603de9b0 0x5644603e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.792+0000 7eff83fff640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5644603de9b0 0x5644603e0de0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff8a8f9640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7eff7c072020 0x7eff7c069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7eff7c072020 0x7eff7c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.793+0000 7eff8b0fa640 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7eff7c072020 0x7eff7c069870 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c072020 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.794+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.795+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x7eff7c072020 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff84030040 con 0x7eff7c072020 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.796+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.797+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.798+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x7eff7c072020 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x7eff7c072020 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x7eff7c072020 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff84030040 con 0x7eff7c072020 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.799+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603de9b0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.800+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644603e14b0 con 0x5644603d99a0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603dd5f0 con 0x5644603d5520 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff84030040 con 0x5644603d5520 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.801+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603dde90 con 0x5644603d99a0 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603dd230 con 0x7eff7c072020 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 zone default found 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 4 Realm: () 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 zonegroup default 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603e1930 con 0x7eff7c072020 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603e3450 con 0x5644603de9b0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.802+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603e3910 con 0x5644603de9b0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.803+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.803+0000 7eff8ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.803+0000 7eff8ce0f800 20 started sync module instance, tier type = 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.803+0000 7eff8ce0f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:32.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.803+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e27c0 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.804+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.804+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851672452368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e27c0 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.804+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e43f0 con 0x5644603d5520 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.805+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.805+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851672452368] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.805+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851672456928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e48c0 con 0x5644603d5520 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.805+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e2350 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.806+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851672456928] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.806+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.806+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851672458160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e2310 con 0x5644603d99a0 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.806+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e5980 con 0x7eff7c072020 2024-09-10T04:50:32.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.807+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851672458160] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.807+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.807+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851672460976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e5980 con 0x7eff7c072020 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.807+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e6380 con 0x5644603d99a0 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.808+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851672460976] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.808+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.808+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851672465040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e5980 con 0x5644603d99a0 2024-09-10T04:50:32.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.808+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e6d90 con 0x5644603de9b0 2024-09-10T04:50:32.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.809+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.809+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851672465040] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.809+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851672467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e75e0 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.809+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e54d0 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.810+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851672467680] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.811+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.811+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851672462544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e8050 con 0x5644603de9b0 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.811+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e8a10 con 0x7eff7c072020 2024-09-10T04:50:32.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851672474976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e8e30 con 0x7eff7c072020 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=0 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=1 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=2 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=3 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=4 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=5 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851672462544] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=6 2024-09-10T04:50:32.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851672474976] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 20 add_watcher() i=7 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.812+0000 7eff8ce0f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.813+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644603e8e30 con 0x5644603d5520 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.813+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.813+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851672476032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e8da0 con 0x5644603d5520 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.814+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851672476032] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.814+0000 7efe417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.814+0000 7eff8ce0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.814+0000 7eff8ce0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.815+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f4750 con 0x5644603d99a0 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.816+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.816+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f4880 con 0x7eff7c072020 2024-09-10T04:50:32.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.816+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.817+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f4ee0 con 0x5644603de9b0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.818+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.818+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f5390 con 0x5644603d5520 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.819+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'128 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.819+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f3e50 con 0x5644603d99a0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.820+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.820+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f3e50 con 0x5644603de9b0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.821+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'35 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.821+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f3e50 con 0x5644603d99a0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.822+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.822+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f3e50 con 0x5644603d5520 2024-09-10T04:50:32.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.823+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.823+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f60c0 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.824+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.824+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f60c0 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.825+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.825+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f60c0 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.826+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.826+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f60c0 con 0x5644603de9b0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.827+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.827+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6630 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.828+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.828+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6630 con 0x5644603d5520 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.829+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.829+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6ae0 con 0x5644603d5520 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.830+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'129 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.830+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6ae0 con 0x5644603d99a0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.831+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.831+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6ae0 con 0x5644603d99a0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.832+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.832+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6ae0 con 0x5644603de9b0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.833+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.833+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603d99a0 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.834+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.834+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603d5520 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.835+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'130 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.835+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603d99a0 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.836+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.836+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603d99a0 2024-09-10T04:50:32.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.838+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.838+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603de9b0 2024-09-10T04:50:32.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.839+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.839+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f68f0 con 0x5644603d99a0 2024-09-10T04:50:32.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.840+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.840+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6970 con 0x5644603de9b0 2024-09-10T04:50:32.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.841+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.841+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6930 con 0x5644603de9b0 2024-09-10T04:50:32.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.843+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.843+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f69b0 con 0x5644603de9b0 2024-09-10T04:50:32.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.844+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.844+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6990 con 0x5644603d99a0 2024-09-10T04:50:32.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.845+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.845+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f69d0 con 0x5644603d5520 2024-09-10T04:50:32.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.847+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.847+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6990 con 0x5644603d99a0 2024-09-10T04:50:32.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.847+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.847+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f6990 con 0x5644603d5520 2024-09-10T04:50:32.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.849+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'43 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.849+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603f69f0 con 0x7eff7c072020 2024-09-10T04:50:32.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7efdbbfff640 20 reqs_thread_entry: start 2024-09-10T04:50:32.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8ce0f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:32.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8ce0f800 20 Filter name: none 2024-09-10T04:50:32.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7efdb9ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8ce0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8ce0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.850+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460421910 con 0x7eff7c072020 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:32.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460423f00 con 0x5644603d5520 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.851+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460423ec0 con 0x5644603de9b0 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.852+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.852+0000 7eff8ce0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:32.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.852+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94851672717888 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460422f00 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== watch-notify(notify (1) cookie 94851672458160 notify 137438953496 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5644603f60c0 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7efe6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94851672458160 notifier 4531 bl.length()=170 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(97 notify.2 [notify cookie 94851672717888 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7efe6e7fc640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe50003d60 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== watch-notify(notify_complete (2) cookie 94851672717888 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff7c090020 con 0x5644603d99a0 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8ce0f800 10 removing email index: 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8ce0f800 10 removing user buckets index 2024-09-10T04:50:32.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.853+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460423a10 con 0x5644603d5520 2024-09-10T04:50:32.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7eff8ce0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T04:50:32.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94851672717840 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460422a50 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== watch-notify(notify (1) cookie 94851672462544 notify 137438953478 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5644603f3d40 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7efe6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94851672462544 notifier 4531 bl.length()=160 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(100 notify.6 [notify cookie 94851672717840 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.854+0000 7efe6e7fc640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe50003d60 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.855+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== watch-notify(notify_complete (2) cookie 94851672717840 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644603f43e0 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.855+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.855+0000 7eff8ce0f800 10 removing user index: fud 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.855+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422a50 con 0x7eff7c072020 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.856+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.856+0000 7eff8ce0f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.856+0000 7eff8ce0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T04:50:32.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.856+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94851672714848 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564460422a20 con 0x5644603de9b0 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.856+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== watch-notify(notify (1) cookie 94851672467680 notify 137438953479 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5644603f43e0 con 0x5644603de9b0 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.857+0000 7efe6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94851672467680 notifier 4531 bl.length()=152 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.857+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(103 notify.5 [notify cookie 94851672714848 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.857+0000 7efe6e7fc640 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe50003d60 con 0x5644603de9b0 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.857+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== watch-notify(notify_complete (2) cookie 94851672714848 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644603f41f0 con 0x5644603de9b0 2024-09-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.857+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.858+0000 7efe417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:32.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.858+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851672476032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422e60 con 0x5644603d5520 2024-09-10T04:50:32.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.859+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94851672476032] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.859+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851672452368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422e60 con 0x5644603d99a0 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.860+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94851672452368] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.860+0000 7eff8ce0f800 20 remove_watcher() i=0 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.860+0000 7eff8ce0f800 2 removed watcher, disabling cache 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.860+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851672456928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e2d10 con 0x5644603d5520 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.861+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94851672456928] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x5644603d5520 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.861+0000 7eff8ce0f800 20 remove_watcher() i=1 2024-09-10T04:50:32.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.861+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851672458160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422e60 con 0x5644603d99a0 2024-09-10T04:50:32.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.862+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94851672458160] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.862+0000 7eff8ce0f800 20 remove_watcher() i=2 2024-09-10T04:50:32.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.862+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851672460976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e43b0 con 0x7eff7c072020 2024-09-10T04:50:32.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.863+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94851672460976] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.863+0000 7eff8ce0f800 20 remove_watcher() i=3 2024-09-10T04:50:32.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.863+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851672465040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422e60 con 0x5644603d99a0 2024-09-10T04:50:32.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.864+0000 7eff8a8f9640 1 -- 172.21.15.145:0/1487307890 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94851672465040] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c067040 con 0x5644603d99a0 2024-09-10T04:50:32.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.864+0000 7eff8ce0f800 20 remove_watcher() i=4 2024-09-10T04:50:32.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.864+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851672467680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e5e90 con 0x5644603de9b0 2024-09-10T04:50:32.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.865+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94851672467680] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.865+0000 7eff8ce0f800 20 remove_watcher() i=5 2024-09-10T04:50:32.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.865+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851672462544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564460422e60 con 0x5644603de9b0 2024-09-10T04:50:32.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.866+0000 7eff83fff640 1 -- 172.21.15.145:0/1487307890 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94851672462544] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7407c040 con 0x5644603de9b0 2024-09-10T04:50:32.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.866+0000 7eff8ce0f800 20 remove_watcher() i=6 2024-09-10T04:50:32.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.866+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851672474976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644603e68e0 con 0x7eff7c072020 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94851672474976] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff84041040 con 0x7eff7c072020 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 20 remove_watcher() i=7 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5644603d99a0 msgr2=0x5644603dbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5644603d99a0 0x5644603dbd90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5644603d5520 msgr2=0x5644603d79e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5644603d5520 0x5644603d79e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7eff7c072020 msgr2=0x7eff7c069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7eff7c072020 0x7eff7c069870 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5644603de9b0 msgr2=0x5644603e0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5644603de9b0 0x5644603e0de0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe5403c780 msgr2=0x7efe5403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe5403c780 0x7efe5403ec40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff74000c00 tx=0x7eff74053000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 msgr2=0x5644603c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/1487307890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446038d1d0 0x5644603c9fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0247d0 tx=0x7eff7c03de60 comp rx=0 tx=0).stop 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 reap_dead start 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8b0fa640 1 -- 172.21.15.145:0/1487307890 reap_dead start 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 shutdown_connections 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 >> 172.21.15.145:0/1487307890 conn(0x5644603bcd60 msgr2=0x5644603baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 shutdown_connections 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.867+0000 7eff8ce0f800 1 -- 172.21.15.145:0/1487307890 wait complete. 2024-09-10T04:50:32.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 msgr2=0x7efe6403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 0x7efe6403ec40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564460397590 tx=0x7eff74005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 msgr2=0x5644603b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7eff7c051f50 tx=0x7eff7c017f10 comp rx=0 tx=0).stop 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 shutdown_connections 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe6403c780 0x7efe6403ec40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/3561433197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644603b4050 0x5644603b4470 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 >> 172.21.15.145:0/3561433197 conn(0x5644603a8400 msgr2=0x5644603a87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 shutdown_connections 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/3561433197 wait complete. 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56446039e520 msgr2=0x5644603a0910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56446039e520 0x5644603a0910 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56446029f210 msgr2=0x56446039d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56446029f210 0x56446039d5f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5644603a3ba0 msgr2=0x5644603a5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5644603a3ba0 0x5644603a5f90 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe7003c780 msgr2=0x7efe7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7efe7003c780 0x7efe7003ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff74057000 tx=0x7eff74052000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 msgr2=0x564460395fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 --2- 172.21.15.145:0/2747274953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56446029de00 0x564460395fa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c010 tx=0x7eff7c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8b0fa640 1 -- 172.21.15.145:0/2747274953 reap_dead start 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 shutdown_connections 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 >> 172.21.15.145:0/2747274953 conn(0x5644602991f0 msgr2=0x564460387690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 shutdown_connections 2024-09-10T04:50:32.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.868+0000 7eff8ce0f800 1 -- 172.21.15.145:0/2747274953 wait complete. 2024-09-10T04:50:32.878 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T04:50:32.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T04:50:32.878 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T04:50:32.934 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:32.934 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.933+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.933+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.933+0000 7f2fd2317800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5649c999e4a0 0x5649c999e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.933+0000 7f2fd2317800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649c9848e40 con 0x5649c99a0f90 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.933+0000 7f2fd2317800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5649c9813680 con 0x5649c999e4a0 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.934+0000 7f2fcfe01640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5649c999e4a0 0x5649c999e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.934+0000 7f2fcf600640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5649c99a0f90 0x5649c99a3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39290/0 (socket says 172.21.15.145:39290) 2024-09-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.934+0000 7f2fcf600640 1 -- 172.21.15.145:0/3992060040 learned_addr learned my addr 172.21.15.145:0/3992060040 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.934+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3992060040 >> v1:172.21.15.98:6789/0 conn(0x5649c99a0f90 legacy=0x5649c99a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.934+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3992060040 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c982f6b0 con 0x5649c999e4a0 2024-09-10T04:50:32.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/3992060040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999e8a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005fd0 tx=0x7f2fc0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118baa640a90c08e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fcedff640 1 -- 172.21.15.145:0/3992060040 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0058530 con 0x5649c999e4a0 2024-09-10T04:50:32.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fcedff640 1 -- 172.21.15.145:0/3992060040 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc00586d0 con 0x5649c999e4a0 2024-09-10T04:50:32.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fcedff640 1 -- 172.21.15.145:0/3992060040 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc00589d0 con 0x5649c999e4a0 2024-09-10T04:50:32.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 -- 172.21.15.145:0/3992060040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 msgr2=0x5649c999e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3992060040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999e8a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005fd0 tx=0x7f2fc0045c30 comp rx=0 tx=0).stop 2024-09-10T04:50:32.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 -- 172.21.15.145:0/3992060040 shutdown_connections 2024-09-10T04:50:32.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3992060040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999e8a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 -- 172.21.15.145:0/3992060040 >> 172.21.15.145:0/3992060040 conn(0x5649c9998980 msgr2=0x5649c999ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 -- 172.21.15.145:0/3992060040 shutdown_connections 2024-09-10T04:50:32.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.936+0000 7f2fd2317800 1 -- 172.21.15.145:0/3992060040 wait complete. 2024-09-10T04:50:32.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.950+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.950+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.950+0000 7f2fd2317800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.950+0000 7f2fd2317800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649c9837dd0 con 0x5649c999e4a0 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56114/0 (socket says 172.21.15.145:56114) 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2fcfe01640 1 -- 172.21.15.145:0/932992939 learned_addr learned my addr 172.21.15.145:0/932992939 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2fcfe01640 1 -- 172.21.15.145:0/932992939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c9850e10 con 0x5649c999e4a0 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/932992939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0025a60 tx=0x7f2fc0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646931505aa5e05d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2ebde0b640 1 -- 172.21.15.145:0/932992939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0058a30 con 0x5649c999e4a0 2024-09-10T04:50:32.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2ebde0b640 1 -- 172.21.15.145:0/932992939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc0068070 con 0x5649c999e4a0 2024-09-10T04:50:32.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.951+0000 7f2ebde0b640 1 -- 172.21.15.145:0/932992939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0058d00 con 0x5649c999e4a0 2024-09-10T04:50:32.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- 172.21.15.145:0/932992939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 msgr2=0x5649c999d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 --2- 172.21.15.145:0/932992939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0025a60 tx=0x7f2fc0051000 comp rx=0 tx=0).stop 2024-09-10T04:50:32.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- 172.21.15.145:0/932992939 shutdown_connections 2024-09-10T04:50:32.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 --2- 172.21.15.145:0/932992939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c999d5e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- 172.21.15.145:0/932992939 >> 172.21.15.145:0/932992939 conn(0x5649c9998980 msgr2=0x5649c9a89030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- 172.21.15.145:0/932992939 shutdown_connections 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- 172.21.15.145:0/932992939 wait complete. 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c9a98250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.952+0000 7f2fd2317800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649c99a4fb0 con 0x5649c999e4a0 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c9a98250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c9a98250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56126/0 (socket says 172.21.15.145:56126) 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3699540433 learned_addr learned my addr 172.21.15.145:0/3699540433 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c9a987b0 con 0x5649c999e4a0 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c9a98250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0025a60 tx=0x7f2fc0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2eb7fff640 1 -- 172.21.15.145:0/3699540433 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0063710 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2eb7fff640 1 -- 172.21.15.145:0/3699540433 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc00638b0 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649c9a98a40 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2eb7fff640 1 -- 172.21.15.145:0/3699540433 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0063bd0 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.953+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c9a99440 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2eb7fff640 1 -- 172.21.15.145:0/3699540433 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2fc0075480 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2eb7fff640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2eb803c780 0x7f2eb803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2eb7fff640 1 -- 172.21.15.145:0/3699540433 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fc0097df0 con 0x5649c999e4a0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2fcf600640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2eb803c780 0x7f2eb803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c99a0f90 0x5649c9a9f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.954+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9a99fb0 con 0x5649c99a0f90 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fd0602640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c99a0f90 0x5649c9a9f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fcf600640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2eb803c780 0x7f2eb803ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8001d70 tx=0x7f2fb80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fd0602640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c99a0f90 0x5649c9a9f8a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fd0602640 1 -- 172.21.15.145:0/3699540433 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c99a0f90 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9aa07d0 0x5649c9aa2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9aa31f0 con 0x5649c9aa07d0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.955+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9aa07d0 0x5649c9aa2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9aa07d0 0x5649c9aa2bc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3699540433 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fc004f3f0 con 0x5649c9aa07d0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9aa4aa0 con 0x5649c99a0f90 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fd0602640 1 -- 172.21.15.145:0/3699540433 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c99a0f90 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9aa3cd0 con 0x5649c9aa07d0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.956+0000 7f2fcfe01640 1 -- 172.21.15.145:0/3699540433 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fc004f3f0 con 0x5649c9aa07d0 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649c9aa5e50 0x5649c9aa8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9aa8780 con 0x5649c9aa5e50 2024-09-10T04:50:32.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fcf600640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649c9aa5e50 0x5649c9aa8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fcf600640 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649c9aa5e50 0x5649c9aa8240 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fcf600640 1 -- 172.21.15.145:0/3699540433 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9aa5e50 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.957+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fd2317800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fd2317800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649c9895a00 con 0x5649c9ab6330 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56140/0 (socket says 172.21.15.145:56140) 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fcfe01640 1 -- 172.21.15.145:0/1501788952 learned_addr learned my addr 172.21.15.145:0/1501788952 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fcfe01640 1 -- 172.21.15.145:0/1501788952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c9ab6d90 con 0x5649c9ab6330 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.958+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0096180 tx=0x7f2fc0074de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2eb57fa640 1 -- 172.21.15.145:0/1501788952 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc009b070 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2eb57fa640 1 -- 172.21.15.145:0/1501788952 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc007ec70 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649c9ab75c0 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2eb57fa640 1 -- 172.21.15.145:0/1501788952 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc00743e0 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c9ab7b60 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.959+0000 7f2eb57fa640 1 -- 172.21.15.145:0/1501788952 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2fc009e070 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2eb57fa640 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 0x7f2ea803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2eb57fa640 1 -- 172.21.15.145:0/1501788952 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fc00a1ca0 con 0x5649c9ab6330 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fcf600640 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 0x7f2ea803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fcf600640 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 0x7f2ea803ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80016b0 tx=0x7f2fb800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fd2317800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fd2317800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649c999dc60 con 0x5649c9ac2cd0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56144/0 (socket says 172.21.15.145:56144) 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.960+0000 7f2fcfe01640 1 -- 172.21.15.145:0/2505844298 learned_addr learned my addr 172.21.15.145:0/2505844298 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fcfe01640 1 -- 172.21.15.145:0/2505844298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c9ac36c0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/2505844298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fc009d000 tx=0x7f2fc0096f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe85f3011e15da26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2eaeffd640 1 -- 172.21.15.145:0/2505844298 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0099df0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2eaeffd640 1 -- 172.21.15.145:0/2505844298 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc006c3f0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2eaeffd640 1 -- 172.21.15.145:0/2505844298 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc0094380 con 0x5649c9ac2cd0 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 -- 172.21.15.145:0/2505844298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 msgr2=0x5649c9ac30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:32.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 --2- 172.21.15.145:0/2505844298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fc009d000 tx=0x7f2fc0096f90 comp rx=0 tx=0).stop 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 -- 172.21.15.145:0/2505844298 shutdown_connections 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 --2- 172.21.15.145:0/2505844298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9ac30d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 -- 172.21.15.145:0/2505844298 >> 172.21.15.145:0/2505844298 conn(0x5649c9abf0d0 msgr2=0x5649c9abd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 -- 172.21.15.145:0/2505844298 shutdown_connections 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.961+0000 7f2fd2317800 1 -- 172.21.15.145:0/2505844298 wait complete. 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fd2317800 1 Processor -- start 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fd2317800 1 -- start start 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fd2317800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fd2317800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5649c9ac3b30 con 0x5649c9ac2cd0 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fcfe01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56146/0 (socket says 172.21.15.145:56146) 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 learned_addr learned my addr 172.21.15.145:0/4019315447 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c9aca6d0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.962+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00a1f10 tx=0x7f2fc007af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2ead7fa640 1 -- 172.21.15.145:0/4019315447 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc00746b0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2ead7fa640 1 -- 172.21.15.145:0/4019315447 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc0074870 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649c9aca6d0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2ead7fa640 1 -- 172.21.15.145:0/4019315447 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc009f6e0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c9aca6d0 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.963+0000 7f2ead7fa640 1 -- 172.21.15.145:0/4019315447 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2fc005aa60 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2ead7fa640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2e9803c780 0x7f2e9803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2ead7fa640 1 -- 172.21.15.145:0/4019315447 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fc00c2c90 con 0x5649c9ac2cd0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fcf600640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2e9803c780 0x7f2e9803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fcf600640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2e9803c780 0x7f2e9803ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800bf40 tx=0x7f2fb8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c9ad54c0 0x5649c9ad7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ad80d0 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.964+0000 7f2fd0602640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c9ad54c0 0x5649c9ad7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd0602640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c9ad54c0 0x5649c9ad7980 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 realm 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ad47f0 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ad8b60 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c9ad54c0 2024-09-10T04:50:32.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9ad9940 0x5649c9adbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.965+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adc390 con 0x5649c9ad9940 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9ad9940 0x5649c9adbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9ad9940 0x5649c9adbd30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fd2317800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.966+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c9ad54c0 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fd2317800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:32.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fd2317800 20 searching for the correct realm 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649c9ade950 0x5649c9ae0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae1450 con 0x5649c9ade950 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fcf600640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649c9ade950 0x5649c9ae0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fcf600640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649c9ade950 0x5649c9ae0d80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.967+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae1450 con 0x5649c9ad9940 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fcfe01640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2fc00b8040 0x7f2fc00531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae1450 con 0x7f2fc00b8040 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2fc00b8040 0x7f2fc00531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2fc00b8040 0x7f2fc00531b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2fc80083e0 con 0x7f2fc00b8040 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc80083e0 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.968+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.969+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x7f2fc00b8040 2024-09-10T04:50:32.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.970+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x7f2fc00b8040 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.971+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.972+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x7f2fc00b8040 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.973+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x7f2fc00b8040 2024-09-10T04:50:32.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x7f2fc00b8040 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.974+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ade950 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.975+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649c9adcbe0 con 0x5649c9ad9940 2024-09-10T04:50:32.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9add430 con 0x5649c9ad54c0 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9add820 con 0x5649c9ad9940 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9addc40 con 0x7f2fc00b8040 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 zone default found 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 4 Realm: () 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:32.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 zonegroup default 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.976+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae18d0 con 0x7f2fc00b8040 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae33c0 con 0x5649c9ade950 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae38e0 con 0x5649c9ade950 2024-09-10T04:50:33.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 started sync module instance, tier type = 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.977+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae2760 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.979+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.979+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874916236112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae23c0 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.979+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae4810 con 0x5649c9ad54c0 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.980+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94874916236112] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.980+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.980+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874916240704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae4810 con 0x5649c9ad54c0 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.980+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae5210 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.981+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.981+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94874916240704] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.981+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874916244768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae51c0 con 0x5649c9ad9940 2024-09-10T04:50:33.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.981+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae4380 con 0x7f2fc00b8040 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.982+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.982+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874916242304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae6180 con 0x7f2fc00b8040 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.982+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae6bf0 con 0x5649c9ad9940 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.982+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94874916244768] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.983+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94874916242304] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.983+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.983+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874916251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae5cd0 con 0x5649c9ad9940 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.983+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae7490 con 0x5649c9ade950 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.984+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94874916251328] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.984+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.984+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874916253664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae5cd0 con 0x5649c9ade950 2024-09-10T04:50:33.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.984+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae7e90 con 0x5649c9ade950 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.985+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94874916253664] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.985+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.985+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874916246960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae8730 con 0x5649c9ade950 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.985+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae90f0 con 0x7f2fc00b8040 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874916261408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae9870 con 0x7f2fc00b8040 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=0 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=1 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=2 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=3 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=4 2024-09-10T04:50:33.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=5 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94874916246960] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.986+0000 7f2fd2317800 20 add_watcher() i=6 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.987+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94874916261408] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.987+0000 7f2fd2317800 20 add_watcher() i=7 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.987+0000 7f2fd2317800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.987+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae8280 con 0x5649c9ad54c0 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.988+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.988+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874916262656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9ae8280 con 0x5649c9ad54c0 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94874916262656] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd2317800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd2317800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd2317800 5 note: GC not initialized 2024-09-10T04:50:33.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2e84fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd2317800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2fd2317800 20 Filter name: none 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.989+0000 7f2dfe7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1fb10 con 0x5649c9ade950 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T04:50:33.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1e100 con 0x5649c9ade950 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.990+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b225f0 con 0x5649c9ade950 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.991+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'7 uv7 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.991+0000 7f2fd2317800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.991+0000 7f2fd2317800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.991+0000 7f2fd2317800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T04:50:33.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.991+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94874916495392 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b230e0 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== watch-notify(notify (1) cookie 94874916242304 notify 137438953480 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f2fc800aa60 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94874916242304 notifier 4538 bl.length()=610 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2eaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2eaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(65 notify.3 [notify cookie 94874916495392 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2eaeffd640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2e94003ea0 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== watch-notify(notify_complete (2) cookie 94874916495392 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2fc800ad00 con 0x7f2fc00b8040 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.992+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b230a0 con 0x5649c9ade950 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.993+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'8 uv8 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.993+0000 7f2fd2317800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:33.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.993+0000 7f2fd2317800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.993+0000 7f2fd2317800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.993+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94874916498416 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b23010 con 0x5649c9ad9940 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94874916244768 notify 137438953497 ret 0) ==== 234+0+0 (crc 0 0 0) 0x5649c9ab75c0 con 0x5649c9ad9940 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94874916244768 notifier 4538 bl.length()=192 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2eaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2eaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [notify cookie 94874916498416 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2eaeffd640 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2e94003ea0 con 0x5649c9ad9940 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.994+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94874916498416 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5649c9ab6d90 con 0x5649c9ad9940 2024-09-10T04:50:33.009 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T04:50:32.991487Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:32.991473Z","tags":[],"group_ids":[]} 2024-09-10T04:50:33.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.995+0000 7f2e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.995+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874916262656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ad54c0 2024-09-10T04:50:33.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.996+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94874916262656] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.996+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874916236112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ad9940 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.997+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94874916236112] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.997+0000 7f2fd2317800 20 remove_watcher() i=0 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.997+0000 7f2fd2317800 2 removed watcher, disabling cache 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.997+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874916240704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ad54c0 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.998+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94874916240704] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x5649c9ad54c0 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.998+0000 7f2fd2317800 20 remove_watcher() i=1 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.998+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874916244768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ad9940 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.999+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94874916244768] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.999+0000 7f2fd2317800 20 remove_watcher() i=2 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:32.999+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874916242304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x7f2fc00b8040 2024-09-10T04:50:33.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.000+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94874916242304] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.000+0000 7f2fd2317800 20 remove_watcher() i=3 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.000+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874916251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ad9940 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.001+0000 7f2fcfe01640 1 -- 172.21.15.145:0/4019315447 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94874916251328] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc00c7020 con 0x5649c9ad9940 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.001+0000 7f2fd2317800 20 remove_watcher() i=4 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.001+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874916253664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ade950 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.002+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94874916253664] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.002+0000 7f2fd2317800 20 remove_watcher() i=5 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.002+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874916246960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x5649c9ade950 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.003+0000 7f2fcf600640 1 -- 172.21.15.145:0/4019315447 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94874916246960] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8009050 con 0x5649c9ade950 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.003+0000 7f2fd2317800 20 remove_watcher() i=6 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.003+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874916261408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649c9b1d770 con 0x7f2fc00b8040 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94874916261408] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc8025040 con 0x7f2fc00b8040 2024-09-10T04:50:33.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 20 remove_watcher() i=7 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9ad9940 msgr2=0x5649c9adbd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9ad9940 0x5649c9adbd30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c9ad54c0 msgr2=0x5649c9ad7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c9ad54c0 0x5649c9ad7980 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2fc00b8040 msgr2=0x7f2fc00531b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2fc00b8040 0x7f2fc00531b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649c9ade950 msgr2=0x5649c9ae0d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5649c9ade950 0x5649c9ae0d80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2e9803c780 msgr2=0x7f2e9803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2e9803c780 0x7f2e9803ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800bf40 tx=0x7f2fb8010000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 msgr2=0x5649c9aca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd0602640 1 -- 172.21.15.145:0/4019315447 reap_dead start 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00a1f10 tx=0x7f2fc007af40 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 shutdown_connections 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 --2- 172.21.15.145:0/4019315447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ac2cd0 0x5649c9aca170 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 >> 172.21.15.145:0/4019315447 conn(0x5649c9abf0d0 msgr2=0x5649c9abd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 shutdown_connections 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.004+0000 7f2fd2317800 1 -- 172.21.15.145:0/4019315447 wait complete. 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 msgr2=0x7f2ea803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 0x7f2ea803ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80016b0 tx=0x7f2fb800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 msgr2=0x5649c9ab6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0096180 tx=0x7f2fc0074de0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 shutdown_connections 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ea803c780 0x7f2ea803ec40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/1501788952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c9ab6330 0x5649c9ab6750 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 >> 172.21.15.145:0/1501788952 conn(0x5649c9aaa6e0 msgr2=0x5649c9aaaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 shutdown_connections 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/1501788952 wait complete. 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9aa07d0 msgr2=0x5649c9aa2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5649c9aa07d0 0x5649c9aa2bc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c99a0f90 msgr2=0x5649c9a9f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5649c99a0f90 0x5649c9a9f8a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649c9aa5e50 msgr2=0x5649c9aa8240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5649c9aa5e50 0x5649c9aa8240 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2eb803c780 msgr2=0x7f2eb803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2eb803c780 0x7f2eb803ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8001d70 tx=0x7f2fb80012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 msgr2=0x5649c9a98250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 --2- 172.21.15.145:0/3699540433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5649c999e4a0 0x5649c9a98250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0025a60 tx=0x7f2fc0003330 comp rx=0 tx=0).stop 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd0602640 1 -- 172.21.15.145:0/3699540433 reap_dead start 2024-09-10T04:50:33.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 shutdown_connections 2024-09-10T04:50:33.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 >> 172.21.15.145:0/3699540433 conn(0x5649c9998980 msgr2=0x5649c9a87820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 shutdown_connections 2024-09-10T04:50:33.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.005+0000 7f2fd2317800 1 -- 172.21.15.145:0/3699540433 wait complete. 2024-09-10T04:50:33.019 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T04:50:32.991487Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:32.991473Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:33.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T04:50:33.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T04:50:33.020 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-10T04:50:33.069 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.069 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.068+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3dedb2c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562c7c1a36a0 0x562c7c1a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3dedb2c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c7c04ce40 con 0x562c7c1a6030 2024-09-10T04:50:33.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3dedb2c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562c7c017680 con 0x562c7c1a36a0 2024-09-10T04:50:33.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de984f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562c7c1a36a0 0x562c7c1a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de3fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x562c7c1a6030 0x562c7c1a84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39298/0 (socket says 172.21.15.145:39298) 2024-09-10T04:50:33.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de3fff640 1 -- 172.21.15.145:0/3255062631 learned_addr learned my addr 172.21.15.145:0/3255062631 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de984f640 1 -- 172.21.15.145:0/3255062631 >> v1:172.21.15.98:6789/0 conn(0x562c7c1a6030 legacy=0x562c7c1a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de904e640 1 -- 172.21.15.145:0/3255062631 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47724227 0 0) 0x562c7c04ce40 con 0x562c7c1a6030 2024-09-10T04:50:33.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.069+0000 7f3de984f640 1 -- 172.21.15.145:0/3255062631 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c0336b0 con 0x562c7c1a36a0 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.071+0000 7f3de984f640 1 --2- 172.21.15.145:0/3255062631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a5a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00a470 tx=0x7f3ddc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e76c2a9f41add1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.071+0000 7f3de904e640 1 -- 172.21.15.145:0/3255062631 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc053570 con 0x562c7c1a36a0 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.071+0000 7f3de904e640 1 -- 172.21.15.145:0/3255062631 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc058070 con 0x562c7c1a36a0 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.071+0000 7f3de904e640 1 -- 172.21.15.145:0/3255062631 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc053880 con 0x562c7c1a36a0 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 -- 172.21.15.145:0/3255062631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 msgr2=0x562c7c1a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/3255062631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a5a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00a470 tx=0x7f3ddc045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 -- 172.21.15.145:0/3255062631 shutdown_connections 2024-09-10T04:50:33.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/3255062631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a5a90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 -- 172.21.15.145:0/3255062631 >> 172.21.15.145:0/3255062631 conn(0x562c7c19d1e0 msgr2=0x562c7c19f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 -- 172.21.15.145:0/3255062631 shutdown_connections 2024-09-10T04:50:33.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.072+0000 7f3dedb2c800 1 -- 172.21.15.145:0/3255062631 wait complete. 2024-09-10T04:50:33.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3dedb2c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3dedb2c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c7c03bdd0 con 0x562c7c1a36a0 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56166/0 (socket says 172.21.15.145:56166) 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3de984f640 1 -- 172.21.15.145:0/1562697477 learned_addr learned my addr 172.21.15.145:0/1562697477 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.086+0000 7f3de984f640 1 -- 172.21.15.145:0/1562697477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c054e10 con 0x562c7c1a36a0 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3de984f640 1 --2- 172.21.15.145:0/1562697477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc025c20 tx=0x7f3ddc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d08f455d9c6f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3cd7e07640 1 -- 172.21.15.145:0/1562697477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc053a20 con 0x562c7c1a36a0 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3cd7e07640 1 -- 172.21.15.145:0/1562697477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc063070 con 0x562c7c1a36a0 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3cd7e07640 1 -- 172.21.15.145:0/1562697477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc053d30 con 0x562c7c1a36a0 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1562697477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 msgr2=0x562c7c2924f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.087+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1562697477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc025c20 tx=0x7f3ddc051000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1562697477 shutdown_connections 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1562697477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c2924f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1562697477 >> 172.21.15.145:0/1562697477 conn(0x562c7c19d1e0 msgr2=0x562c7c28de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1562697477 shutdown_connections 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1562697477 wait complete. 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3dedb2c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c7c1aa050 con 0x562c7c1a36a0 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56182/0 (socket says 172.21.15.145:56182) 2024-09-10T04:50:33.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.088+0000 7f3de984f640 1 -- 172.21.15.145:0/428400694 learned_addr learned my addr 172.21.15.145:0/428400694 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3de984f640 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c1a3320 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3de984f640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a2dc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc025c20 tx=0x7f3ddc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3cd6604640 1 -- 172.21.15.145:0/428400694 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc078070 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3cd6604640 1 -- 172.21.15.145:0/428400694 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc073470 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c7c1a16d0 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3cd6604640 1 -- 172.21.15.145:0/428400694 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc073750 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.089+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7c1a1cf0 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3cd6604640 1 -- 172.21.15.145:0/428400694 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ddc07b070 con 0x562c7c1a36a0 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3cd6604640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cd003c730 0x7f3cd003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3cd6604640 1 -- 172.21.15.145:0/428400694 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ddc097d60 con 0x562c7c1a36a0 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3de3fff640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cd003c730 0x7f3cd003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c1a6030 0x562c7c2a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2a3790 con 0x562c7c1a6030 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3dea050640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c1a6030 0x562c7c2a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.090+0000 7f3de3fff640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cd003c730 0x7f3cd003ebf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.091+0000 7f3dea050640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c1a6030 0x562c7c2a3250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.091+0000 7f3dea050640 1 -- 172.21.15.145:0/428400694 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c1a6030 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.091+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2a44f0 0x562c7c2a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.091+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2a6ed0 con 0x562c7c2a44f0 2024-09-10T04:50:33.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.091+0000 7f3de984f640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2a44f0 0x562c7c2a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3de984f640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2a44f0 0x562c7c2a68e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3de984f640 1 -- 172.21.15.145:0/428400694 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ddc07a030 con 0x562c7c2a44f0 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2a8780 con 0x562c7c1a6030 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3dea050640 1 -- 172.21.15.145:0/428400694 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c1a6030 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2a79e0 con 0x562c7c2a44f0 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3de984f640 1 -- 172.21.15.145:0/428400694 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ddc07a030 con 0x562c7c2a44f0 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c7c2a9b30 0x562c7c2abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.092+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ac460 con 0x562c7c2a9b30 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.093+0000 7f3de3fff640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c7c2a9b30 0x562c7c2abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.093+0000 7f3de3fff640 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c7c2a9b30 0x562c7c2abf20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.093+0000 7f3de3fff640 1 -- 172.21.15.145:0/428400694 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3dd400f670 con 0x562c7c2a9b30 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.093+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.093+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3dedb2c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3dedb2c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c7c099a00 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56190/0 (socket says 172.21.15.145:56190) 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3de984f640 1 -- 172.21.15.145:0/1278991129 learned_addr learned my addr 172.21.15.145:0/1278991129 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3de984f640 1 -- 172.21.15.145:0/1278991129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c2baa30 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3de984f640 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc05d770 tx=0x7f3ddc0685b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3ccf7fe640 1 -- 172.21.15.145:0/1278991129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc07c730 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3ccf7fe640 1 -- 172.21.15.145:0/1278991129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc07c8d0 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c7c2bb260 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3ccf7fe640 1 -- 172.21.15.145:0/1278991129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc05fb00 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.094+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7c2bb800 con 0x562c7c2b9fd0 2024-09-10T04:50:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.095+0000 7f3ccf7fe640 1 -- 172.21.15.145:0/1278991129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ddc05d7e0 con 0x562c7c2b9fd0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.095+0000 7f3ccf7fe640 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 0x7f3cc403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.095+0000 7f3ccf7fe640 1 -- 172.21.15.145:0/1278991129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ddc0a0ca0 con 0x562c7c2b9fd0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.095+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 0x7f3cc403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 0x7f3cc403ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x562c7c1a2110 tx=0x7f3dd4006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3dedb2c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3dedb2c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c7c292ce0 con 0x562c7c2c68f0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56202/0 (socket says 172.21.15.145:56202) 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de984f640 1 -- 172.21.15.145:0/1147099431 learned_addr learned my addr 172.21.15.145:0/1147099431 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de984f640 1 -- 172.21.15.145:0/1147099431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c2c72c0 con 0x562c7c2c68f0 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3de984f640 1 --2- 172.21.15.145:0/1147099431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc08b680 tx=0x7f3ddc08b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730a100767421dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3ccd7fa640 1 -- 172.21.15.145:0/1147099431 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc0a4070 con 0x562c7c2c68f0 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3ccd7fa640 1 -- 172.21.15.145:0/1147099431 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc07ed40 con 0x562c7c2c68f0 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.096+0000 7f3ccd7fa640 1 -- 172.21.15.145:0/1147099431 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc05c8c0 con 0x562c7c2c68f0 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1147099431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 msgr2=0x562c7c2c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1147099431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc08b680 tx=0x7f3ddc08b3f0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1147099431 shutdown_connections 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1147099431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2c6cd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1147099431 >> 172.21.15.145:0/1147099431 conn(0x562c7c2c2cf0 msgr2=0x562c7c2c0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1147099431 shutdown_connections 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1147099431 wait complete. 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 Processor -- start 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- start start 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.097+0000 7f3dedb2c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c7c2c7750 con 0x562c7c2c68f0 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3de984f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56210/0 (socket says 172.21.15.145:56210) 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 learned_addr learned my addr 172.21.15.145:0/1849535396 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7c2ce260 con 0x562c7c2c68f0 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3de984f640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2cdd00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0a1620 tx=0x7f3ddc05af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3cbb7fe640 1 -- 172.21.15.145:0/1849535396 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc0a1290 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3cbb7fe640 1 -- 172.21.15.145:0/1849535396 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc07e7b0 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c7c2ce260 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3cbb7fe640 1 -- 172.21.15.145:0/1849535396 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ddc07e960 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.098+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7c2ce260 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.099+0000 7f3cbb7fe640 1 -- 172.21.15.145:0/1849535396 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ddc0c5060 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.099+0000 7f3cbb7fe640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cb403c730 0x7f3cb403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.099+0000 7f3cbb7fe640 1 -- 172.21.15.145:0/1849535396 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ddc0bfce0 con 0x562c7c2c68f0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.099+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cb403c730 0x7f3cb403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cb403c730 0x7f3cb403ebf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x562c7c2a8690 tx=0x7f3dd4023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c2d9120 0x562c7c2db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2dbd30 con 0x562c7c2d9120 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3dea050640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c2d9120 0x562c7c2db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.100+0000 7f3dea050640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c2d9120 0x562c7c2db5e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 realm 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2d8450 con 0x562c7c2d9120 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2dc7c0 con 0x562c7c2d9120 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2dd5a0 0x562c7c2df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2dfff0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.101+0000 7f3de984f640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2dd5a0 0x562c7c2df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3de984f640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2dd5a0 0x562c7c2df990 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e0840 con 0x562c7c2d9120 2024-09-10T04:50:33.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 20 searching for the correct realm 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c7c2e25b0 0x562c7c2e49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.102+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c7c2e25b0 0x562c7c2e49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de3fff640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c7c2e25b0 0x562c7c2e49c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de984f640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3ddc0c7070 0x7f3ddc0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3dea050640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3ddc0c7070 0x7f3ddc0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.103+0000 7f3dea050640 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3ddc0c7070 0x7f3ddc0a9450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3de400a4d0 con 0x7f3ddc0c7070 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.104+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de400a4d0 con 0x562c7c2d9120 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.105+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3de4030040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.106+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.107+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.108+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2d9120 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x7f3ddc0c7070 2024-09-10T04:50:33.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3de4030040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.109+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2e25b0 2024-09-10T04:50:33.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5090 con 0x562c7c2dd5a0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.110+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e11f0 con 0x562c7c2d9120 2024-09-10T04:50:33.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3de4030040 con 0x562c7c2d9120 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e1a90 con 0x562c7c2dd5a0 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e0e30 con 0x7f3ddc0c7070 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 zone default found 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 4 Realm: () 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 zonegroup default 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.111+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e5510 con 0x7f3ddc0c7070 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e7060 con 0x562c7c2e25b0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e75b0 con 0x562c7c2e25b0 2024-09-10T04:50:33.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 started sync module instance, tier type = 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.112+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e63a0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.113+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.113+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94749061966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e63a0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.113+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e8070 con 0x562c7c2d9120 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.114+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.114+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94749061970816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e8040 con 0x562c7c2d9120 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.114+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94749061966016] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.114+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e9060 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.115+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.115+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94749061974832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e9020 con 0x562c7c2dd5a0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.115+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e9b10 con 0x7f3ddc0c7070 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.115+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94749061970816] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.116+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.116+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94749061977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2e9b10 con 0x7f3ddc0c7070 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.116+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ea550 con 0x562c7c2dd5a0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.117+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94749061974832] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.117+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94749061977632] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.117+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.118+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94749061973088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ea0a0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.118+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2eadf0 con 0x562c7c2e25b0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.119+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.119+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94749061982528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ea0a0 con 0x562c7c2e25b0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.119+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ebd20 con 0x562c7c2e25b0 2024-09-10T04:50:33.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.119+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94749061973088] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.120+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94749061982528] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.120+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.120+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94749061986320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ec140 con 0x562c7c2e25b0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.120+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ec990 con 0x7f3ddc0c7070 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94749061986320] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94749061988672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ecd80 con 0x7f3ddc0c7070 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=0 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=1 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=2 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=3 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=4 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=5 2024-09-10T04:50:33.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.121+0000 7f3dedb2c800 20 add_watcher() i=6 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94749061988672] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dedb2c800 20 add_watcher() i=7 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dedb2c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2efdb0 con 0x562c7c2d9120 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.122+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94749061990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c2ed300 con 0x562c7c2d9120 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.123+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94749061990192] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.123+0000 7f3c9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 5 note: GC not initialized 2024-09-10T04:50:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3c9a7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 20 Filter name: none 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3c0bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.124+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c322fc0 con 0x562c7c2e25b0 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c322950 con 0x7f3ddc0c7070 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.125+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c326700 con 0x562c7c2e25b0 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(64 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.126+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32ac60 con 0x7f3ddc0c7070 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.127+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.127+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 8.c 8:36b6b928:root::.bucket.meta.testx%3amyfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e570 con 0x562c7c2d9120 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [create,call,writefull 0~420,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dedb2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x7 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dedb2c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dedb2c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T04:50:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dedb2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94749062251424 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32dfe0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94749061966016 notify 137438953498 ret 0) ==== 897+0+0 (crc 0 0 0) 0x562c7c2bb260 con 0x562c7c2dd5a0 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94749061966016 notifier 4545 bl.length()=855 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3ccd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x7 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3ccd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3ccd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.0 [notify cookie 94749062251424 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.128+0000 7f3ccd7fa640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3cac003ea0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94749062251424 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c7c2baa30 con 0x562c7c2dd5a0 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3dedb2c800 20 handle_bi_update(): bucket=testx:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3dedb2c800 20 handle_bi_update(): bucket=testx:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3dedb2c800 20 handle_bi_update(): bucket=testx:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3dedb2c800 20 handle_bi_update(): bucket=testx:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.129+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e160 con 0x562c7c2d9120 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.130+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.130+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e160 con 0x562c7c2d9120 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.131+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.131+0000 7f3dedb2c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.131+0000 7f3dedb2c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.131+0000 7f3dedb2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T04:50:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.131+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94749062257840 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e0d0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94749061973088 notify 137438953499 ret 0) ==== 390+0+0 (crc 0 0 0) 0x562c7c2baa30 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3cccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94749061973088 notifier 4545 bl.length()=348 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3cccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3cccff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(71 notify.4 [notify cookie 94749062257840 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3cccff9640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3c14003400 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94749062257840 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c7c1a1cf0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.132+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e160 con 0x7f3ddc0c7070 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3dedb2c800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3dedb2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94749062257840 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e0d0 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== watch-notify(notify (1) cookie 94749061986320 notify 137438953480 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562c7c326af0 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3cccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94749061986320 notifier 4545 bl.length()=149 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3cccff9640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3c14003400 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.133+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(74 notify.6 [notify cookie 94749062257840 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.134+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.134+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== watch-notify(notify_complete (2) cookie 94749062257840 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c7c324c00 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.134+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e0e0 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(76 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3dedb2c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 from cache 2024-09-10T04:50:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3dedb2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94749062229376 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7c32e0e0 con 0x562c7c2d9120 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== watch-notify(notify (1) cookie 94749061970816 notify 137438953475 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562c7c32e500 con 0x562c7c2d9120 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94749061970816 notifier 4545 bl.length()=206 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(77 notify.1 [notify cookie 94749062229376 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.135+0000 7f3ccd7fa640 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3cac003ea0 con 0x562c7c2d9120 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.136+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== watch-notify(notify_complete (2) cookie 94749062229376 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c7c32d3b0 con 0x562c7c2d9120 2024-09-10T04:50:33.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.136+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.136+0000 7f3c9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.137+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94749061990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2d9120 2024-09-10T04:50:33.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.138+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94749061990192] v32'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.138+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94749061966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.139+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94749061966016] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.139+0000 7f3dedb2c800 20 remove_watcher() i=0 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.139+0000 7f3dedb2c800 2 removed watcher, disabling cache 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.139+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94749061970816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2d9120 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.140+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94749061970816] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x562c7c2d9120 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.140+0000 7f3dedb2c800 20 remove_watcher() i=1 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.140+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94749061974832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.141+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94749061974832] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.141+0000 7f3dedb2c800 20 remove_watcher() i=2 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.141+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94749061977632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x7f3ddc0c7070 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.142+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94749061977632] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.142+0000 7f3dedb2c800 20 remove_watcher() i=3 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.142+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94749061973088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2dd5a0 2024-09-10T04:50:33.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.143+0000 7f3de984f640 1 -- 172.21.15.145:0/1849535396 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94749061973088] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ddc0a6070 con 0x562c7c2dd5a0 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.144+0000 7f3dedb2c800 20 remove_watcher() i=4 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.144+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94749061982528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2e25b0 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.144+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94749061982528] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.144+0000 7f3dedb2c800 20 remove_watcher() i=5 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.144+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94749061986320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x562c7c2e25b0 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.145+0000 7f3de3fff640 1 -- 172.21.15.145:0/1849535396 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94749061986320] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd4037040 con 0x562c7c2e25b0 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.145+0000 7f3dedb2c800 20 remove_watcher() i=6 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.145+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94749061988672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c7c320cf0 con 0x7f3ddc0c7070 2024-09-10T04:50:33.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.146+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94749061988672] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3de4041040 con 0x7f3ddc0c7070 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.146+0000 7f3dedb2c800 20 remove_watcher() i=7 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2dd5a0 msgr2=0x562c7c2df990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2dd5a0 0x562c7c2df990 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c2d9120 msgr2=0x562c7c2db5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c2d9120 0x562c7c2db5e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3ddc0c7070 msgr2=0x7f3ddc0a9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3ddc0c7070 0x7f3ddc0a9450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c7c2e25b0 msgr2=0x562c7c2e49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562c7c2e25b0 0x562c7c2e49c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cb403c730 msgr2=0x7f3cb403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cb403c730 0x7f3cb403ebf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x562c7c2a8690 tx=0x7f3dd4023040 comp rx=0 tx=0).stop 2024-09-10T04:50:33.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 msgr2=0x562c7c2cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1849535396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2c68f0 0x562c7c2cdd00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0a1620 tx=0x7f3ddc05af70 comp rx=0 tx=0).stop 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 reap_dead start 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dea050640 1 -- 172.21.15.145:0/1849535396 reap_dead start 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 shutdown_connections 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 >> 172.21.15.145:0/1849535396 conn(0x562c7c2c2cf0 msgr2=0x562c7c2c0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 shutdown_connections 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1849535396 wait complete. 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 msgr2=0x7f3cc403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 0x7f3cc403ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x562c7c1a2110 tx=0x7f3dd4006000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 msgr2=0x562c7c2ba3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc05d770 tx=0x7f3ddc0685b0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 shutdown_connections 2024-09-10T04:50:33.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cc403c780 0x7f3cc403ec40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/1278991129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c2b9fd0 0x562c7c2ba3f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 >> 172.21.15.145:0/1278991129 conn(0x562c7c2ae380 msgr2=0x562c7c2ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 shutdown_connections 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.147+0000 7f3dedb2c800 1 -- 172.21.15.145:0/1278991129 wait complete. 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2a44f0 msgr2=0x562c7c2a68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562c7c2a44f0 0x562c7c2a68e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c1a6030 msgr2=0x562c7c2a3250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562c7c1a6030 0x562c7c2a3250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c7c2a9b30 msgr2=0x562c7c2abf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562c7c2a9b30 0x562c7c2abf20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cd003c730 msgr2=0x7f3cd003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3cd003c730 0x7f3cd003ebf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd40013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 msgr2=0x562c7c1a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 --2- 172.21.15.145:0/428400694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c7c1a36a0 0x562c7c1a2dc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc025c20 tx=0x7f3ddc002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dea050640 1 -- 172.21.15.145:0/428400694 reap_dead start 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 shutdown_connections 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 >> 172.21.15.145:0/428400694 conn(0x562c7c19d1e0 msgr2=0x562c7c293740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 shutdown_connections 2024-09-10T04:50:33.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.148+0000 7f3dedb2c800 1 -- 172.21.15.145:0/428400694 wait complete. 2024-09-10T04:50:33.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T04:50:33.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T04:50:33.164 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-10T04:50:33.208 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.208 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.207+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.207+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.207+0000 7f105e12e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f05aa06fe0 0x55f05aa0fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.207+0000 7f105e12e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f05a8b0e40 con 0x55f05aa054c0 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.207+0000 7f105e12e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f05a87b680 con 0x55f05aa06fe0 2024-09-10T04:50:33.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f105156a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f05aa06fe0 0x55f05aa0fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f1059d6b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f05aa054c0 0x55f05aa058c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39308/0 (socket says 172.21.15.145:39308) 2024-09-10T04:50:33.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f1059d6b640 1 -- 172.21.15.145:0/1278607892 learned_addr learned my addr 172.21.15.145:0/1278607892 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f105156a640 1 -- 172.21.15.145:0/1278607892 >> v1:172.21.15.98:6789/0 conn(0x55f05aa054c0 legacy=0x55f05aa058c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f105156a640 1 -- 172.21.15.145:0/1278607892 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05a8976b0 con 0x55f05aa06fe0 2024-09-10T04:50:33.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.208+0000 7f105956a640 1 -- 172.21.15.145:0/1278607892 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837717480 0 0) 0x55f05a8b0e40 con 0x55f05aa054c0 2024-09-10T04:50:33.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.210+0000 7f105156a640 1 --2- 172.21.15.145:0/1278607892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa06fe0 0x55f05aa0fb00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f104400a470 tx=0x7f1044045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad32456cca37081 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.210+0000 7f105956a640 1 -- 172.21.15.145:0/1278607892 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044053570 con 0x55f05aa06fe0 2024-09-10T04:50:33.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.210+0000 7f105956a640 1 -- 172.21.15.145:0/1278607892 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1044058070 con 0x55f05aa06fe0 2024-09-10T04:50:33.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.210+0000 7f105956a640 1 -- 172.21.15.145:0/1278607892 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1044053880 con 0x55f05aa06fe0 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 -- 172.21.15.145:0/1278607892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa06fe0 msgr2=0x55f05aa0fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 --2- 172.21.15.145:0/1278607892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa06fe0 0x55f05aa0fb00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f104400a470 tx=0x7f1044045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 -- 172.21.15.145:0/1278607892 shutdown_connections 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 --2- 172.21.15.145:0/1278607892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa06fe0 0x55f05aa0fb00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 -- 172.21.15.145:0/1278607892 >> 172.21.15.145:0/1278607892 conn(0x55f05aa011f0 msgr2=0x55f05aa03630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 -- 172.21.15.145:0/1278607892 shutdown_connections 2024-09-10T04:50:33.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.211+0000 7f105e12e800 1 -- 172.21.15.145:0/1278607892 wait complete. 2024-09-10T04:50:33.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.225+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.225+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f105e12e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f105e12e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f05a89fdd0 con 0x55f05aa054c0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56236/0 (socket says 172.21.15.145:56236) 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f1059d6b640 1 -- 172.21.15.145:0/1898619726 learned_addr learned my addr 172.21.15.145:0/1898619726 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f1059d6b640 1 -- 172.21.15.145:0/1898619726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05a8b8e10 con 0x55f05aa054c0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.226+0000 7f1059d6b640 1 --2- 172.21.15.145:0/1898619726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f104c001ea0 tx=0x7f104c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9602a54ab75b8e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f0f47e07640 1 -- 172.21.15.145:0/1898619726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c008070 con 0x55f05aa054c0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f0f47e07640 1 -- 172.21.15.145:0/1898619726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c00d500 con 0x55f05aa054c0 2024-09-10T04:50:33.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f0f47e07640 1 -- 172.21.15.145:0/1898619726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c00d880 con 0x55f05aa054c0 2024-09-10T04:50:33.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 -- 172.21.15.145:0/1898619726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 msgr2=0x55f05aaf8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 --2- 172.21.15.145:0/1898619726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f104c001ea0 tx=0x7f104c00b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 -- 172.21.15.145:0/1898619726 shutdown_connections 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 --2- 172.21.15.145:0/1898619726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05aaf8710 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 -- 172.21.15.145:0/1898619726 >> 172.21.15.145:0/1898619726 conn(0x55f05aa011f0 msgr2=0x55f05aaf4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 -- 172.21.15.145:0/1898619726 shutdown_connections 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.227+0000 7f105e12e800 1 -- 172.21.15.145:0/1898619726 wait complete. 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f105e12e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05ab00060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f105e12e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f05aa10340 con 0x55f05aa054c0 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05ab00060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05ab00060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56248/0 (socket says 172.21.15.145:56248) 2024-09-10T04:50:33.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f1059d6b640 1 -- 172.21.15.145:0/2698192463 learned_addr learned my addr 172.21.15.145:0/2698192463 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.228+0000 7f1059d6b640 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05ab005c0 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f1059d6b640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05ab00060 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f104c0012f0 tx=0x7f104c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f0f46604640 1 -- 172.21.15.145:0/2698192463 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c00f9d0 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f0f46604640 1 -- 172.21.15.145:0/2698192463 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c00fb70 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f05ab00850 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f0f46604640 1 -- 172.21.15.145:0/2698192463 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c00fe50 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.229+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05ab01250 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f0f46604640 1 -- 172.21.15.145:0/2698192463 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f104c017040 con 0x55f05aa054c0 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f0f46604640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f4003c8d0 0x7f0f4003ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f0f46604640 1 -- 172.21.15.145:0/2698192463 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f104c015020 con 0x55f05aa054c0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f105156a640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f4003c8d0 0x7f0f4003ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05aa06fe0 0x55f05ab076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab07bf0 con 0x55f05aa06fe0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.230+0000 7f105a56c640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05aa06fe0 0x55f05ab076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f105156a640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f4003c8d0 0x7f0f4003ed90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1044057000 tx=0x7f1044052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f105a56c640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05aa06fe0 0x55f05ab076b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f105a56c640 1 -- 172.21.15.145:0/2698192463 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05aa06fe0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab084a0 0x55f05ab0a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab0b0d0 con 0x55f05ab084a0 2024-09-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.231+0000 7f1059d6b640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab084a0 0x55f05ab0a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.232+0000 7f1059d6b640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab084a0 0x55f05ab0a960 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.232+0000 7f1059d6b640 1 -- 172.21.15.145:0/2698192463 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f104c02d070 con 0x55f05ab084a0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.232+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab0c980 con 0x55f05aa06fe0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.232+0000 7f105a56c640 1 -- 172.21.15.145:0/2698192463 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05aa06fe0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.232+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab0bbb0 con 0x55f05ab084a0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f1059d6b640 1 -- 172.21.15.145:0/2698192463 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f104c02d070 con 0x55f05ab084a0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f05ab0dd30 0x55f05ab10120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab10660 con 0x55f05ab0dd30 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f105156a640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f05ab0dd30 0x55f05ab10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f105156a640 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f05ab0dd30 0x55f05ab10120 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.233+0000 7f105156a640 1 -- 172.21.15.145:0/2698192463 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1044051070 con 0x55f05ab0dd30 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f105e12e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f105e12e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f05a8fda00 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56250/0 (socket says 172.21.15.145:56250) 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f1059d6b640 1 -- 172.21.15.145:0/2228372331 learned_addr learned my addr 172.21.15.145:0/2228372331 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f1059d6b640 1 -- 172.21.15.145:0/2228372331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05ab1ec40 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f1059d6b640 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f104c00c010 tx=0x7f104c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.234+0000 7f0f3f7fe640 1 -- 172.21.15.145:0/2228372331 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c04b2a0 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f0f3f7fe640 1 -- 172.21.15.145:0/2228372331 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c01c970 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f05ab1f470 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f0f3f7fe640 1 -- 172.21.15.145:0/2228372331 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c01cb20 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05ab1fa10 con 0x55f05ab1e1e0 2024-09-10T04:50:33.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f0f3f7fe640 1 -- 172.21.15.145:0/2228372331 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f104c044990 con 0x55f05ab1e1e0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.235+0000 7f0f3f7fe640 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 0x7f0f3403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f0f3f7fe640 1 -- 172.21.15.145:0/2228372331 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f104c03bc90 con 0x55f05ab1e1e0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105156a640 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 0x7f0f3403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105156a640 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 0x7f0f3403ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f05ab01f90 tx=0x7f1044005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105e12e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f105e12e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f05aaf8f60 con 0x55f05ab2aae0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56260/0 (socket says 172.21.15.145:56260) 2024-09-10T04:50:33.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f1059d6b640 1 -- 172.21.15.145:0/2111438720 learned_addr learned my addr 172.21.15.145:0/2111438720 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.236+0000 7f1059d6b640 1 -- 172.21.15.145:0/2111438720 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05ab2b4d0 con 0x55f05ab2aae0 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f1059d6b640 1 --2- 172.21.15.145:0/2111438720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f104c001600 tx=0x7f104c01ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0dbfe2d92b5328 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f0f3d7fa640 1 -- 172.21.15.145:0/2111438720 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c035040 con 0x55f05ab2aae0 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f0f3d7fa640 1 -- 172.21.15.145:0/2111438720 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c02e550 con 0x55f05ab2aae0 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f0f3d7fa640 1 -- 172.21.15.145:0/2111438720 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c031020 con 0x55f05ab2aae0 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 -- 172.21.15.145:0/2111438720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 msgr2=0x55f05ab2aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 --2- 172.21.15.145:0/2111438720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f104c001600 tx=0x7f104c01ce30 comp rx=0 tx=0).stop 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 -- 172.21.15.145:0/2111438720 shutdown_connections 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 --2- 172.21.15.145:0/2111438720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab2aee0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 -- 172.21.15.145:0/2111438720 >> 172.21.15.145:0/2111438720 conn(0x55f05ab26ee0 msgr2=0x55f05ab25120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 -- 172.21.15.145:0/2111438720 shutdown_connections 2024-09-10T04:50:33.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.237+0000 7f105e12e800 1 -- 172.21.15.145:0/2111438720 wait complete. 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f105e12e800 1 Processor -- start 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f105e12e800 1 -- start start 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f105e12e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f105e12e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f05ab2b940 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f1059d6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56266/0 (socket says 172.21.15.145:56266) 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 learned_addr learned my addr 172.21.15.145:0/1619100071 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05ab32450 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f1059d6b640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f104c051580 tx=0x7f104c04bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f0f2b7fe640 1 -- 172.21.15.145:0/1619100071 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c035050 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f0f2b7fe640 1 -- 172.21.15.145:0/1619100071 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c04b7e0 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.238+0000 7f0f2b7fe640 1 -- 172.21.15.145:0/1619100071 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104c044130 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.239+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f05ab32450 con 0x55f05ab2aae0 2024-09-10T04:50:33.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.239+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05ab32450 con 0x55f05ab2aae0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.239+0000 7f0f2b7fe640 1 -- 172.21.15.145:0/1619100071 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f104c05c030 con 0x55f05ab2aae0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.239+0000 7f0f2b7fe640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f2403c6e0 0x7f0f2403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f0f2b7fe640 1 -- 172.21.15.145:0/1619100071 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f104c066070 con 0x55f05ab2aae0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105156a640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f2403c6e0 0x7f0f2403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05ab3d450 0x55f05ab3f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab40060 con 0x55f05ab3d450 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105a56c640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05ab3d450 0x55f05ab3f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105156a640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f2403c6e0 0x7f0f2403eba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1044000c00 tx=0x7f1044053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105a56c640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05ab3d450 0x55f05ab3f910 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.240+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 realm 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab3c780 con 0x55f05ab3d450 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab40af0 con 0x55f05ab3d450 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab418d0 0x55f05ab43cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab442f0 con 0x55f05ab418d0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f1059d6b640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab418d0 0x55f05ab43cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.241+0000 7f1059d6b640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab418d0 0x55f05ab43cc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab44b90 con 0x55f05ab3d450 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 20 searching for the correct realm 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f05ab46900 0x55f05ab48d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105156a640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f05ab46900 0x55f05ab48d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.242+0000 7f105156a640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f05ab46900 0x55f05ab48d30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f1059d6b640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f104c0269b0 0x7f104c04d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f105a56c640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f104c0269b0 0x7f104c04d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.243+0000 7f105a56c640 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f104c0269b0 0x7f104c04d0e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f105400a4d0 con 0x7f104c0269b0 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.244+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f105400a4d0 con 0x55f05ab3d450 2024-09-10T04:50:33.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.245+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x7f104c0269b0 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1054030040 con 0x7f104c0269b0 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.246+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.247+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.248+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x7f104c0269b0 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab3d450 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x7f104c0269b0 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x7f104c0269b0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.249+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1054030040 con 0x7f104c0269b0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab46900 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.250+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab49400 con 0x55f05ab418d0 2024-09-10T04:50:33.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab454e0 con 0x55f05ab3d450 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1054030040 con 0x55f05ab3d450 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab45960 con 0x55f05ab418d0 2024-09-10T04:50:33.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab45e00 con 0x7f104c0269b0 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.251+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 zone default found 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 4 Realm: () 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 zonegroup default 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab498d0 con 0x7f104c0269b0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4b450 con 0x55f05ab46900 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4b960 con 0x55f05ab46900 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 started sync module instance, tier type = 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.252+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4a760 con 0x55f05ab418d0 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.253+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.253+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94490802302080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4a760 con 0x55f05ab418d0 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.253+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4c470 con 0x55f05ab3d450 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.254+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94490802302080] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.255+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.255+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94490802306912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4a760 con 0x55f05ab3d450 2024-09-10T04:50:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.255+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4cf20 con 0x55f05ab418d0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.255+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94490802306912] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.256+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.256+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94490802309632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4a760 con 0x55f05ab418d0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.256+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4d990 con 0x7f104c0269b0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.257+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.257+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94490802312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4d950 con 0x7f104c0269b0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.257+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4e950 con 0x55f05ab418d0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.257+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94490802309632] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.258+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94490802312320] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.258+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.258+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94490802314624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4e950 con 0x55f05ab418d0 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.258+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4f1f0 con 0x55f05ab46900 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.259+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.259+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94490802318656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4e950 con 0x55f05ab46900 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.259+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab50110 con 0x55f05ab46900 2024-09-10T04:50:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.259+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94490802314624] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.261+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94490802318656] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.262+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.262+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94490802320784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4e480 con 0x55f05ab46900 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.262+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab509f0 con 0x7f104c0269b0 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94490802324736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab50960 con 0x7f104c0269b0 2024-09-10T04:50:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=0 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=1 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=2 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=3 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=4 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=5 2024-09-10T04:50:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94490802320784] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.263+0000 7f105e12e800 20 add_watcher() i=6 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94490802324736] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105e12e800 20 add_watcher() i=7 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105e12e800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4fbe0 con 0x55f05ab3d450 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.264+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94490802326928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4fbe0 con 0x55f05ab3d450 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.265+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94490802326928] v32'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.265+0000 7f0f0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.265+0000 7f105e12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.265+0000 7f105e12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105e12e800 5 note: GC not initialized 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f0f0a7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105e12e800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105e12e800 20 Filter name: none 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f0e7bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105e12e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab869f0 con 0x55f05ab3d450 2024-09-10T04:50:33.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.266+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.267+0000 7f105e12e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.267+0000 7f0f0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.267+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94490802326928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab513d0 con 0x55f05ab3d450 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.268+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94490802326928] v32'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.269+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94490802302080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab50d90 con 0x55f05ab418d0 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.269+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94490802302080] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.269+0000 7f105e12e800 20 remove_watcher() i=0 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.269+0000 7f105e12e800 2 removed watcher, disabling cache 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.269+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94490802306912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x55f05ab3d450 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.270+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94490802306912] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x55f05ab3d450 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.270+0000 7f105e12e800 20 remove_watcher() i=1 2024-09-10T04:50:33.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.270+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94490802309632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x55f05ab418d0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.272+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94490802309632] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.272+0000 7f105e12e800 20 remove_watcher() i=2 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.272+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94490802312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x7f104c0269b0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.273+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94490802312320] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.273+0000 7f105e12e800 20 remove_watcher() i=3 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.273+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94490802314624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x55f05ab418d0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.276+0000 7f1059d6b640 1 -- 172.21.15.145:0/1619100071 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94490802314624] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104c070020 con 0x55f05ab418d0 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.276+0000 7f105e12e800 20 remove_watcher() i=4 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.276+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94490802318656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x55f05ab46900 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.277+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94490802318656] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.277+0000 7f105e12e800 20 remove_watcher() i=5 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.277+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94490802320784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4ac80 con 0x55f05ab46900 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.278+0000 7f105156a640 1 -- 172.21.15.145:0/1619100071 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94490802320784] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f104407c040 con 0x55f05ab46900 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.278+0000 7f105e12e800 20 remove_watcher() i=6 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.278+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94490802324736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f05ab4f590 con 0x7f104c0269b0 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94490802324736] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1054041040 con 0x7f104c0269b0 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 20 remove_watcher() i=7 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab418d0 msgr2=0x55f05ab43cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab418d0 0x55f05ab43cc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05ab3d450 msgr2=0x55f05ab3f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05ab3d450 0x55f05ab3f910 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f104c0269b0 msgr2=0x7f104c04d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f104c0269b0 0x7f104c04d0e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f05ab46900 msgr2=0x55f05ab48d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f05ab46900 0x55f05ab48d30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f2403c6e0 msgr2=0x7f0f2403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f2403c6e0 0x7f0f2403eba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1044000c00 tx=0x7f1044053000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 msgr2=0x55f05ab31ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105a56c640 1 -- 172.21.15.145:0/1619100071 reap_dead start 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f104c051580 tx=0x7f104c04bba0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 shutdown_connections 2024-09-10T04:50:33.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/1619100071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab2aae0 0x55f05ab31ef0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 >> 172.21.15.145:0/1619100071 conn(0x55f05ab26ee0 msgr2=0x55f05ab250f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 shutdown_connections 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/1619100071 wait complete. 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 msgr2=0x7f0f3403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 0x7f0f3403ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f05ab01f90 tx=0x7f1044005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 msgr2=0x55f05ab1e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f104c00c010 tx=0x7f104c00e940 comp rx=0 tx=0).stop 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 shutdown_connections 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f3403c730 0x7f0f3403ebf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 --2- 172.21.15.145:0/2228372331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05ab1e1e0 0x55f05ab1e600 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 >> 172.21.15.145:0/2228372331 conn(0x55f05ab12590 msgr2=0x55f05ab12970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 shutdown_connections 2024-09-10T04:50:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.279+0000 7f105e12e800 1 -- 172.21.15.145:0/2228372331 wait complete. 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab084a0 msgr2=0x55f05ab0a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f05ab084a0 0x55f05ab0a960 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05aa06fe0 msgr2=0x55f05ab076b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f05aa06fe0 0x55f05ab076b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f05ab0dd30 msgr2=0x55f05ab10120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f05ab0dd30 0x55f05ab10120 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f4003c8d0 msgr2=0x7f0f4003ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0f4003c8d0 0x7f0f4003ed90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1044057000 tx=0x7f1044052000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 msgr2=0x55f05ab00060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 --2- 172.21.15.145:0/2698192463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f05aa054c0 0x55f05ab00060 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f104c0012f0 tx=0x7f104c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105a56c640 1 -- 172.21.15.145:0/2698192463 reap_dead start 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 shutdown_connections 2024-09-10T04:50:33.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 >> 172.21.15.145:0/2698192463 conn(0x55f05aa011f0 msgr2=0x55f05aaf99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 shutdown_connections 2024-09-10T04:50:33.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.280+0000 7f105e12e800 1 -- 172.21.15.145:0/2698192463 wait complete. 2024-09-10T04:50:33.292 INFO:teuthology.orchestra.run.smithi145.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"EBSHppxvPq3kgWkPPQ8vjE+7","ver":2},"mtime":"2024-09-10T04:50:33.131218Z","data":{"bucket":{"name":"myfoo","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","bucket_id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-10T04:50:30.682311Z","linked":true,"has_bucket_info":false}} 2024-09-10T04:50:33.293 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'EBSHppxvPq3kgWkPPQ8vjE+7', 'ver': 2}, 'mtime': '2024-09-10T04:50:33.131218Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'bucket_id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-10T04:50:30.682311Z', 'linked': True, 'has_bucket_info': False}} 2024-09-10T04:50:33.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T04:50:33.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T04:50:33.293 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-10T04:50:33.380 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.380 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.379+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.379+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.379+0000 7f0cf3523800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562fde75ce00 0x562fde75db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.379+0000 7f0cf3523800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562fde607e40 con 0x562fde75e040 2024-09-10T04:50:33.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.379+0000 7f0cf3523800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562fde5d2680 con 0x562fde75ce00 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0cef20c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562fde75ce00 0x562fde75db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0ceea0b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x562fde75e040 0x562fde762da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39314/0 (socket says 172.21.15.145:39314) 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0ceea0b640 1 -- 172.21.15.145:0/840786851 learned_addr learned my addr 172.21.15.145:0/840786851 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0cef20c640 1 -- 172.21.15.145:0/840786851 >> v1:172.21.15.98:6789/0 conn(0x562fde75e040 legacy=0x562fde762da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0cee20a640 1 -- 172.21.15.145:0/840786851 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758059562 0 0) 0x562fde607e40 con 0x562fde75e040 2024-09-10T04:50:33.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.380+0000 7f0cef20c640 1 -- 172.21.15.145:0/840786851 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde5ee6b0 con 0x562fde75ce00 2024-09-10T04:50:33.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.382+0000 7f0cef20c640 1 --2- 172.21.15.145:0/840786851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde75db00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005fd0 tx=0x7f0ce0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89628e31257bb54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.382+0000 7f0cee20a640 1 -- 172.21.15.145:0/840786851 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0058530 con 0x562fde75ce00 2024-09-10T04:50:33.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.382+0000 7f0cee20a640 1 -- 172.21.15.145:0/840786851 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce00586d0 con 0x562fde75ce00 2024-09-10T04:50:33.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.382+0000 7f0cee20a640 1 -- 172.21.15.145:0/840786851 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00589d0 con 0x562fde75ce00 2024-09-10T04:50:33.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 -- 172.21.15.145:0/840786851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 msgr2=0x562fde75db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 --2- 172.21.15.145:0/840786851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde75db00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005fd0 tx=0x7f0ce0045c30 comp rx=0 tx=0).stop 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 -- 172.21.15.145:0/840786851 shutdown_connections 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 --2- 172.21.15.145:0/840786851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde75db00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 -- 172.21.15.145:0/840786851 >> 172.21.15.145:0/840786851 conn(0x562fde7581d0 msgr2=0x562fde75a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 -- 172.21.15.145:0/840786851 shutdown_connections 2024-09-10T04:50:33.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.383+0000 7f0cf3523800 1 -- 172.21.15.145:0/840786851 wait complete. 2024-09-10T04:50:33.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.396+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cf3523800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cf3523800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562fde5f6dd0 con 0x562fde75ce00 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56280/0 (socket says 172.21.15.145:56280) 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cef20c640 1 -- 172.21.15.145:0/1424090312 learned_addr learned my addr 172.21.15.145:0/1424090312 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.397+0000 7f0cef20c640 1 -- 172.21.15.145:0/1424090312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde60fe10 con 0x562fde75ce00 2024-09-10T04:50:33.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cef20c640 1 --2- 172.21.15.145:0/1424090312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0025a60 tx=0x7f0ce0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a86402afda53c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0bdd60a640 1 -- 172.21.15.145:0/1424090312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0068070 con 0x562fde75ce00 2024-09-10T04:50:33.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0bdd60a640 1 -- 172.21.15.145:0/1424090312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0058880 con 0x562fde75ce00 2024-09-10T04:50:33.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0bdd60a640 1 -- 172.21.15.145:0/1424090312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0058ba0 con 0x562fde75ce00 2024-09-10T04:50:33.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 -- 172.21.15.145:0/1424090312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 msgr2=0x562fde84c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1424090312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0025a60 tx=0x7f0ce0051000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 -- 172.21.15.145:0/1424090312 shutdown_connections 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1424090312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde84c420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 -- 172.21.15.145:0/1424090312 >> 172.21.15.145:0/1424090312 conn(0x562fde7581d0 msgr2=0x562fde847da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 -- 172.21.15.145:0/1424090312 shutdown_connections 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.398+0000 7f0cf3523800 1 -- 172.21.15.145:0/1424090312 wait complete. 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cf3523800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde6d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cf3523800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562fde75e730 con 0x562fde75ce00 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde6d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde6d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56296/0 (socket says 172.21.15.145:56296) 2024-09-10T04:50:33.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cef20c640 1 -- 172.21.15.145:0/1025492544 learned_addr learned my addr 172.21.15.145:0/1025492544 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.399+0000 7f0cef20c640 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde6d12d0 con 0x562fde75ce00 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0cef20c640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde6d0d70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0025a60 tx=0x7f0ce0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0bdbe07640 1 -- 172.21.15.145:0/1025492544 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0068040 con 0x562fde75ce00 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0bdbe07640 1 -- 172.21.15.145:0/1025492544 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0071070 con 0x562fde75ce00 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fde857a20 con 0x562fde75ce00 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0bdbe07640 1 -- 172.21.15.145:0/1025492544 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00637b0 con 0x562fde75ce00 2024-09-10T04:50:33.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.400+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde857f80 con 0x562fde75ce00 2024-09-10T04:50:33.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0bdbe07640 1 -- 172.21.15.145:0/1025492544 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ce0063950 con 0x562fde75ce00 2024-09-10T04:50:33.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0bdbe07640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bd403c780 0x7f0bd403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0bdbe07640 1 -- 172.21.15.145:0/1025492544 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ce0097470 con 0x562fde75ce00 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bd403c780 0x7f0bd403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde75e040 0x562fde85bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde85c590 con 0x562fde75e040 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde75e040 0x562fde85bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.401+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bd403c780 0x7f0bd403ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8000c00 tx=0x7f0cd80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.402+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde75e040 0x562fde85bf70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.402+0000 7f0cefa0d640 1 -- 172.21.15.145:0/1025492544 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde75e040 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.402+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde85d380 0x562fde85f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.402+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde85fda0 con 0x562fde85d380 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.402+0000 7f0cef20c640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde85d380 0x562fde85f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cef20c640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde85d380 0x562fde85f770 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cef20c640 1 -- 172.21.15.145:0/1025492544 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ce00769d0 con 0x562fde85d380 2024-09-10T04:50:33.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde861650 con 0x562fde75e040 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cefa0d640 1 -- 172.21.15.145:0/1025492544 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde75e040 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde860880 con 0x562fde85d380 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cef20c640 1 -- 172.21.15.145:0/1025492544 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ce00769d0 con 0x562fde85d380 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.403+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562fde862a00 0x562fde864df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde865330 con 0x562fde862a00 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562fde862a00 0x562fde864df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562fde862a00 0x562fde864df0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0ceea0b640 1 -- 172.21.15.145:0/1025492544 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cd800f670 con 0x562fde862a00 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.404+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cf3523800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cf3523800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562fde654a00 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56312/0 (socket says 172.21.15.145:56312) 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cef20c640 1 -- 172.21.15.145:0/1682863655 learned_addr learned my addr 172.21.15.145:0/1682863655 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cef20c640 1 -- 172.21.15.145:0/1682863655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde873920 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cef20c640 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005d20 tx=0x7f0ce006b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0bd9602640 1 -- 172.21.15.145:0/1682863655 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0094150 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0bd9602640 1 -- 172.21.15.145:0/1682863655 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce00942f0 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0bd9602640 1 -- 172.21.15.145:0/1682863655 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce008e310 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fde874150 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.405+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde8746f0 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.406+0000 7f0bd9602640 1 -- 172.21.15.145:0/1682863655 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ce006b760 con 0x562fde872ec0 2024-09-10T04:50:33.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.406+0000 7f0bd9602640 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 0x7f0bc803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.406+0000 7f0bd9602640 1 -- 172.21.15.145:0/1682863655 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ce0087070 con 0x562fde872ec0 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.406+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 0x7f0bc803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 0x7f0bc803ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x562fde859310 tx=0x7f0cd8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cf3523800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cf3523800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562fde84cbb0 con 0x562fde87f710 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56314/0 (socket says 172.21.15.145:56314) 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cef20c640 1 -- 172.21.15.145:0/3726690718 learned_addr learned my addr 172.21.15.145:0/3726690718 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cef20c640 1 -- 172.21.15.145:0/3726690718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde8800e0 con 0x562fde87f710 2024-09-10T04:50:33.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.407+0000 7f0cef20c640 1 --2- 172.21.15.145:0/3726690718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0074b60 tx=0x7f0ce00746b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a772a72712afff39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0bd2ffd640 1 -- 172.21.15.145:0/3726690718 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00a5070 con 0x562fde87f710 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0bd2ffd640 1 -- 172.21.15.145:0/3726690718 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce008e950 con 0x562fde87f710 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0bd2ffd640 1 -- 172.21.15.145:0/3726690718 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0083050 con 0x562fde87f710 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- 172.21.15.145:0/3726690718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 msgr2=0x562fde87faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 --2- 172.21.15.145:0/3726690718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0074b60 tx=0x7f0ce00746b0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- 172.21.15.145:0/3726690718 shutdown_connections 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 --2- 172.21.15.145:0/3726690718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde87faf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- 172.21.15.145:0/3726690718 >> 172.21.15.145:0/3726690718 conn(0x562fde87bb10 msgr2=0x562fde879d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- 172.21.15.145:0/3726690718 shutdown_connections 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- 172.21.15.145:0/3726690718 wait complete. 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 Processor -- start 2024-09-10T04:50:33.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.408+0000 7f0cf3523800 1 -- start start 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cf3523800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde886b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cf3523800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562fde880570 con 0x562fde87f710 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde886b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cef20c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde886b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56328/0 (socket says 172.21.15.145:56328) 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 learned_addr learned my addr 172.21.15.145:0/2495371241 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde887070 con 0x562fde87f710 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cef20c640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde886b10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0068fd0 tx=0x7f0ce0088ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0bd17fa640 1 -- 172.21.15.145:0/2495371241 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00ba070 con 0x562fde87f710 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0bd17fa640 1 -- 172.21.15.145:0/2495371241 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0080560 con 0x562fde87f710 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fde887070 con 0x562fde87f710 2024-09-10T04:50:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0bd17fa640 1 -- 172.21.15.145:0/2495371241 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00a5040 con 0x562fde87f710 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.409+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde887070 con 0x562fde87f710 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.410+0000 7f0bd17fa640 1 -- 172.21.15.145:0/2495371241 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ce00bd070 con 0x562fde87f710 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.410+0000 7f0bd17fa640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bb803c730 0x7f0bb803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.410+0000 7f0bd17fa640 1 -- 172.21.15.145:0/2495371241 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ce00b0030 con 0x562fde87f710 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.410+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bb803c730 0x7f0bb803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.411+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bb803c730 0x7f0bb803ebf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800ffd0 tx=0x7f0cd8023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.411+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.411+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde892130 0x562fde8945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.411+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde894d40 con 0x562fde892130 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.411+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde892130 0x562fde8945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde892130 0x562fde8945f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde892130 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 realm 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde891460 con 0x562fde892130 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde892130 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8957d0 con 0x562fde892130 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde892130 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde8965b0 0x562fde8989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.412+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde899000 con 0x562fde8965b0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cef20c640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde8965b0 0x562fde8989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cef20c640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde8965b0 0x562fde8989a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde892130 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 20 searching for the correct realm 2024-09-10T04:50:33.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562fde89b5c0 0x562fde89d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.413+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde89e0c0 con 0x562fde89b5c0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562fde89b5c0 0x562fde89d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0ceea0b640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562fde89b5c0 0x562fde89d9f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde89e0c0 con 0x562fde8965b0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0cef20c640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0ce00bf060 0x7f0ce004f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde89e0c0 con 0x7f0ce00bf060 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.414+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0ce00bf060 0x7f0ce004f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0ce00bf060 0x7f0ce004f3f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ce80083e0 con 0x7f0ce00bf060 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce80083e0 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.415+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.416+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x7f0ce00bf060 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x7f0ce00bf060 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.417+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.418+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.419+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde892130 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.420+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde89b5c0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.421+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562fde899850 con 0x562fde8965b0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde89a0a0 con 0x562fde892130 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde89a490 con 0x562fde8965b0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.422+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde89a8b0 con 0x7f0ce00bf060 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 zone default found 2024-09-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 4 Realm: () 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 zonegroup default 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde89e540 con 0x7f0ce00bf060 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a00c0 con 0x562fde89b5c0 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a0570 con 0x562fde89b5c0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 started sync module instance, tier type = 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.423+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde89f3d0 con 0x562fde8965b0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.425+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.425+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94763597035456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde89fbe0 con 0x562fde8965b0 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.425+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a1370 con 0x562fde892130 2024-09-10T04:50:33.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.426+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94763597035456] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.426+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.426+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94763597040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a1790 con 0x562fde892130 2024-09-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.426+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a2190 con 0x562fde8965b0 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.427+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94763597040080] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.427+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.427+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94763597041136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a2530 con 0x562fde8965b0 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.427+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a2ff0 con 0x7f0ce00bf060 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.428+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94763597041136] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.428+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.428+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94763597048512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a2fb0 con 0x7f0ce00bf060 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.428+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a3a10 con 0x562fde8965b0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.429+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94763597048512] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.429+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.429+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94763597044896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a3a10 con 0x562fde8965b0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.429+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a4420 con 0x562fde89b5c0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.430+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94763597044896] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.430+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.430+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94763597053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a4810 con 0x562fde89b5c0 2024-09-10T04:50:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.430+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a5210 con 0x562fde89b5c0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.431+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94763597053808] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.431+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.431+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94763597051120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a5ab0 con 0x562fde89b5c0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.431+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a6470 con 0x7f0ce00bf060 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94763597051120] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94763597062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8a63e0 con 0x7f0ce00bf060 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=0 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=1 2024-09-10T04:50:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=2 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=3 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=4 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=5 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.433+0000 7f0cf3523800 20 add_watcher() i=6 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94763597062080] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x7f0ce00bf060 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cf3523800 20 add_watcher() i=7 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cf3523800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8abc30 con 0x562fde892130 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.434+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94763597059584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde853c50 con 0x562fde892130 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.435+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94763597059584] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.435+0000 7f0ba5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.435+0000 7f0cf3523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.435+0000 7f0cf3523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.435+0000 7f0cf3523800 5 note: GC not initialized 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0ba4fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 20 Filter name: none 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0b1e7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8deae0 con 0x562fde892130 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.436+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8de540 con 0x562fde892130 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.c 8:36b6b928:root::.bucket.meta.testx%3amyfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e22f0 con 0x562fde892130 2024-09-10T04:50:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f0ce8025040 con 0x562fde892130 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 20 rados_obj.operate() r=0 bl.length=420 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.437+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e6990 con 0x562fde892130 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.438+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.438+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8ea2a0 con 0x562fde89b5c0 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [create,call,writefull 0~387,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x7 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94763597332544 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9d60 con 0x562fde892130 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== watch-notify(notify (1) cookie 94763597040080 notify 137438953476 ret 0) ==== 778+0+0 (crc 0 0 0) 0x562fde8e26e0 con 0x562fde892130 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0bd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94763597040080 notifier 4559 bl.length()=736 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(67 notify.1 [notify cookie 94763597332544 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0bd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x7 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0bd2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0bd2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0bd2ffd640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0bb4003ea0 con 0x562fde892130 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== watch-notify(notify_complete (2) cookie 94763597332544 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fde8e0790 con 0x562fde892130 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.440+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9ee0 con 0x7f0ce00bf060 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.441+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x7f0ce00bf060 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9ee0 con 0x7f0ce00bf060 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x7f0ce00bf060 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cf3523800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cf3523800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cf3523800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.442+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94763597339184 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9e50 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== watch-notify(notify (1) cookie 94763597051120 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x562fde8e6bd0 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0bd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94763597051120 notifier 4559 bl.length()=314 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0bd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0bd2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0bd2ffd640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0bb4003ea0 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [notify cookie 94763597339184 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 94763597339184 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0cd8018040 con 0x562fde89b5c0 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.443+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9ee0 con 0x562fde892130 2024-09-10T04:50:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.444+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.444+0000 7f0cf3523800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.444+0000 7f0cf3523800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.444+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94763597339184 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9e50 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94763597044896 notify 137438953500 ret 0) ==== 197+0+0 (crc 0 0 0) 0x562fde874150 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0bd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94763597044896 notifier 4559 bl.length()=155 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(74 notify.4 [notify cookie 94763597339184 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0bd27fc640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b240032c0 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94763597339184 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fde873920 con 0x562fde8965b0 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.445+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 8.c 8:36b6b928:root::.bucket.meta.testx%3amyfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9e60 con 0x562fde892130 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.446+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.446+0000 7f0cf3523800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 from cache 2024-09-10T04:50:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.446+0000 7f0cf3523800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.446+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94763597310352 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562fde8e9e60 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94763597035456 notify 137438953501 ret 0) ==== 254+0+0 (crc 0 0 0) 0x562fde873920 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0bd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94763597035456 notifier 4559 bl.length()=212 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0bd27fc640 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b24003330 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(77 notify.0 [notify cookie 94763597310352 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.447+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94763597310352 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562fde857f80 con 0x562fde8965b0 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.448+0000 7f0ba5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.448+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94763597059584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde892130 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.449+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94763597059584] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.449+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94763597035456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde8965b0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.450+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94763597035456] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.450+0000 7f0cf3523800 20 remove_watcher() i=0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.450+0000 7f0cf3523800 2 removed watcher, disabling cache 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.450+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94763597040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde892130 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.451+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94763597040080] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x562fde892130 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.451+0000 7f0cf3523800 20 remove_watcher() i=1 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.451+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94763597041136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde8965b0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.452+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94763597041136] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.452+0000 7f0cf3523800 20 remove_watcher() i=2 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.452+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94763597048512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x7f0ce00bf060 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.453+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94763597048512] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x7f0ce00bf060 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.453+0000 7f0cf3523800 20 remove_watcher() i=3 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.453+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94763597044896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde8965b0 2024-09-10T04:50:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.454+0000 7f0cef20c640 1 -- 172.21.15.145:0/2495371241 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94763597044896] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce00bc030 con 0x562fde8965b0 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.454+0000 7f0cf3523800 20 remove_watcher() i=4 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.454+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94763597053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde89b5c0 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.455+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94763597053808] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.455+0000 7f0cf3523800 20 remove_watcher() i=5 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.455+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94763597051120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x562fde89b5c0 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.456+0000 7f0ceea0b640 1 -- 172.21.15.145:0/2495371241 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94763597051120] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd8037040 con 0x562fde89b5c0 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.456+0000 7f0cf3523800 20 remove_watcher() i=6 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.456+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94763597062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562fde8dc9a0 con 0x7f0ce00bf060 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94763597062080] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ce8043040 con 0x7f0ce00bf060 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 20 remove_watcher() i=7 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde8965b0 msgr2=0x562fde8989a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde8965b0 0x562fde8989a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde892130 msgr2=0x562fde8945f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde892130 0x562fde8945f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0ce00bf060 msgr2=0x7f0ce004f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0ce00bf060 0x7f0ce004f3f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562fde89b5c0 msgr2=0x562fde89d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562fde89b5c0 0x562fde89d9f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bb803c730 msgr2=0x7f0bb803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bb803c730 0x7f0bb803ebf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800ffd0 tx=0x7f0cd8023040 comp rx=0 tx=0).stop 2024-09-10T04:50:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 msgr2=0x562fde886b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/2495371241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde87f710 0x562fde886b10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0068fd0 tx=0x7f0ce0088ef0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 reap_dead start 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cefa0d640 1 -- 172.21.15.145:0/2495371241 reap_dead start 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 shutdown_connections 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 >> 172.21.15.145:0/2495371241 conn(0x562fde87bb10 msgr2=0x562fde879d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 shutdown_connections 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/2495371241 wait complete. 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 msgr2=0x7f0bc803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 0x7f0bc803ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x562fde859310 tx=0x7f0cd8006000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 msgr2=0x562fde8732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005d20 tx=0x7f0ce006b390 comp rx=0 tx=0).stop 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 shutdown_connections 2024-09-10T04:50:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bc803c730 0x7f0bc803ebf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1682863655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde872ec0 0x562fde8732e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.457+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 >> 172.21.15.145:0/1682863655 conn(0x562fde867270 msgr2=0x562fde867650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 shutdown_connections 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1682863655 wait complete. 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde85d380 msgr2=0x562fde85f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562fde85d380 0x562fde85f770 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde75e040 msgr2=0x562fde85bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562fde75e040 0x562fde85bf70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562fde862a00 msgr2=0x562fde864df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562fde862a00 0x562fde864df0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bd403c780 msgr2=0x7f0bd403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0bd403c780 0x7f0bd403ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8000c00 tx=0x7f0cd80013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 msgr2=0x562fde6d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 --2- 172.21.15.145:0/1025492544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562fde75ce00 0x562fde6d0d70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0025a60 tx=0x7f0ce0003330 comp rx=0 tx=0).stop 2024-09-10T04:50:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cefa0d640 1 -- 172.21.15.145:0/1025492544 reap_dead start 2024-09-10T04:50:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 shutdown_connections 2024-09-10T04:50:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 >> 172.21.15.145:0/1025492544 conn(0x562fde7581d0 msgr2=0x562fde84d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 shutdown_connections 2024-09-10T04:50:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.458+0000 7f0cf3523800 1 -- 172.21.15.145:0/1025492544 wait complete. 2024-09-10T04:50:33.480 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T04:50:33.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T04:50:33.480 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-10T04:50:33.527 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.527 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.526+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.526+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.526+0000 7f5c8cd40800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d868ae2210 0x55d868ae7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.526+0000 7f5c8cd40800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d86898be40 con 0x55d868ae0e00 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.526+0000 7f5c8cd40800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55d868956680 con 0x55d868ae2210 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c80285640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d868ae2210 0x55d868ae7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c88a86640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55d868ae0e00 0x55d868ae1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39318/0 (socket says 172.21.15.145:39318) 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c88a86640 1 -- 172.21.15.145:0/1151604687 learned_addr learned my addr 172.21.15.145:0/1151604687 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c80285640 1 -- 172.21.15.145:0/1151604687 >> v1:172.21.15.98:6789/0 conn(0x55d868ae0e00 legacy=0x55d868ae1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c83fff640 1 -- 172.21.15.145:0/1151604687 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020096577 0 0) 0x55d86898be40 con 0x55d868ae0e00 2024-09-10T04:50:33.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.527+0000 7f5c80285640 1 -- 172.21.15.145:0/1151604687 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8689726b0 con 0x55d868ae2210 2024-09-10T04:50:33.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c80285640 1 --2- 172.21.15.145:0/1151604687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae2210 0x55d868ae7db0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000a470 tx=0x7f5c70045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b12d5f837269d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c83fff640 1 -- 172.21.15.145:0/1151604687 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c70053570 con 0x55d868ae2210 2024-09-10T04:50:33.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c83fff640 1 -- 172.21.15.145:0/1151604687 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c70058070 con 0x55d868ae2210 2024-09-10T04:50:33.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c83fff640 1 -- 172.21.15.145:0/1151604687 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c70053880 con 0x55d868ae2210 2024-09-10T04:50:33.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1151604687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae2210 msgr2=0x55d868ae7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1151604687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae2210 0x55d868ae7db0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000a470 tx=0x7f5c70045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1151604687 shutdown_connections 2024-09-10T04:50:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1151604687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae2210 0x55d868ae7db0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1151604687 >> 172.21.15.145:0/1151604687 conn(0x55d868adc1d0 msgr2=0x55d868ade630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.529+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1151604687 shutdown_connections 2024-09-10T04:50:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.530+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1151604687 wait complete. 2024-09-10T04:50:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c8cd40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c8cd40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d86897add0 con 0x55d868ae0e00 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56350/0 (socket says 172.21.15.145:56350) 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.543+0000 7f5c88a86640 1 -- 172.21.15.145:0/1909092976 learned_addr learned my addr 172.21.15.145:0/1909092976 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.544+0000 7f5c88a86640 1 -- 172.21.15.145:0/1909092976 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868993e10 con 0x55d868ae0e00 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.544+0000 7f5c88a86640 1 --2- 172.21.15.145:0/1909092976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5c78001ea0 tx=0x7f5c7800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8290bba9ce08d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.544+0000 7f5b76e0d640 1 -- 172.21.15.145:0/1909092976 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78008070 con 0x55d868ae0e00 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.544+0000 7f5b76e0d640 1 -- 172.21.15.145:0/1909092976 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7800d500 con 0x55d868ae0e00 2024-09-10T04:50:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.544+0000 7f5b76e0d640 1 -- 172.21.15.145:0/1909092976 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7800d880 con 0x55d868ae0e00 2024-09-10T04:50:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1909092976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 msgr2=0x55d868bd03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1909092976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5c78001ea0 tx=0x7f5c7800b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1909092976 shutdown_connections 2024-09-10T04:50:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1909092976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd03c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1909092976 >> 172.21.15.145:0/1909092976 conn(0x55d868adc1d0 msgr2=0x55d868bcbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1909092976 shutdown_connections 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1909092976 wait complete. 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.545+0000 7f5c8cd40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d868ae2900 con 0x55d868ae0e00 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56358/0 (socket says 172.21.15.145:56358) 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c88a86640 1 -- 172.21.15.145:0/1448910689 learned_addr learned my addr 172.21.15.145:0/1448910689 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c88a86640 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868bd7150 con 0x55d868ae0e00 2024-09-10T04:50:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c88a86640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd6bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5c780012f0 tx=0x7f5c78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5b7560a640 1 -- 172.21.15.145:0/1448910689 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7800f9d0 con 0x55d868ae0e00 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5b7560a640 1 -- 172.21.15.145:0/1448910689 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7800fb70 con 0x55d868ae0e00 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d868bd73e0 con 0x55d868ae0e00 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5b7560a640 1 -- 172.21.15.145:0/1448910689 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7800fe50 con 0x55d868ae0e00 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.546+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d868bd7de0 con 0x55d868ae0e00 2024-09-10T04:50:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.547+0000 7f5b7560a640 1 -- 172.21.15.145:0/1448910689 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c78017040 con 0x55d868ae0e00 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.547+0000 7f5b7560a640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b7003eb30 0x7f5b70040ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.547+0000 7f5b7560a640 1 -- 172.21.15.145:0/1448910689 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5c78015020 con 0x55d868ae0e00 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c80285640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b7003eb30 0x7f5b70040ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868ae2210 0x55d868bde240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868bde780 con 0x55d868ae2210 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c89287640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868ae2210 0x55d868bde240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c80285640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b7003eb30 0x7f5b70040ff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5c70057000 tx=0x7f5c70052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c89287640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868ae2210 0x55d868bde240 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c89287640 1 -- 172.21.15.145:0/1448910689 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868ae2210 2024-09-10T04:50:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868bdf030 0x55d868be14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.548+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868be1c60 con 0x55d868bdf030 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c88a86640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868bdf030 0x55d868be14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c88a86640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868bdf030 0x55d868be14f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c88a86640 1 -- 172.21.15.145:0/1448910689 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c7802d070 con 0x55d868bdf030 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868be3510 con 0x55d868ae2210 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c89287640 1 -- 172.21.15.145:0/1448910689 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868ae2210 2024-09-10T04:50:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.549+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868be2740 con 0x55d868bdf030 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c88a86640 1 -- 172.21.15.145:0/1448910689 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c7802d070 con 0x55d868bdf030 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d868be48c0 0x55d868be6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868be71f0 con 0x55d868be48c0 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c80285640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d868be48c0 0x55d868be6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c80285640 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d868be48c0 0x55d868be6cb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.550+0000 7f5c80285640 1 -- 172.21.15.145:0/1448910689 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c70051070 con 0x55d868be48c0 2024-09-10T04:50:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c8cd40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c8cd40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d8689d8a00 con 0x55d868bf9150 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56374/0 (socket says 172.21.15.145:56374) 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c88a86640 1 -- 172.21.15.145:0/3135413441 learned_addr learned my addr 172.21.15.145:0/3135413441 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c88a86640 1 -- 172.21.15.145:0/3135413441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868bf9bb0 con 0x55d868bf9150 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.551+0000 7f5c88a86640 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800eb00 tx=0x7f5c78018e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5b6e7fc640 1 -- 172.21.15.145:0/3135413441 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7804b2a0 con 0x55d868bf9150 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5b6e7fc640 1 -- 172.21.15.145:0/3135413441 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7801ac80 con 0x55d868bf9150 2024-09-10T04:50:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5b6e7fc640 1 -- 172.21.15.145:0/3135413441 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c780183d0 con 0x55d868bf9150 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d868bfa3e0 con 0x55d868bf9150 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d868bfa980 con 0x55d868bf9150 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5b6e7fc640 1 -- 172.21.15.145:0/3135413441 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c78018570 con 0x55d868bf9150 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.552+0000 7f5b6e7fc640 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 0x7f5b6003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5b6e7fc640 1 -- 172.21.15.145:0/3135413441 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5c7803bc90 con 0x55d868bf9150 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c80285640 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 0x7f5b6003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c80285640 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 0x7f5b6003ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55d868bd8b20 tx=0x7f5c70005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c8cd40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c8cd40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d868bd0c10 con 0x55d868c05a50 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56390/0 (socket says 172.21.15.145:56390) 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c88a86640 1 -- 172.21.15.145:0/454746091 learned_addr learned my addr 172.21.15.145:0/454746091 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.553+0000 7f5c88a86640 1 -- 172.21.15.145:0/454746091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868c06440 con 0x55d868c05a50 2024-09-10T04:50:33.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c88a86640 1 --2- 172.21.15.145:0/454746091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800f690 tx=0x7f5c7802fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576a18bc8f55c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5b5ffff640 1 -- 172.21.15.145:0/454746091 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78035040 con 0x55d868c05a50 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5b5ffff640 1 -- 172.21.15.145:0/454746091 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78018860 con 0x55d868c05a50 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5b5ffff640 1 -- 172.21.15.145:0/454746091 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7802f3e0 con 0x55d868c05a50 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 -- 172.21.15.145:0/454746091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 msgr2=0x55d868c05e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/454746091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800f690 tx=0x7f5c7802fb60 comp rx=0 tx=0).stop 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 -- 172.21.15.145:0/454746091 shutdown_connections 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/454746091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c05e50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 -- 172.21.15.145:0/454746091 >> 172.21.15.145:0/454746091 conn(0x55d868c01e50 msgr2=0x55d868c00090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 -- 172.21.15.145:0/454746091 shutdown_connections 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.554+0000 7f5c8cd40800 1 -- 172.21.15.145:0/454746091 wait complete. 2024-09-10T04:50:33.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 Processor -- start 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 -- start start 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d868c068b0 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c88a86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56406/0 (socket says 172.21.15.145:56406) 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 learned_addr learned my addr 172.21.15.145:0/730511521 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868c0d410 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c88a86640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800f690 tx=0x7f5c78006f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5b5e7fc640 1 -- 172.21.15.145:0/730511521 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7806e070 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5b5e7fc640 1 -- 172.21.15.145:0/730511521 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7802f890 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d868c0d410 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5b5e7fc640 1 -- 172.21.15.145:0/730511521 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78035050 con 0x55d868c05a50 2024-09-10T04:50:33.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.555+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d868c0d410 con 0x55d868c05a50 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.556+0000 7f5b5e7fc640 1 -- 172.21.15.145:0/730511521 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c78071070 con 0x55d868c05a50 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.556+0000 7f5b5e7fc640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b5403c730 0x7f5b5403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5b5e7fc640 1 -- 172.21.15.145:0/730511521 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5c7805a020 con 0x55d868c05a50 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c80285640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b5403c730 0x7f5b5403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c80285640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b5403c730 0x7f5b5403ebf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c70000c00 tx=0x7f5c70053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868c182d0 0x55d868c1a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c1aee0 con 0x55d868c182d0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c89287640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868c182d0 0x55d868c1a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.557+0000 7f5c89287640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868c182d0 0x55d868c1a790 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 realm 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c17600 con 0x55d868c182d0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c1b970 con 0x55d868c182d0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868c1c750 0x55d868c1eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c1f1d0 con 0x55d868c1c750 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.558+0000 7f5c88a86640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868c1c750 0x55d868c1eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c88a86640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868c1c750 0x55d868c1eb40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c1fa20 con 0x55d868c182d0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 20 searching for the correct realm 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d868c21790 0x55d868c23be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c80285640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d868c21790 0x55d868c23be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.559+0000 7f5c80285640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d868c21790 0x55d868c23be0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c88a86640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5c78073060 0x7f5c78028030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c89287640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5c78073060 0x7f5c78028030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.560+0000 7f5c89287640 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5c78073060 0x7f5c78028030 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5c8400a4d0 con 0x7f5c78073060 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.561+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8400a4d0 con 0x55d868c182d0 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.562+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x7f5c78073060 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5c84030040 con 0x7f5c78073060 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.563+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.564+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.565+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x7f5c78073060 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x7f5c78073060 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x7f5c78073060 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c84030040 con 0x7f5c78073060 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.566+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c21790 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.567+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d868c242b0 con 0x55d868c1c750 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c203d0 con 0x55d868c182d0 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c84030040 con 0x55d868c182d0 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c20010 con 0x55d868c1c750 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c20d70 con 0x7f5c78073060 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 zone default found 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 4 Realm: () 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 zonegroup default 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.568+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c24770 con 0x7f5c78073060 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c265a0 con 0x55d868c21790 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c26a60 con 0x55d868c21790 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 started sync module instance, tier type = 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.569+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c25a40 con 0x55d868c1c750 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.570+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.570+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94387958865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c27370 con 0x55d868c1c750 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.570+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c27bc0 con 0x55d868c182d0 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.571+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94387958865456] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.571+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.571+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94387958869696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c27870 con 0x55d868c182d0 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.571+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c28390 con 0x55d868c1c750 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.572+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94387958869696] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.572+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.572+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94387958873696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c28350 con 0x55d868c1c750 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.572+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c28e10 con 0x7f5c78073060 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.573+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.574+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94387958876448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c28e10 con 0x7f5c78073060 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.574+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c29db0 con 0x55d868c1c750 2024-09-10T04:50:33.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.574+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94387958873696] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.574+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94387958876448] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.575+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.575+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94387958880384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c29d70 con 0x55d868c1c750 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.575+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2a650 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.576+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.576+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94387958882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c29d70 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.576+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2b580 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.576+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94387958880384] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.576+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94387958882720] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.577+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.577+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94387958884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c272e0 con 0x55d868c21790 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.577+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2be50 con 0x7f5c78073060 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94387958884848] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94387958886544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2be50 con 0x7f5c78073060 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=0 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=1 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=2 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=3 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=4 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=5 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.578+0000 7f5c8cd40800 20 add_watcher() i=6 2024-09-10T04:50:33.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94387958886544] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c8cd40800 20 add_watcher() i=7 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c8cd40800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2f300 con 0x55d868c182d0 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.579+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94387958889328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c2c860 con 0x55d868c182d0 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.580+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94387958889328] v32'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.580+0000 7f5b3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.580+0000 7f5c8cd40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.580+0000 7f5c8cd40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.581+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c37c40 con 0x55d868c1c750 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.582+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'46 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.582+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c37c40 con 0x7f5c78073060 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.583+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.583+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c37c40 con 0x55d868c21790 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.584+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.584+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c38680 con 0x55d868c182d0 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.585+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'141 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.585+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c38b00 con 0x55d868c1c750 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.586+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.586+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c38b00 con 0x55d868c21790 2024-09-10T04:50:33.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.587+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.587+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39070 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.588+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.588+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39070 con 0x55d868c182d0 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.589+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.589+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c395e0 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.590+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.590+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c395e0 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.592+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.592+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c395e0 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.593+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.593+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c395e0 con 0x55d868c21790 2024-09-10T04:50:33.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.594+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.594+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39b50 con 0x55d868c1c750 2024-09-10T04:50:33.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.595+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.595+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39b50 con 0x55d868c182d0 2024-09-10T04:50:33.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.596+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.596+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c3a000 con 0x55d868c182d0 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.597+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'142 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.597+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c3a000 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.598+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.598+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c3a000 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.599+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.599+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c3a000 con 0x55d868c21790 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.600+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.600+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39e30 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.601+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.601+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39de0 con 0x55d868c182d0 2024-09-10T04:50:33.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.602+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'143 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.602+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39de0 con 0x55d868c1c750 2024-09-10T04:50:33.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.603+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.603+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39de0 con 0x55d868c1c750 2024-09-10T04:50:33.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.604+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.604+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39de0 con 0x55d868c21790 2024-09-10T04:50:33.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.605+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.605+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39e20 con 0x55d868c1c750 2024-09-10T04:50:33.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.607+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.607+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f50 con 0x55d868c21790 2024-09-10T04:50:33.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.607+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.608+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f50 con 0x55d868c21790 2024-09-10T04:50:33.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.608+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.608+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f50 con 0x55d868c21790 2024-09-10T04:50:33.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.609+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.609+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f90 con 0x55d868c1c750 2024-09-10T04:50:33.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.611+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.611+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f90 con 0x55d868c182d0 2024-09-10T04:50:33.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.612+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.612+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f90 con 0x55d868c1c750 2024-09-10T04:50:33.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.613+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.613+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39f90 con 0x55d868c182d0 2024-09-10T04:50:33.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.614+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'45 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.614+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c39fd0 con 0x7f5c78073060 2024-09-10T04:50:33.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5b3e7e4640 20 reqs_thread_entry: start 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c8cd40800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c8cd40800 20 Filter name: none 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5b377fe640 20 reqs_thread_entry: start 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c8cd40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c8cd40800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.615+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c64ef0 con 0x55d868c21790 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T04:50:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T04:50:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c673b0 con 0x55d868c182d0 2024-09-10T04:50:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv3 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T04:50:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.616+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c652f0 con 0x55d868c21790 2024-09-10T04:50:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.617+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.617+0000 7f5c8cd40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:50:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.617+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94387959127632 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c67c80 con 0x55d868c1c750 2024-09-10T04:50:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== watch-notify(notify (1) cookie 94387958873696 notify 137438953502 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d868c395e0 con 0x55d868c1c750 2024-09-10T04:50:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5b5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94387958873696 notifier 4566 bl.length()=170 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5b5ffff640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5b4c003d60 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(97 notify.2 [notify cookie 94387959127632 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== watch-notify(notify_complete (2) cookie 94387959127632 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5c7808b020 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c8cd40800 10 removing email index: 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c8cd40800 10 removing user buckets index 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.618+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c652f0 con 0x55d868c182d0 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5c8cd40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94387959123520 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c65260 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== watch-notify(notify (1) cookie 94387958880384 notify 137438953503 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f5c7808b020 con 0x55d868c1c750 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5b5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94387958880384 notifier 4566 bl.length()=175 2024-09-10T04:50:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5b5f7fe640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ab00032c0 con 0x55d868c1c750 2024-09-10T04:50:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.619+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(100 notify.4 [notify cookie 94387959123520 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.620+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.620+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== watch-notify(notify_complete (2) cookie 94387959123520 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d868bf9bb0 con 0x55d868c1c750 2024-09-10T04:50:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.620+0000 7f5c8cd40800 10 removing user index: testx$tenanteduser 2024-09-10T04:50:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.620+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c66700 con 0x55d868c21790 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'10 uv10 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c8cd40800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c8cd40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94387959131136 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d868c66700 con 0x7f5c78073060 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== watch-notify(notify (1) cookie 94387958876448 notify 137438953481 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55d868c38570 con 0x7f5c78073060 2024-09-10T04:50:33.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5b5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94387958876448 notifier 4566 bl.length()=167 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5b5ffff640 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5b4c003d60 con 0x7f5c78073060 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(103 notify.3 [notify cookie 94387959131136 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.621+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== watch-notify(notify_complete (2) cookie 94387959131136 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d868c39410 con 0x7f5c78073060 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.622+0000 7f5b3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.622+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94387958889328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x55d868c182d0 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.623+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94387958889328] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.623+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94387958865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x55d868c1c750 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.624+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94387958865456] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.624+0000 7f5c8cd40800 20 remove_watcher() i=0 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.624+0000 7f5c8cd40800 2 removed watcher, disabling cache 2024-09-10T04:50:33.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.624+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94387958869696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x55d868c182d0 2024-09-10T04:50:33.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.626+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94387958869696] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x55d868c182d0 2024-09-10T04:50:33.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.626+0000 7f5c8cd40800 20 remove_watcher() i=1 2024-09-10T04:50:33.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.626+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94387958873696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c26ec0 con 0x55d868c1c750 2024-09-10T04:50:33.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.627+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94387958873696] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.627+0000 7f5c8cd40800 20 remove_watcher() i=2 2024-09-10T04:50:33.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.627+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94387958876448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x7f5c78073060 2024-09-10T04:50:33.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.628+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94387958876448] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.628+0000 7f5c8cd40800 20 remove_watcher() i=3 2024-09-10T04:50:33.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.628+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94387958880384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c26ec0 con 0x55d868c1c750 2024-09-10T04:50:33.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.629+0000 7f5c88a86640 1 -- 172.21.15.145:0/730511521 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94387958880384] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78070030 con 0x55d868c1c750 2024-09-10T04:50:33.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.629+0000 7f5c8cd40800 20 remove_watcher() i=4 2024-09-10T04:50:33.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.629+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94387958882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x55d868c21790 2024-09-10T04:50:33.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.630+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94387958882720] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.630+0000 7f5c8cd40800 20 remove_watcher() i=5 2024-09-10T04:50:33.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.630+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94387958884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c26ec0 con 0x55d868c21790 2024-09-10T04:50:33.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.631+0000 7f5c80285640 1 -- 172.21.15.145:0/730511521 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94387958884848] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7007c040 con 0x55d868c21790 2024-09-10T04:50:33.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.631+0000 7f5c8cd40800 20 remove_watcher() i=6 2024-09-10T04:50:33.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.631+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94387958886544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d868c112b0 con 0x7f5c78073060 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94387958886544] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c84041040 con 0x7f5c78073060 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 20 remove_watcher() i=7 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868c1c750 msgr2=0x55d868c1eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868c1c750 0x55d868c1eb40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868c182d0 msgr2=0x55d868c1a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868c182d0 0x55d868c1a790 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5c78073060 msgr2=0x7f5c78028030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f5c78073060 0x7f5c78028030 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d868c21790 msgr2=0x55d868c23be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d868c21790 0x55d868c23be0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b5403c730 msgr2=0x7f5b5403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b5403c730 0x7f5b5403ebf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c70000c00 tx=0x7f5c70053000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c89287640 1 -- 172.21.15.145:0/730511521 reap_dead start 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 msgr2=0x55d868c0ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800f690 tx=0x7f5c78006f20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 shutdown_connections 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/730511521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868c05a50 0x55d868c0ceb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.632+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 >> 172.21.15.145:0/730511521 conn(0x55d868c01e50 msgr2=0x55d868c00060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 shutdown_connections 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/730511521 wait complete. 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 msgr2=0x7f5b6003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 0x7f5b6003ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55d868bd8b20 tx=0x7f5c70005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 msgr2=0x55d868bf9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800eb00 tx=0x7f5c78018e80 comp rx=0 tx=0).stop 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 shutdown_connections 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b6003c730 0x7f5b6003ebf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/3135413441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868bf9150 0x55d868bf9570 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 >> 172.21.15.145:0/3135413441 conn(0x55d868be90f0 msgr2=0x55d868be94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 shutdown_connections 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/3135413441 wait complete. 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868bdf030 msgr2=0x55d868be14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d868bdf030 0x55d868be14f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868ae2210 msgr2=0x55d868bde240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d868ae2210 0x55d868bde240 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d868be48c0 msgr2=0x55d868be6cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d868be48c0 0x55d868be6cb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b7003eb30 msgr2=0x7f5b70040ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f5b7003eb30 0x7f5b70040ff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5c70057000 tx=0x7f5c70052000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 msgr2=0x55d868bd6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 --2- 172.21.15.145:0/1448910689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d868ae0e00 0x55d868bd6bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5c780012f0 tx=0x7f5c78000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c89287640 1 -- 172.21.15.145:0/1448910689 reap_dead start 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 shutdown_connections 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 >> 172.21.15.145:0/1448910689 conn(0x55d868adc1d0 msgr2=0x55d868bd16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 shutdown_connections 2024-09-10T04:50:33.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.633+0000 7f5c8cd40800 1 -- 172.21.15.145:0/1448910689 wait complete. 2024-09-10T04:50:33.650 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T04:50:33.654 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-10T04:50:33.697 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:33.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T04:50:33.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T04:50:33.698 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b96bb800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x558453fdbfd0 0x558453fe4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b96bb800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558453e85e40 con 0x558453fda4b0 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b96bb800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x558453e50680 con 0x558453fdbfd0 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b69a4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x558453fdbfd0 0x558453fe4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b71a5640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x558453fda4b0 0x558453fda8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39330/0 (socket says 172.21.15.145:39330) 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b71a5640 1 -- 172.21.15.145:0/2074145579 learned_addr learned my addr 172.21.15.145:0/2074145579 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b69a4640 1 -- 172.21.15.145:0/2074145579 >> v1:172.21.15.98:6789/0 conn(0x558453fda4b0 legacy=0x558453fda8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.744+0000 7fd2b69a4640 1 -- 172.21.15.145:0/2074145579 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558453e6c6b0 con 0x558453fdbfd0 2024-09-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.746+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/2074145579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fdbfd0 0x558453fe4af0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00a470 tx=0x7fd2ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b28236fa3bd4e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.746+0000 7fd2b61a3640 1 -- 172.21.15.145:0/2074145579 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac053570 con 0x558453fdbfd0 2024-09-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.746+0000 7fd2b61a3640 1 -- 172.21.15.145:0/2074145579 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac058070 con 0x558453fdbfd0 2024-09-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.746+0000 7fd2b61a3640 1 -- 172.21.15.145:0/2074145579 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac053880 con 0x558453fdbfd0 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2074145579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fdbfd0 msgr2=0x558453fe4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/2074145579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fdbfd0 0x558453fe4af0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00a470 tx=0x7fd2ac045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2074145579 shutdown_connections 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/2074145579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fdbfd0 0x558453fe4af0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2074145579 >> 172.21.15.145:0/2074145579 conn(0x558453fd6200 msgr2=0x558453fd8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2074145579 shutdown_connections 2024-09-10T04:50:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.747+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2074145579 wait complete. 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b96bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b96bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558453e74dd0 con 0x558453fda4b0 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56424/0 (socket says 172.21.15.145:56424) 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.761+0000 7fd2b71a5640 1 -- 172.21.15.145:0/2551296916 learned_addr learned my addr 172.21.15.145:0/2551296916 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.762+0000 7fd2b71a5640 1 -- 172.21.15.145:0/2551296916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558453e8de10 con 0x558453fda4b0 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.762+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/2551296916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8001df0 tx=0x7fd2a800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fbee6b87d59b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.762+0000 7fd1a560a640 1 -- 172.21.15.145:0/2551296916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8012020 con 0x558453fda4b0 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.762+0000 7fd1a560a640 1 -- 172.21.15.145:0/2551296916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a800e470 con 0x558453fda4b0 2024-09-10T04:50:33.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.762+0000 7fd1a560a640 1 -- 172.21.15.145:0/2551296916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a800e7f0 con 0x558453fda4b0 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2551296916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 msgr2=0x5584540cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/2551296916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8001df0 tx=0x7fd2a800b6c0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2551296916 shutdown_connections 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/2551296916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540cd810 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2551296916 >> 172.21.15.145:0/2551296916 conn(0x558453fd6200 msgr2=0x5584540c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2551296916 shutdown_connections 2024-09-10T04:50:33.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- 172.21.15.145:0/2551296916 wait complete. 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b96bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558453fe5300 con 0x558453fda4b0 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540d51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56430/0 (socket says 172.21.15.145:56430) 2024-09-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.763+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1922630936 learned_addr learned my addr 172.21.15.145:0/1922630936 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584540d5700 con 0x558453fda4b0 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540d51a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5584540ce7a0 tx=0x7fd2a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd1a3e07640 1 -- 172.21.15.145:0/1922630936 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8012030 con 0x558453fda4b0 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd1a3e07640 1 -- 172.21.15.145:0/1922630936 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8001450 con 0x558453fda4b0 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd1a3e07640 1 -- 172.21.15.145:0/1922630936 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a801a7a0 con 0x558453fda4b0 2024-09-10T04:50:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584540d5990 con 0x558453fda4b0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.764+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584540d6390 con 0x558453fda4b0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd1a3e07640 1 -- 172.21.15.145:0/1922630936 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd2a8015020 con 0x558453fda4b0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd1a3e07640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19c03c780 0x7fd19c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd1a3e07640 1 -- 172.21.15.145:0/1922630936 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2a8020030 con 0x558453fda4b0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19c03c780 0x7fd19c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558453fdbfd0 0x5584540dc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.765+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584540dcd30 con 0x558453fdbfd0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558453fdbfd0 0x5584540dc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19c03c780 0x7fd19c03ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac057000 tx=0x7fd2ac052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558453fdbfd0 0x5584540dc7f0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b79a6640 1 -- 172.21.15.145:0/1922630936 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558453fdbfd0 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584540dd5e0 0x5584540dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.766+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584540e01f0 con 0x5584540dd5e0 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584540dd5e0 0x5584540dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584540dd5e0 0x5584540dfa80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1922630936 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2a80187b0 con 0x5584540dd5e0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584540e1aa0 con 0x558453fdbfd0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b79a6640 1 -- 172.21.15.145:0/1922630936 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558453fdbfd0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.767+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584540e0cd0 con 0x5584540dd5e0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1922630936 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2a80187b0 con 0x5584540dd5e0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5584540e2e50 0x5584540e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584540e5780 con 0x5584540e2e50 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5584540e2e50 0x5584540e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5584540e2e50 0x5584540e5240 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.768+0000 7fd2b69a4640 1 -- 172.21.15.145:0/1922630936 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2ac051070 con 0x5584540e2e50 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b96bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b96bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558453ed2a00 con 0x5584540f3310 2024-09-10T04:50:33.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56432/0 (socket says 172.21.15.145:56432) 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1126008314 learned_addr learned my addr 172.21.15.145:0/1126008314 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.769+0000 7fd2b71a5640 1 -- 172.21.15.145:0/1126008314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584540f3d70 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8016d70 tx=0x7fd2a801ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd1a1602640 1 -- 172.21.15.145:0/1126008314 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8022750 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd1a1602640 1 -- 172.21.15.145:0/1126008314 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a80228f0 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584540f45a0 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd1a1602640 1 -- 172.21.15.145:0/1126008314 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8022bd0 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584540f4b40 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.770+0000 7fd1a1602640 1 -- 172.21.15.145:0/1126008314 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd2a8049030 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd1a1602640 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 0x7fd19003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd1a1602640 1 -- 172.21.15.145:0/1126008314 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2a8037c90 con 0x5584540f3310 2024-09-10T04:50:33.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 0x7fd19003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 0x7fd19003ebf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5584540d70b0 tx=0x7fd2ac005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b96bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b96bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584540ce060 con 0x5584540ffb70 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56442/0 (socket says 172.21.15.145:56442) 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.771+0000 7fd2b71a5640 1 -- 172.21.15.145:0/153302327 learned_addr learned my addr 172.21.15.145:0/153302327 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b71a5640 1 -- 172.21.15.145:0/153302327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454100560 con 0x5584540ffb70 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/153302327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8017fd0 tx=0x7fd2a804b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3639ec2c5099c549 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd19affd640 1 -- 172.21.15.145:0/153302327 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a805a040 con 0x5584540ffb70 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd19affd640 1 -- 172.21.15.145:0/153302327 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8024e30 con 0x5584540ffb70 2024-09-10T04:50:33.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd19affd640 1 -- 172.21.15.145:0/153302327 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8022d70 con 0x5584540ffb70 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 -- 172.21.15.145:0/153302327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 msgr2=0x5584540fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/153302327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8017fd0 tx=0x7fd2a804b8a0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 -- 172.21.15.145:0/153302327 shutdown_connections 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/153302327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x5584540fff70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 -- 172.21.15.145:0/153302327 >> 172.21.15.145:0/153302327 conn(0x5584540fbf70 msgr2=0x5584540fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 -- 172.21.15.145:0/153302327 shutdown_connections 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.772+0000 7fd2b96bb800 1 -- 172.21.15.145:0/153302327 wait complete. 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b96bb800 1 Processor -- start 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b96bb800 1 -- start start 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b96bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b96bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584541009d0 con 0x5584540ffb70 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b71a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56458/0 (socket says 172.21.15.145:56458) 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 learned_addr learned my addr 172.21.15.145:0/828145811 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.773+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454107530 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8050d20 tx=0x7fd2a80436b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd1997fa640 1 -- 172.21.15.145:0/828145811 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a80249a0 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd1997fa640 1 -- 172.21.15.145:0/828145811 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8022d70 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd1997fa640 1 -- 172.21.15.145:0/828145811 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8016860 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558454107530 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558454107530 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.774+0000 7fd1997fa640 1 -- 172.21.15.145:0/828145811 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd2a803d300 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd1997fa640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd18003c730 0x7fd18003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd1997fa640 1 -- 172.21.15.145:0/828145811 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2a8074c80 con 0x5584540ffb70 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd18003c730 0x7fd18003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd18003c730 0x7fd18003ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac045a60 tx=0x7fd2ac053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558454112570 0x558454114a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454115180 con 0x558454112570 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.775+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558454112570 0x558454114a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558454112570 0x558454114a30 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 realm 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584541118a0 con 0x558454112570 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454115c10 con 0x558454112570 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584541169f0 0x558454118de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.776+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454119440 con 0x5584541169f0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584541169f0 0x558454118de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584541169f0 0x558454118de0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454119c90 con 0x558454112570 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 20 searching for the correct realm 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55845411ba00 0x55845411ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.777+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55845411ba00 0x55845411ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b69a4640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55845411ba00 0x55845411ddf0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b71a5640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd2a8069050 0x7fd2a802d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.778+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd2a8069050 0x7fd2a802d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd2a8069050 0x7fd2a802d3f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2b000a4d0 con 0x7fd2a8069050 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.779+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.780+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b000a4d0 con 0x558454112570 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x7fd2a8069050 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2b0030040 con 0x7fd2a8069050 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.781+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.782+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x7fd2a8069050 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.783+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x558454112570 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x7fd2a8069050 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x55845411ba00 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x7fd2a8069050 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b0030040 con 0x7fd2a8069050 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.784+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55845411e4c0 con 0x5584541169f0 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd2a808f040 con 0x5584541169f0 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd2a808f040 con 0x55845411ba00 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd2a808f040 con 0x5584541169f0 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.785+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd2a808f040 con 0x5584541169f0 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55845411a610 con 0x558454112570 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2b0030040 con 0x558454112570 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55845411aeb0 con 0x5584541169f0 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55845411a250 con 0x7fd2a8069050 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 zone default found 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 4 Realm: () 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 zonegroup default 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.786+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55845411e9a0 con 0x7fd2a8069050 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454120800 con 0x55845411ba00 2024-09-10T04:50:33.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454120ce0 con 0x55845411ba00 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 started sync module instance, tier type = 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.787+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845411fc70 con 0x5584541169f0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.788+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.788+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94026834509968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845411f8d0 con 0x5584541169f0 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.788+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454121b00 con 0x558454112570 2024-09-10T04:50:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.789+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.789+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94026834515440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454121b00 con 0x558454112570 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.789+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94026834509968] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.789+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584541225f0 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.790+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.790+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94026834514240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454121b00 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.790+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454123570 con 0x7fd2a8069050 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.790+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94026834515440] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.791+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.791+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94026834522240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454123570 con 0x7fd2a8069050 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.791+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454124060 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.792+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94026834514240] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.792+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94026834522240] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.793+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.793+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94026834524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454124020 con 0x5584541169f0 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.793+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454124900 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.793+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.794+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94026834527312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454124020 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.794+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94026834524976] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.794+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454125810 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.794+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94026834527312] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.795+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.795+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94026834529440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584541252f0 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.795+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584541260f0 con 0x7fd2a8069050 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94026834529440] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94026834517744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584541260b0 con 0x7fd2a8069050 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=0 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=1 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=2 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=3 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=4 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=5 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.796+0000 7fd2b96bb800 20 add_watcher() i=6 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94026834517744] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b96bb800 20 add_watcher() i=7 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b96bb800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454129540 con 0x558454112570 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.797+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94026834533840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454126a90 con 0x558454112570 2024-09-10T04:50:33.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.798+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94026834533840] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.798+0000 7fd16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.799+0000 7fd2b96bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.799+0000 7fd2b96bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.799+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454131de0 con 0x5584541169f0 2024-09-10T04:50:33.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.800+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'47 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.800+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454131e40 con 0x7fd2a8069050 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.801+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.801+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584541324f0 con 0x55845411ba00 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.802+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.802+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454132a60 con 0x558454112570 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.803+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'146 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.803+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454132f10 con 0x5584541169f0 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.804+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.804+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454132f10 con 0x55845411ba00 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.805+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.805+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133480 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.806+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.806+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133480 con 0x558454112570 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.807+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'33 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.807+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133930 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.808+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.808+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133930 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.809+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.809+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133930 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.810+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.810+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454133930 con 0x55845411ba00 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.811+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.811+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845412fd50 con 0x5584541169f0 2024-09-10T04:50:33.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.812+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.812+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845412fd50 con 0x558454112570 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.813+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.813+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454130200 con 0x558454112570 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.814+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'147 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.814+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.815+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.815+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.816+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.816+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x55845411ba00 2024-09-10T04:50:33.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.817+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.817+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.818+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.818+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x558454112570 2024-09-10T04:50:33.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.819+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'148 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.819+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.820+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.820+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.821+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.821+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x55845411ba00 2024-09-10T04:50:33.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.822+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.822+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.823+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.823+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x55845411ba00 2024-09-10T04:50:33.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.824+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.824+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x55845411ba00 2024-09-10T04:50:33.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.824+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.825+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x55845411ba00 2024-09-10T04:50:33.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.825+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.825+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x5584541169f0 2024-09-10T04:50:33.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.826+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.826+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134490 con 0x558454112570 2024-09-10T04:50:33.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.827+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.827+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454134ac0 con 0x5584541169f0 2024-09-10T04:50:33.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.828+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.828+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845412f5a0 con 0x558454112570 2024-09-10T04:50:33.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.829+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'47 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.829+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55845412f5a0 con 0x7fd2a8069050 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.830+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd16cfe1640 20 reqs_thread_entry: start 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 20 Filter name: none 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd0e67fc640 20 reqs_thread_entry: start 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:33.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55845415f460 con 0x7fd2a8069050 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.831+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:95 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454160e20 con 0x55845411ba00 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(95 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:33.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 get_obj_state: octx=0x7fd2b000ab10 obj=myfoo:four state=0x558454161bb8 s->prefetch_data=0 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 3.as0 3:517ae255:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558454162cc0 con 0x5584541169f0 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 10 manifest: total_size = 4 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7450352351960373779 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 get_obj_state: octx=0x7fd2b000ab10 obj=myfoo:four state=0x558454161bb8 s->prefetch_data=0 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 prepare_atomic_modification: state is not atomic. state=0x558454161bb8 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 2024-09-10T04:50:33.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.832+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:97 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454167700 con 0x55845411ba00 2024-09-10T04:50:33.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.833+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(97 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.833+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 3.as0 3:517ae255:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454167700 con 0x5584541169f0 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.835+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.835+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:99 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454168030 con 0x55845411ba00 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.836+0000 7fd16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.836+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(99 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.836+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94026834533840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454168030 con 0x558454112570 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.836+0000 7fd19affd640 20 handle_completion(): completion ok for obj=four 2024-09-10T04:50:33.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.837+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94026834533840] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.837+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94026834509968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454168030 con 0x5584541169f0 2024-09-10T04:50:33.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.838+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94026834509968] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.838+0000 7fd2b96bb800 20 remove_watcher() i=0 2024-09-10T04:50:33.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.838+0000 7fd2b96bb800 2 removed watcher, disabling cache 2024-09-10T04:50:33.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.838+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94026834515440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454120090 con 0x558454112570 2024-09-10T04:50:33.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.839+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94026834515440] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x558454112570 2024-09-10T04:50:33.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.839+0000 7fd2b96bb800 20 remove_watcher() i=1 2024-09-10T04:50:33.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.839+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94026834514240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454120090 con 0x5584541169f0 2024-09-10T04:50:33.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.840+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94026834514240] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.840+0000 7fd2b96bb800 20 remove_watcher() i=2 2024-09-10T04:50:33.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.840+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94026834522240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454120090 con 0x7fd2a8069050 2024-09-10T04:50:33.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.841+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94026834522240] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.841+0000 7fd2b96bb800 20 remove_watcher() i=3 2024-09-10T04:50:33.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.841+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94026834524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454120090 con 0x5584541169f0 2024-09-10T04:50:33.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.842+0000 7fd2b71a5640 1 -- 172.21.15.145:0/828145811 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94026834524976] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2a807a070 con 0x5584541169f0 2024-09-10T04:50:33.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.842+0000 7fd2b96bb800 20 remove_watcher() i=4 2024-09-10T04:50:33.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.842+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94026834527312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454123b30 con 0x55845411ba00 2024-09-10T04:50:33.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.843+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94026834527312] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.843+0000 7fd2b96bb800 20 remove_watcher() i=5 2024-09-10T04:50:33.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.843+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94026834529440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454120090 con 0x55845411ba00 2024-09-10T04:50:33.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.844+0000 7fd2b69a4640 1 -- 172.21.15.145:0/828145811 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94026834529440] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2ac07c040 con 0x55845411ba00 2024-09-10T04:50:33.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.844+0000 7fd2b96bb800 20 remove_watcher() i=6 2024-09-10T04:50:33.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.844+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94026834517744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558454124450 con 0x7fd2a8069050 2024-09-10T04:50:33.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94026834517744] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b0041040 con 0x7fd2a8069050 2024-09-10T04:50:33.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 20 remove_watcher() i=7 2024-09-10T04:50:33.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584541169f0 msgr2=0x558454118de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584541169f0 0x558454118de0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558454112570 msgr2=0x558454114a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558454112570 0x558454114a30 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd2a8069050 msgr2=0x7fd2a802d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fd2a8069050 0x7fd2a802d3f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55845411ba00 msgr2=0x55845411ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55845411ba00 0x55845411ddf0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd18003c730 msgr2=0x7fd18003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd18003c730 0x7fd18003ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac045a60 tx=0x7fd2ac053000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 msgr2=0x558454106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b79a6640 1 -- 172.21.15.145:0/828145811 reap_dead start 2024-09-10T04:50:33.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8050d20 tx=0x7fd2a80436b0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 shutdown_connections 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/828145811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540ffb70 0x558454106fd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 >> 172.21.15.145:0/828145811 conn(0x5584540fbf70 msgr2=0x5584540fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 shutdown_connections 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.845+0000 7fd2b96bb800 1 -- 172.21.15.145:0/828145811 wait complete. 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 msgr2=0x7fd19003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 0x7fd19003ebf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5584540d70b0 tx=0x7fd2ac005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 msgr2=0x5584540f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8016d70 tx=0x7fd2a801ae90 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 shutdown_connections 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19003c730 0x7fd19003ebf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1126008314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584540f3310 0x5584540f3730 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 >> 172.21.15.145:0/1126008314 conn(0x5584540e76c0 msgr2=0x5584540e7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 shutdown_connections 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1126008314 wait complete. 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584540dd5e0 msgr2=0x5584540dfa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5584540dd5e0 0x5584540dfa80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558453fdbfd0 msgr2=0x5584540dc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558453fdbfd0 0x5584540dc7f0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5584540e2e50 msgr2=0x5584540e5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5584540e2e50 0x5584540e5240 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19c03c780 msgr2=0x7fd19c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd19c03c780 0x7fd19c03ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac057000 tx=0x7fd2ac052000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 msgr2=0x5584540d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 --2- 172.21.15.145:0/1922630936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558453fda4b0 0x5584540d51a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5584540ce7a0 tx=0x7fd2a8000bc0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b79a6640 1 -- 172.21.15.145:0/1922630936 reap_dead start 2024-09-10T04:50:33.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 shutdown_connections 2024-09-10T04:50:33.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 >> 172.21.15.145:0/1922630936 conn(0x558453fd6200 msgr2=0x5584540ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 shutdown_connections 2024-09-10T04:50:33.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.846+0000 7fd2b96bb800 1 -- 172.21.15.145:0/1922630936 wait complete. 2024-09-10T04:50:33.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:33.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T04:50:33.857 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T04:50:33.901 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:33.901 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:33.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8586d33800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561d38e94200 0x561d38e99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8586d33800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d38d3de40 con 0x561d38e92df0 2024-09-10T04:50:33.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8586d33800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x561d38d08680 con 0x561d38e94200 2024-09-10T04:50:33.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f857a275640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561d38e94200 0x561d38e99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8582a76640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x561d38e92df0 0x561d38e93af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39338/0 (socket says 172.21.15.145:39338) 2024-09-10T04:50:33.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.901+0000 7f8582a76640 1 -- 172.21.15.145:0/1080314857 learned_addr learned my addr 172.21.15.145:0/1080314857 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:33.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.902+0000 7f857a275640 1 -- 172.21.15.145:0/1080314857 >> v1:172.21.15.98:6789/0 conn(0x561d38e92df0 legacy=0x561d38e93af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.902+0000 7f857a275640 1 -- 172.21.15.145:0/1080314857 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38d246b0 con 0x561d38e94200 2024-09-10T04:50:33.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.903+0000 7f857a275640 1 --2- 172.21.15.145:0/1080314857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e94200 0x561d38e99da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a470 tx=0x7f856c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b58ff563263d2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8582275640 1 -- 172.21.15.145:0/1080314857 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c053570 con 0x561d38e94200 2024-09-10T04:50:33.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8582275640 1 -- 172.21.15.145:0/1080314857 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c058070 con 0x561d38e94200 2024-09-10T04:50:33.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8582275640 1 -- 172.21.15.145:0/1080314857 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c053880 con 0x561d38e94200 2024-09-10T04:50:33.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 -- 172.21.15.145:0/1080314857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e94200 msgr2=0x561d38e99da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 --2- 172.21.15.145:0/1080314857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e94200 0x561d38e99da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a470 tx=0x7f856c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:33.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 -- 172.21.15.145:0/1080314857 shutdown_connections 2024-09-10T04:50:33.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 --2- 172.21.15.145:0/1080314857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e94200 0x561d38e99da0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 -- 172.21.15.145:0/1080314857 >> 172.21.15.145:0/1080314857 conn(0x561d38e8e1c0 msgr2=0x561d38e90620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 -- 172.21.15.145:0/1080314857 shutdown_connections 2024-09-10T04:50:33.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.904+0000 7f8586d33800 1 -- 172.21.15.145:0/1080314857 wait complete. 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8586d33800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8586d33800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d38d2cdd0 con 0x561d38e92df0 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56480/0 (socket says 172.21.15.145:56480) 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.918+0000 7f8582a76640 1 -- 172.21.15.145:0/2184187873 learned_addr learned my addr 172.21.15.145:0/2184187873 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.919+0000 7f8582a76640 1 -- 172.21.15.145:0/2184187873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38d45e10 con 0x561d38e92df0 2024-09-10T04:50:33.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.919+0000 7f8582a76640 1 --2- 172.21.15.145:0/2184187873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8574001e40 tx=0x7f8574001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4191bbca876e409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.919+0000 7f8470e09640 1 -- 172.21.15.145:0/2184187873 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8574012020 con 0x561d38e92df0 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.919+0000 7f8470e09640 1 -- 172.21.15.145:0/2184187873 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857400e5a0 con 0x561d38e92df0 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.919+0000 7f8470e09640 1 -- 172.21.15.145:0/2184187873 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857400e8a0 con 0x561d38e92df0 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- 172.21.15.145:0/2184187873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 msgr2=0x561d38e06db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 --2- 172.21.15.145:0/2184187873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8574001e40 tx=0x7f8574001e70 comp rx=0 tx=0).stop 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- 172.21.15.145:0/2184187873 shutdown_connections 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 --2- 172.21.15.145:0/2184187873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38e06db0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- 172.21.15.145:0/2184187873 >> 172.21.15.145:0/2184187873 conn(0x561d38e8e1c0 msgr2=0x561d38f7ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- 172.21.15.145:0/2184187873 shutdown_connections 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- 172.21.15.145:0/2184187873 wait complete. 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38f8aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8586d33800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d38e948f0 con 0x561d38e92df0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38f8aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.920+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38f8aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56486/0 (socket says 172.21.15.145:56486) 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f8582a76640 1 -- 172.21.15.145:0/3089528 learned_addr learned my addr 172.21.15.145:0/3089528 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f8582a76640 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38f8b550 con 0x561d38e92df0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f8582a76640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38f8aff0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f857400c010 tx=0x7f8574000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f846f606640 1 -- 172.21.15.145:0/3089528 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8574012030 con 0x561d38e92df0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f846f606640 1 -- 172.21.15.145:0/3089528 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85740014a0 con 0x561d38e92df0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d38f8b7e0 con 0x561d38e92df0 2024-09-10T04:50:33.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f846f606640 1 -- 172.21.15.145:0/3089528 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857401a7a0 con 0x561d38e92df0 2024-09-10T04:50:33.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.921+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d38f8c1e0 con 0x561d38e92df0 2024-09-10T04:50:33.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f846f606640 1 -- 172.21.15.145:0/3089528 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8574015020 con 0x561d38e92df0 2024-09-10T04:50:33.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f846f606640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f846803c780 0x7f846803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f846f606640 1 -- 172.21.15.145:0/3089528 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8574020030 con 0x561d38e92df0 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f857a275640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f846803c780 0x7f846803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38e94200 0x561d38f92640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.922+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38f8cd50 con 0x561d38e94200 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8583277640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38e94200 0x561d38f92640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f857a275640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f846803c780 0x7f846803ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f856c057000 tx=0x7f856c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8583277640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38e94200 0x561d38f92640 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8583277640 1 -- 172.21.15.145:0/3089528 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38e94200 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38f93570 0x561d38f95960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38f95f90 con 0x561d38f93570 2024-09-10T04:50:33.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.923+0000 7f8582a76640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38f93570 0x561d38f95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.924+0000 7f8582a76640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38f93570 0x561d38f95960 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.924+0000 7f8582a76640 1 -- 172.21.15.145:0/3089528 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85740187b0 con 0x561d38f93570 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.924+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38f97840 con 0x561d38e94200 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.924+0000 7f8583277640 1 -- 172.21.15.145:0/3089528 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38e94200 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.924+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38f96a70 con 0x561d38f93570 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f8582a76640 1 -- 172.21.15.145:0/3089528 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85740187b0 con 0x561d38f93570 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x561d38f98bf0 0x561d38f9afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38f9b520 con 0x561d38f98bf0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f857a275640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x561d38f98bf0 0x561d38f9afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f857a275640 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x561d38f98bf0 0x561d38f9afe0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.925+0000 7f857a275640 1 -- 172.21.15.145:0/3089528 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f856c051070 con 0x561d38f98bf0 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8586d33800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8586d33800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d38d8aa00 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56500/0 (socket says 172.21.15.145:56500) 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8582a76640 1 -- 172.21.15.145:0/3508196640 learned_addr learned my addr 172.21.15.145:0/3508196640 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8582a76640 1 -- 172.21.15.145:0/3508196640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38fa9b00 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.926+0000 7f8582a76640 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8574051f50 tx=0x7f8574017f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 -- 172.21.15.145:0/3508196640 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8574018430 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 -- 172.21.15.145:0/3508196640 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8574045070 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d38faa330 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 -- 172.21.15.145:0/3508196640 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857400c790 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d38faa8d0 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 -- 172.21.15.145:0/3508196640 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f857400c930 con 0x561d38fa90a0 2024-09-10T04:50:33.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 0x7f845c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.927+0000 7f846ce01640 1 -- 172.21.15.145:0/3508196640 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8574050e90 con 0x561d38fa90a0 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f857a275640 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 0x7f845c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f857a275640 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 0x7f845c03ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x561d38f8c5e0 tx=0x7f856c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8586d33800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8586d33800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d38f86320 con 0x561d38fb5960 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56512/0 (socket says 172.21.15.145:56512) 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8582a76640 1 -- 172.21.15.145:0/2483893748 learned_addr learned my addr 172.21.15.145:0/2483893748 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.928+0000 7f8582a76640 1 -- 172.21.15.145:0/2483893748 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38fb6350 con 0x561d38fb5960 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8582a76640 1 --2- 172.21.15.145:0/2483893748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f857401af70 tx=0x7f857400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe033b489471d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f84667fc640 1 -- 172.21.15.145:0/2483893748 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8574064070 con 0x561d38fb5960 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f84667fc640 1 -- 172.21.15.145:0/2483893748 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857405b040 con 0x561d38fb5960 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f84667fc640 1 -- 172.21.15.145:0/2483893748 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857405a050 con 0x561d38fb5960 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 -- 172.21.15.145:0/2483893748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 msgr2=0x561d38fb5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 --2- 172.21.15.145:0/2483893748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f857401af70 tx=0x7f857400cce0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 -- 172.21.15.145:0/2483893748 shutdown_connections 2024-09-10T04:50:33.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 --2- 172.21.15.145:0/2483893748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fb5d60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 -- 172.21.15.145:0/2483893748 >> 172.21.15.145:0/2483893748 conn(0x561d38fb1d60 msgr2=0x561d38faffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 -- 172.21.15.145:0/2483893748 shutdown_connections 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 -- 172.21.15.145:0/2483893748 wait complete. 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.929+0000 7f8586d33800 1 Processor -- start 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8586d33800 1 -- start start 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8586d33800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8586d33800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d38fb67c0 con 0x561d38fb5960 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8582a76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56516/0 (socket says 172.21.15.145:56516) 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 learned_addr learned my addr 172.21.15.145:0/1050017943 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:33.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d38fbd2f0 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8582a76640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8574010fa0 tx=0x7f8574032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8464ff9640 1 -- 172.21.15.145:0/1050017943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857406d020 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8464ff9640 1 -- 172.21.15.145:0/1050017943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8574024e30 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d38fbd2f0 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.930+0000 7f8464ff9640 1 -- 172.21.15.145:0/1050017943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8574064040 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.931+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d38fbd2f0 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.931+0000 7f8464ff9640 1 -- 172.21.15.145:0/1050017943 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8574070020 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.931+0000 7f8464ff9640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f844c03c730 0x7f844c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8464ff9640 1 -- 172.21.15.145:0/1050017943 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8574073c60 con 0x561d38fb5960 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f857a275640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f844c03c730 0x7f844c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38fc82d0 0x561d38fca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fcaee0 con 0x561d38fc82d0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8583277640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38fc82d0 0x561d38fca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f857a275640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f844c03c730 0x7f844c03ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8583277640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38fc82d0 0x561d38fca790 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 20 realm 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.932+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fc7600 con 0x561d38fc82d0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:33.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fcb970 con 0x561d38fc82d0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38fcc750 0x561d38fceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fcf170 con 0x561d38fcc750 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8582a76640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38fcc750 0x561d38fceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.933+0000 7f8582a76640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38fcc750 0x561d38fceb40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fcfa10 con 0x561d38fc82d0 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 20 searching for the correct realm 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561d38fd1780 0x561d38fd3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f857a275640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561d38fd1780 0x561d38fd3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.934+0000 7f857a275640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561d38fd1780 0x561d38fd3bb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f8582a76640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8574072020 0x7f8574052920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f8583277640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8574072020 0x7f8574052920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.935+0000 7f8583277640 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8574072020 0x7f8574052920 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f857c00a4d0 con 0x7f8574072020 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.936+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c00a4d0 con 0x561d38fc82d0 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x7f8574072020 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.937+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f857c030040 con 0x7f8574072020 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.938+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.939+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x7f8574072020 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fc82d0 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.940+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x7f8574072020 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fd1780 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x7f8574072020 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857c030040 con 0x7f8574072020 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd4280 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.941+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f857408e040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f857408e040 con 0x561d38fd1780 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f857408e040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f857408e040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.942+0000 7f8586d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd0260 con 0x561d38fc82d0 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857c030040 con 0x561d38fc82d0 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd0650 con 0x561d38fcc750 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd0650 con 0x7f8574072020 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 zone default found 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 4 Realm: () 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:33.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 zonegroup default 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.943+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd0a70 con 0x7f8574072020 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd0a70 con 0x561d38fd1780 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd6140 con 0x561d38fd1780 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 started sync module instance, tier type = 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.944+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x561d38fcc750 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.945+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.945+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683510168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x561d38fcc750 2024-09-10T04:50:33.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.945+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd6b70 con 0x561d38fc82d0 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.946+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683510168320] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.946+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.946+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683510171808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x561d38fc82d0 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.946+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd7690 con 0x561d38fcc750 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.947+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683510171808] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.947+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.947+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683510174080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x561d38fcc750 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.947+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd8110 con 0x7f8574072020 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.948+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683510174080] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.948+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.948+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683510176800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x7f8574072020 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.948+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd8b20 con 0x561d38fcc750 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.949+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683510176800] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.949+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683510179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd55e0 con 0x561d38fcc750 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd9530 con 0x561d38fd1780 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683510179920] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683510182016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd9dd0 con 0x561d38fd1780 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.950+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fd5170 con 0x561d38fd1780 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.951+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683510182016] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.952+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.952+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683510184224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fda7f0 con 0x561d38fd1780 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.952+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fdb1b0 con 0x7f8574072020 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683510189312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fdb5d0 con 0x7f8574072020 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=0 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=1 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=2 2024-09-10T04:50:33.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=3 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=4 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=5 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683510184224] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.953+0000 7f8586d33800 20 add_watcher() i=6 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683510189312] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8586d33800 20 add_watcher() i=7 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8586d33800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d38fdb5d0 con 0x561d38fc82d0 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.954+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683510190368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d38fdb540 con 0x561d38fc82d0 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.955+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683510190368] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.955+0000 7f84397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.955+0000 7f8586d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.955+0000 7f8586d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.955+0000 7f8586d33800 5 note: GC not initialized 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f83b3fff640 20 reqs_thread_entry: start 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 20 Filter name: none 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f83b1ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39011790 con 0x7f8574072020 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.956+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39012020 con 0x561d38fd1780 2024-09-10T04:50:33.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39010a60 con 0x7f8574072020 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 rados->read ofs=0 len=0 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39013630 con 0x561d38fd1780 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(65 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 4.1 4:83414aaf:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39013020 con 0x7f8574072020 2024-09-10T04:50:33.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 4.26 4:65ff416b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39017f50 con 0x561d38fc82d0 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 4.34 4:2cbb4e89:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39013020 con 0x7f8574072020 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 4.39 4:9d1a3169:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3901cf90 con 0x561d38fd1780 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.957+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 4.21 4:873ed889:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3901f460 con 0x561d38fd1780 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 4.34 4:2f60b1f5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39021b80 con 0x7f8574072020 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 4.11 4:8b19d428:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39024a60 con 0x561d38fd1780 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 4.b 4:d0ab592a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d39027420 con 0x7f8574072020 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 4.12 4:49fd84cd:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3902a2e0 con 0x561d38fc82d0 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 4.a 4:52f885ea:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3902d1a0 con 0x561d38fcc750 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 4.23 4:c5314c0f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d3902fb30 con 0x561d38fd1780 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(67 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(66 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(68 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(69 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(75 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(70 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(76 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(72 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(71 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(74 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.958+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(73 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f857c041040 con 0x7f8574072020 2024-09-10T04:50:33.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.959+0000 7f84397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.959+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683510190368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d39027420 con 0x561d38fc82d0 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.960+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94683510190368] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f857c041040 con 0x561d38fc82d0 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.960+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683510168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fcc750 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.961+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94683510168320] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.961+0000 7f8586d33800 20 remove_watcher() i=0 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.961+0000 7f8586d33800 2 removed watcher, disabling cache 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.961+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683510171808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fc82d0 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.962+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94683510171808] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c053040 con 0x561d38fc82d0 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.962+0000 7f8586d33800 20 remove_watcher() i=1 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.962+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683510174080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fcc750 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.963+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94683510174080] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.963+0000 7f8586d33800 20 remove_watcher() i=2 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.963+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683510176800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x7f8574072020 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.964+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94683510176800] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c053040 con 0x7f8574072020 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.964+0000 7f8586d33800 20 remove_watcher() i=3 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.964+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683510179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fcc750 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.965+0000 7f8582a76640 1 -- 172.21.15.145:0/1050017943 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94683510179920] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8574067040 con 0x561d38fcc750 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.965+0000 7f8586d33800 20 remove_watcher() i=4 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.965+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683510182016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fd1780 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.966+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94683510182016] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.966+0000 7f8586d33800 20 remove_watcher() i=5 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.966+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683510184224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x561d38fd1780 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.967+0000 7f857a275640 1 -- 172.21.15.145:0/1050017943 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94683510184224] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c07c040 con 0x561d38fd1780 2024-09-10T04:50:33.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.967+0000 7f8586d33800 20 remove_watcher() i=6 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.967+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683510189312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d3900f110 con 0x7f8574072020 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94683510189312] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857c053040 con 0x7f8574072020 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 20 remove_watcher() i=7 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38fcc750 msgr2=0x561d38fceb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38fcc750 0x561d38fceb40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38fc82d0 msgr2=0x561d38fca790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38fc82d0 0x561d38fca790 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8574072020 msgr2=0x7f8574052920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f8574072020 0x7f8574052920 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561d38fd1780 msgr2=0x561d38fd3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x561d38fd1780 0x561d38fd3bb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f844c03c730 msgr2=0x7f844c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f844c03c730 0x7f844c03ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 msgr2=0x561d38fbcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8574010fa0 tx=0x7f8574032f30 comp rx=0 tx=0).stop 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8583277640 1 -- 172.21.15.145:0/1050017943 reap_dead start 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 shutdown_connections 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 --2- 172.21.15.145:0/1050017943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fb5960 0x561d38fbcd90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 >> 172.21.15.145:0/1050017943 conn(0x561d38fb1d60 msgr2=0x561d38faff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 shutdown_connections 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.968+0000 7f8586d33800 1 -- 172.21.15.145:0/1050017943 wait complete. 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 msgr2=0x7f845c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 0x7f845c03ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x561d38f8c5e0 tx=0x7f856c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 msgr2=0x561d38fa94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8574051f50 tx=0x7f8574017f10 comp rx=0 tx=0).stop 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 shutdown_connections 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f845c03c730 0x7f845c03ebf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3508196640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38fa90a0 0x561d38fa94c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 >> 172.21.15.145:0/3508196640 conn(0x561d38f9d450 msgr2=0x561d38f9d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 shutdown_connections 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3508196640 wait complete. 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38f93570 msgr2=0x561d38f95960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x561d38f93570 0x561d38f95960 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38e94200 msgr2=0x561d38f92640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561d38e94200 0x561d38f92640 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x561d38f98bf0 msgr2=0x561d38f9afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x561d38f98bf0 0x561d38f9afe0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f846803c780 msgr2=0x7f846803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f846803c780 0x7f846803ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f856c057000 tx=0x7f856c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 msgr2=0x561d38f8aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 --2- 172.21.15.145:0/3089528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d38e92df0 0x561d38f8aff0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f857400c010 tx=0x7f8574000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8583277640 1 -- 172.21.15.145:0/3089528 reap_dead start 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 shutdown_connections 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 >> 172.21.15.145:0/3089528 conn(0x561d38e8e1c0 msgr2=0x561d38f7c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 shutdown_connections 2024-09-10T04:50:33.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:33.969+0000 7f8586d33800 1 -- 172.21.15.145:0/3089528 wait complete. 2024-09-10T04:50:33.988 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","marker":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T04:50:33.439825Z","creation_time":"2024-09-10T04:50:30.682311Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-10T04:50:33.988 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:50:33.439825Z', 'creation_time': '2024-09-10T04:50:30.682311Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-10T04:50:33.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-10T04:50:33.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-10T04:50:33.989 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-10T04:50:34.031 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:34.031 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:34.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1f810800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557a701271e0 0x557a701296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1f810800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557a6ffcce40 con 0x557a70123670 2024-09-10T04:50:34.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1f810800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x557a6ff97680 con 0x557a701271e0 2024-09-10T04:50:34.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c13fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557a701271e0 0x557a701296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1af7a640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x557a70123670 0x557a70125a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39346/0 (socket says 172.21.15.145:39346) 2024-09-10T04:50:34.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.031+0000 7f2c1af7a640 1 -- 172.21.15.145:0/3481317253 learned_addr learned my addr 172.21.15.145:0/3481317253 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:34.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.032+0000 7f2c1a779640 1 -- 172.21.15.145:0/3481317253 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923502769 0 0) 0x557a6ffcce40 con 0x557a70123670 2024-09-10T04:50:34.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.032+0000 7f2c1a779640 1 -- 172.21.15.145:0/3481317253 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c08001e10 con 0x557a70123670 2024-09-10T04:50:34.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.032+0000 7f2c13fff640 1 -- 172.21.15.145:0/3481317253 >> v1:172.21.15.98:6789/0 conn(0x557a70123670 legacy=0x557a70125a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.032+0000 7f2c13fff640 1 -- 172.21.15.145:0/3481317253 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ffb36b0 con 0x557a701271e0 2024-09-10T04:50:34.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.033+0000 7f2c13fff640 1 --2- 172.21.15.145:0/3481317253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a701271e0 0x557a701296a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a470 tx=0x7f2c04045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2c4bb779902c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1a779640 1 -- 172.21.15.145:0/3481317253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04059070 con 0x557a701271e0 2024-09-10T04:50:34.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1a779640 1 -- 172.21.15.145:0/3481317253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04054570 con 0x557a701271e0 2024-09-10T04:50:34.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1a779640 1 -- 172.21.15.145:0/3481317253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c04054850 con 0x557a701271e0 2024-09-10T04:50:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 -- 172.21.15.145:0/3481317253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a701271e0 msgr2=0x557a701296a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 --2- 172.21.15.145:0/3481317253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a701271e0 0x557a701296a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a470 tx=0x7f2c04045920 comp rx=0 tx=0).stop 2024-09-10T04:50:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 -- 172.21.15.145:0/3481317253 shutdown_connections 2024-09-10T04:50:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 --2- 172.21.15.145:0/3481317253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a701271e0 0x557a701296a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 -- 172.21.15.145:0/3481317253 >> 172.21.15.145:0/3481317253 conn(0x557a7011d1b0 msgr2=0x557a7011f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 -- 172.21.15.145:0/3481317253 shutdown_connections 2024-09-10T04:50:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.034+0000 7f2c1f810800 1 -- 172.21.15.145:0/3481317253 wait complete. 2024-09-10T04:50:34.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1f810800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1f810800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a6ffbbdd0 con 0x557a70123670 2024-09-10T04:50:34.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56544/0 (socket says 172.21.15.145:56544) 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.048+0000 7f2c1af7a640 1 -- 172.21.15.145:0/750281477 learned_addr learned my addr 172.21.15.145:0/750281477 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.049+0000 7f2c1af7a640 1 -- 172.21.15.145:0/750281477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ffd4e10 con 0x557a70123670 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.049+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/750281477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001e30 tx=0x7f2c0c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b0d0044b91e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.049+0000 7f2b08e09640 1 -- 172.21.15.145:0/750281477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c012020 con 0x557a70123670 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.049+0000 7f2b08e09640 1 -- 172.21.15.145:0/750281477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00e470 con 0x557a70123670 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.049+0000 7f2b08e09640 1 -- 172.21.15.145:0/750281477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c00e790 con 0x557a70123670 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- 172.21.15.145:0/750281477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 msgr2=0x557a702124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 --2- 172.21.15.145:0/750281477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001e30 tx=0x7f2c0c00b780 comp rx=0 tx=0).stop 2024-09-10T04:50:34.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- 172.21.15.145:0/750281477 shutdown_connections 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 --2- 172.21.15.145:0/750281477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a702124a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- 172.21.15.145:0/750281477 >> 172.21.15.145:0/750281477 conn(0x557a7011d1b0 msgr2=0x557a7020de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- 172.21.15.145:0/750281477 shutdown_connections 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- 172.21.15.145:0/750281477 wait complete. 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a70122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.050+0000 7f2c1f810800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a7012a020 con 0x557a70123670 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a70122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a70122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56550/0 (socket says 172.21.15.145:56550) 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1af7a640 1 -- 172.21.15.145:0/880350389 learned_addr learned my addr 172.21.15.145:0/880350389 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1af7a640 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a701232f0 con 0x557a70123670 2024-09-10T04:50:34.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a70122d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x557a70213430 tx=0x7f2c0c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2b07606640 1 -- 172.21.15.145:0/880350389 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c012030 con 0x557a70123670 2024-09-10T04:50:34.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2b07606640 1 -- 172.21.15.145:0/880350389 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c01a7a0 con 0x557a70123670 2024-09-10T04:50:34.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a701216a0 con 0x557a70123670 2024-09-10T04:50:34.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2b07606640 1 -- 172.21.15.145:0/880350389 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c01aaa0 con 0x557a70123670 2024-09-10T04:50:34.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.051+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a70121c60 con 0x557a70123670 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2b07606640 1 -- 172.21.15.145:0/880350389 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c0c015020 con 0x557a70123670 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2b07606640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2b0003c780 0x7f2b0003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2b07606640 1 -- 172.21.15.145:0/880350389 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c0c020070 con 0x557a70123670 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2c13fff640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2b0003c780 0x7f2b0003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a701271e0 0x557a702232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70223830 con 0x557a701271e0 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.052+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a701271e0 0x557a702232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c13fff640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2b0003c780 0x7f2b0003ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x557a700954b0 tx=0x7f2c04050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a701271e0 0x557a702232f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c1b77b640 1 -- 172.21.15.145:0/880350389 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a701271e0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a702245c0 0x557a702269b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70226fe0 con 0x557a702245c0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.053+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a702245c0 0x557a702269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.054+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a702245c0 0x557a702269b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.054+0000 7f2c1af7a640 1 -- 172.21.15.145:0/880350389 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c0c018950 con 0x557a702245c0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.054+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70228890 con 0x557a701271e0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.054+0000 7f2c1b77b640 1 -- 172.21.15.145:0/880350389 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a701271e0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.054+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70227ac0 con 0x557a702245c0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c1af7a640 1 -- 172.21.15.145:0/880350389 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c0c018950 con 0x557a702245c0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557a70229c40 0x557a7022c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7022c570 con 0x557a70229c40 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c13fff640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557a70229c40 0x557a7022c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c13fff640 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557a70229c40 0x557a7022c030 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.055+0000 7f2c13fff640 1 -- 172.21.15.145:0/880350389 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c04061430 con 0x557a70229c40 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1f810800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1f810800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a70019a00 con 0x557a7023a0c0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56556/0 (socket says 172.21.15.145:56556) 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1af7a640 1 -- 172.21.15.145:0/1667058150 learned_addr learned my addr 172.21.15.145:0/1667058150 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1af7a640 1 -- 172.21.15.145:0/1667058150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a7023ab20 con 0x557a7023a0c0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.056+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0442a0 tx=0x7f2c0c0167f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2b04e01640 1 -- 172.21.15.145:0/1667058150 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c031070 con 0x557a7023a0c0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2b04e01640 1 -- 172.21.15.145:0/1667058150 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c04b290 con 0x557a7023a0c0 2024-09-10T04:50:34.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a7023b350 con 0x557a7023a0c0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2b04e01640 1 -- 172.21.15.145:0/1667058150 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c02c800 con 0x557a7023a0c0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a7023b8f0 con 0x557a7023a0c0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2b04e01640 1 -- 172.21.15.145:0/1667058150 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c0c034070 con 0x557a7023a0c0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.057+0000 7f2b04e01640 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 0x7f2af403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2b04e01640 1 -- 172.21.15.145:0/1667058150 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c0c044040 con 0x557a7023a0c0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c13fff640 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 0x7f2af403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c13fff640 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 0x7f2af403ec40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x557a701220e0 tx=0x7f2c04005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1f810800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1f810800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a70212cf0 con 0x557a70246940 2024-09-10T04:50:34.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56564/0 (socket says 172.21.15.145:56564) 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1af7a640 1 -- 172.21.15.145:0/3754141015 learned_addr learned my addr 172.21.15.145:0/3754141015 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.058+0000 7f2c1af7a640 1 -- 172.21.15.145:0/3754141015 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a70247330 con 0x557a70246940 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/3754141015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c04bfd0 tx=0x7f2c0c024ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f0f3ade45c48b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2afe7fc640 1 -- 172.21.15.145:0/3754141015 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c063070 con 0x557a70246940 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2afe7fc640 1 -- 172.21.15.145:0/3754141015 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c048dd0 con 0x557a70246940 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2afe7fc640 1 -- 172.21.15.145:0/3754141015 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c03b070 con 0x557a70246940 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 -- 172.21.15.145:0/3754141015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 msgr2=0x557a70246d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 --2- 172.21.15.145:0/3754141015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c04bfd0 tx=0x7f2c0c024ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 -- 172.21.15.145:0/3754141015 shutdown_connections 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 --2- 172.21.15.145:0/3754141015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a70246d40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 -- 172.21.15.145:0/3754141015 >> 172.21.15.145:0/3754141015 conn(0x557a70242d40 msgr2=0x557a70240f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 -- 172.21.15.145:0/3754141015 shutdown_connections 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.059+0000 7f2c1f810800 1 -- 172.21.15.145:0/3754141015 wait complete. 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1f810800 1 Processor -- start 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1f810800 1 -- start start 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1f810800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1f810800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a702477a0 con 0x557a70246940 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1af7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56566/0 (socket says 172.21.15.145:56566) 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 learned_addr learned my addr 172.21.15.145:0/246915339 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a7024e300 con 0x557a70246940 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c054fd0 tx=0x7f2c0c03cfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2afcff9640 1 -- 172.21.15.145:0/246915339 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c06e020 con 0x557a70246940 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2afcff9640 1 -- 172.21.15.145:0/246915339 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c02cc30 con 0x557a70246940 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a7024e300 con 0x557a70246940 2024-09-10T04:50:34.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.060+0000 7f2afcff9640 1 -- 172.21.15.145:0/246915339 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0c063030 con 0x557a70246940 2024-09-10T04:50:34.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.061+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a7024e900 con 0x557a70246940 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.061+0000 7f2afcff9640 1 -- 172.21.15.145:0/246915339 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c0c071020 con 0x557a70246940 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2afcff9640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ae403c780 0x7f2ae403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2afcff9640 1 -- 172.21.15.145:0/246915339 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c0c064070 con 0x557a70246940 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c13fff640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ae403c780 0x7f2ae403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a70259350 0x557a7025b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7025bf30 con 0x557a70259350 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a70259350 0x557a7025b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c13fff640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ae403c780 0x7f2ae403ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x557a702287e0 tx=0x7f2c04063040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a70259350 0x557a7025b7e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 20 realm 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.062+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a702586e0 con 0x557a70259350 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7025c9c0 con 0x557a70259350 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a7025d580 0x557a7025fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a702601b0 con 0x557a7025d580 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a7025d580 0x557a7025fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.063+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a7025d580 0x557a7025fa40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70260a50 con 0x557a70259350 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 20 searching for the correct realm 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557a702627c0 0x557a70264bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c13fff640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557a702627c0 0x557a70264bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.064+0000 7f2c13fff640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557a702627c0 0x557a70264bf0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c1af7a640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2c0c07e040 0x7f2c0c046420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2c0c07e040 0x7f2c0c046420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.065+0000 7f2c1b77b640 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2c0c07e040 0x7f2c0c046420 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c1400a4d0 con 0x7f2c0c07e040 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.066+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400a4d0 con 0x557a70259350 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.067+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x7f2c0c07e040 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c14030040 con 0x7f2c0c07e040 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.068+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.069+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x7f2c0c07e040 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.070+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x7f2c0c07e040 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x7f2c0c07e040 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c14030040 con 0x7f2c0c07e040 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.071+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a702627c0 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.072+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702652c0 con 0x557a7025d580 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70261400 con 0x557a70259350 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c14030040 con 0x557a70259350 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70261880 con 0x557a7025d580 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70261d20 con 0x7f2c0c07e040 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 zone default found 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 4 Realm: () 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:34.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 zonegroup default 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.073+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70265790 con 0x7f2c0c07e040 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a70267630 con 0x557a702627c0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a702679d0 con 0x557a702627c0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 started sync module instance, tier type = 2024-09-10T04:50:34.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.074+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70266a70 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.076+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.076+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93984355937936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70268220 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.076+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70268a70 con 0x557a70259350 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.077+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.077+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93984355943872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70268fb0 con 0x557a70259350 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.077+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70269ab0 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.077+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93984355937936] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.078+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.078+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93984355947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70269a70 con 0x557a7025d580 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.078+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026a4f0 con 0x7f2c0c07e040 2024-09-10T04:50:34.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.079+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93984355947936] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.079+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.079+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93984355941744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026a4f0 con 0x7f2c0c07e040 2024-09-10T04:50:34.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.079+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026af10 con 0x557a7025d580 2024-09-10T04:50:34.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.080+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93984355943872] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.080+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.080+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93984355953152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026aed0 con 0x557a7025d580 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.080+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026b920 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.081+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93984355941744] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.081+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93984355953152] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.081+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.081+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93984355944992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026a040 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.081+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026c1f0 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.082+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93984355944992] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.083+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.083+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93984355955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.083+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026d400 con 0x7f2c0c07e040 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93984355955824] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93984355963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026dbe0 con 0x7f2c0c07e040 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=0 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=1 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=2 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=3 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=4 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=5 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.084+0000 7f2c1f810800 20 add_watcher() i=6 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93984355963216] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1f810800 20 add_watcher() i=7 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1f810800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7026c620 con 0x557a70259350 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.085+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93984355964528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7026c620 con 0x557a70259350 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.086+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93984355964528] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.086+0000 7f2ad17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.086+0000 7f2c1f810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.086+0000 7f2c1f810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.086+0000 7f2c1f810800 5 note: GC not initialized 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2a4bfff640 20 reqs_thread_entry: start 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1f810800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1f810800 20 Filter name: none 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2a49ffb640 20 reqs_thread_entry: start 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a702a3380 con 0x557a70259350 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'47 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70261400 con 0x557a70259350 2024-09-10T04:50:34.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.087+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70261400 con 0x557a7025d580 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70268220 con 0x7f2c0c07e040 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70268220 con 0x557a70259350 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.088+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70268220 con 0x7f2c0c07e040 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.089+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.089+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a70268220 con 0x557a702627c0 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.089+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.089+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.090+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.091+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.092+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.092+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.092+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.092+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a70259350 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.093+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'24 uv16 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.094+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a70259350 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.095+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a7025d580 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a70259350 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.096+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x7f2c0c07e040 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.097+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.097+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a7026ca40 con 0x557a702627c0 2024-09-10T04:50:34.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.097+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.110 INFO:teuthology.orchestra.run.smithi145.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.099+0000 7f2ad17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.099+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93984355964528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a70261400 con 0x557a70259350 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.100+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93984355964528] v32'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.100+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93984355937936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a1770 con 0x557a7025d580 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.101+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93984355937936] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.101+0000 7f2c1f810800 20 remove_watcher() i=0 2024-09-10T04:50:34.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.101+0000 7f2c1f810800 2 removed watcher, disabling cache 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.101+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93984355943872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x557a70259350 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.102+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93984355943872] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x557a70259350 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.102+0000 7f2c1f810800 20 remove_watcher() i=1 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.102+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93984355947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x557a7025d580 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.103+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93984355947936] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.103+0000 7f2c1f810800 20 remove_watcher() i=2 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.103+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93984355941744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x7f2c0c07e040 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.104+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93984355941744] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.104+0000 7f2c1f810800 20 remove_watcher() i=3 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.104+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93984355953152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x557a7025d580 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.105+0000 7f2c1af7a640 1 -- 172.21.15.145:0/246915339 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93984355953152] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0c03d070 con 0x557a7025d580 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.105+0000 7f2c1f810800 20 remove_watcher() i=4 2024-09-10T04:50:34.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.105+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93984355944992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x557a702627c0 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.106+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93984355944992] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.106+0000 7f2c1f810800 20 remove_watcher() i=5 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.106+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93984355955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x557a702627c0 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.107+0000 7f2c13fff640 1 -- 172.21.15.145:0/246915339 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93984355955824] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c04082070 con 0x557a702627c0 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.107+0000 7f2c1f810800 20 remove_watcher() i=6 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.107+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93984355963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a702a67e0 con 0x7f2c0c07e040 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93984355963216] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c14041040 con 0x7f2c0c07e040 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 20 remove_watcher() i=7 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a7025d580 msgr2=0x557a7025fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a7025d580 0x557a7025fa40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a70259350 msgr2=0x557a7025b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a70259350 0x557a7025b7e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2c0c07e040 msgr2=0x7f2c0c046420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f2c0c07e040 0x7f2c0c046420 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557a702627c0 msgr2=0x557a70264bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.108+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557a702627c0 0x557a70264bf0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ae403c780 msgr2=0x7f2ae403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2ae403c780 0x7f2ae403ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x557a702287e0 tx=0x7f2c04063040 comp rx=0 tx=0).stop 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 msgr2=0x557a7024dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1b77b640 1 -- 172.21.15.145:0/246915339 reap_dead start 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c054fd0 tx=0x7f2c0c03cfe0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 shutdown_connections 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/246915339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70246940 0x557a7024dda0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 >> 172.21.15.145:0/246915339 conn(0x557a70242d40 msgr2=0x557a70240f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 shutdown_connections 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/246915339 wait complete. 2024-09-10T04:50:34.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 msgr2=0x7f2af403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 0x7f2af403ec40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x557a701220e0 tx=0x7f2c04005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 msgr2=0x557a7023a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0442a0 tx=0x7f2c0c0167f0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 shutdown_connections 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2af403c780 0x7f2af403ec40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/1667058150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a7023a0c0 0x557a7023a4e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 >> 172.21.15.145:0/1667058150 conn(0x557a7022e470 msgr2=0x557a7022e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 shutdown_connections 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/1667058150 wait complete. 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a702245c0 msgr2=0x557a702269b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557a702245c0 0x557a702269b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a701271e0 msgr2=0x557a702232f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557a701271e0 0x557a702232f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557a70229c40 msgr2=0x557a7022c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.109+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557a70229c40 0x557a7022c030 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2b0003c780 msgr2=0x7f2b0003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f2b0003c780 0x7f2b0003ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x557a700954b0 tx=0x7f2c04050000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 msgr2=0x557a70122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 --2- 172.21.15.145:0/880350389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a70123670 0x557a70122d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x557a70213430 tx=0x7f2c0c0040e0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1b77b640 1 -- 172.21.15.145:0/880350389 reap_dead start 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 shutdown_connections 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 >> 172.21.15.145:0/880350389 conn(0x557a7011d1b0 msgr2=0x557a70213780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 shutdown_connections 2024-09-10T04:50:34.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.110+0000 7f2c1f810800 1 -- 172.21.15.145:0/880350389 wait complete. 2024-09-10T04:50:34.121 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-10T04:50:34.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T04:50:34.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T04:50:34.122 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T04:50:34.207 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:34.207 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:34.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.206+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.206+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0c1020800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fcf19094a0 0x55fcf19098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0c1020800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcf17b4e40 con 0x55fcf1909de0 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0c1020800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55fcf177f680 con 0x55fcf19094a0 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0beb0a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fcf19094a0 0x55fcf19098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0b7fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55fcf1909de0 0x55fcf190a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39350/0 (socket says 172.21.15.145:39350) 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3341943674 learned_addr learned my addr 172.21.15.145:0/3341943674 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3341943674 >> v1:172.21.15.98:6789/0 conn(0x55fcf1909de0 legacy=0x55fcf190a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.207+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3341943674 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf179b6b0 con 0x55fcf19094a0 2024-09-10T04:50:34.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.209+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/3341943674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19098a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000a470 tx=0x7fb0b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1311c8681cb17b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.209+0000 7fb0be309640 1 -- 172.21.15.145:0/3341943674 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0053570 con 0x55fcf19094a0 2024-09-10T04:50:34.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.209+0000 7fb0be309640 1 -- 172.21.15.145:0/3341943674 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0058070 con 0x55fcf19094a0 2024-09-10T04:50:34.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.209+0000 7fb0be309640 1 -- 172.21.15.145:0/3341943674 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0053880 con 0x55fcf19094a0 2024-09-10T04:50:34.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 -- 172.21.15.145:0/3341943674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 msgr2=0x55fcf19098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3341943674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19098a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000a470 tx=0x7fb0b0045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:34.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 -- 172.21.15.145:0/3341943674 shutdown_connections 2024-09-10T04:50:34.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3341943674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19098a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 -- 172.21.15.145:0/3341943674 >> 172.21.15.145:0/3341943674 conn(0x55fcf19051f0 msgr2=0x55fcf1907630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 -- 172.21.15.145:0/3341943674 shutdown_connections 2024-09-10T04:50:34.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.210+0000 7fb0c1020800 1 -- 172.21.15.145:0/3341943674 wait complete. 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.223+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.223+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0c1020800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0c1020800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcf17a3dd0 con 0x55fcf19094a0 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56596/0 (socket says 172.21.15.145:56596) 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2231691739 learned_addr learned my addr 172.21.15.145:0/2231691739 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2231691739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf17bce10 con 0x55fcf19094a0 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/2231691739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0025c20 tx=0x7fb0b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2d77e4e780917b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7faface09640 1 -- 172.21.15.145:0/2231691739 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0053a20 con 0x55fcf19094a0 2024-09-10T04:50:34.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.224+0000 7faface09640 1 -- 172.21.15.145:0/2231691739 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0063070 con 0x55fcf19094a0 2024-09-10T04:50:34.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7faface09640 1 -- 172.21.15.145:0/2231691739 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0053cf0 con 0x55fcf19094a0 2024-09-10T04:50:34.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 -- 172.21.15.145:0/2231691739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 msgr2=0x55fcf19fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2231691739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0025c20 tx=0x7fb0b0051000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 -- 172.21.15.145:0/2231691739 shutdown_connections 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2231691739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf19fc7e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 -- 172.21.15.145:0/2231691739 >> 172.21.15.145:0/2231691739 conn(0x55fcf19051f0 msgr2=0x55fcf19f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 -- 172.21.15.145:0/2231691739 shutdown_connections 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.225+0000 7fb0c1020800 1 -- 172.21.15.145:0/2231691739 wait complete. 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0c1020800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf1a04120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0c1020800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcf190ad60 con 0x55fcf19094a0 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf1a04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf1a04120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56610/0 (socket says 172.21.15.145:56610) 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0beb0a640 1 -- 172.21.15.145:0/376734045 learned_addr learned my addr 172.21.15.145:0/376734045 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0beb0a640 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1a04680 con 0x55fcf19094a0 2024-09-10T04:50:34.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.226+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf1a04120 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0025c20 tx=0x7fb0b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fafab606640 1 -- 172.21.15.145:0/376734045 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0068660 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fafab606640 1 -- 172.21.15.145:0/376734045 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0068800 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fafab606640 1 -- 172.21.15.145:0/376734045 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0068ae0 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcf1a04910 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf1a05520 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.227+0000 7fafab606640 1 -- 172.21.15.145:0/376734045 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0b0068c80 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fafab606640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fafa403c780 0x7fafa403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fafab606640 1 -- 172.21.15.145:0/376734045 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb0b00982b0 con 0x55fcf19094a0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fafa403c780 0x7fafa403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1909de0 0x55fcf1a0b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a0bcb0 con 0x55fcf1909de0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1909de0 0x55fcf1a0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fafa403c780 0x7fafa403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8001d70 tx=0x7fb0a80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1909de0 0x55fcf1a0b770 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0bf30b640 1 -- 172.21.15.145:0/376734045 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1909de0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a0c560 0x55fcf1a0e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.228+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a0f140 con 0x55fcf1a0c560 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.229+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a0c560 0x55fcf1a0e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.229+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a0c560 0x55fcf1a0e9d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.229+0000 7fb0beb0a640 1 -- 172.21.15.145:0/376734045 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b0051070 con 0x55fcf1a0c560 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.229+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a109f0 con 0x55fcf1909de0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0bf30b640 1 -- 172.21.15.145:0/376734045 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1909de0 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a0fc20 con 0x55fcf1a0c560 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0beb0a640 1 -- 172.21.15.145:0/376734045 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b0051070 con 0x55fcf1a0c560 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcf1a11da0 0x55fcf1a14190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a146d0 con 0x55fcf1a11da0 2024-09-10T04:50:34.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcf1a11da0 0x55fcf1a14190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.230+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcf1a11da0 0x55fcf1a14190 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0b7fff640 1 -- 172.21.15.145:0/376734045 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a11da0 2024-09-10T04:50:34.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0c1020800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0c1020800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1801a00 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.231+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56624/0 (socket says 172.21.15.145:56624) 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2289409714 learned_addr learned my addr 172.21.15.145:0/2289409714 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2289409714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1a22cd0 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb0b005db10 tx=0x7fb0b0074f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fafa8e01640 1 -- 172.21.15.145:0/2289409714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b008d020 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fafa8e01640 1 -- 172.21.15.145:0/2289409714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0082070 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcf1a23500 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fafa8e01640 1 -- 172.21.15.145:0/2289409714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b005eb00 con 0x55fcf1a22270 2024-09-10T04:50:34.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.232+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf1a23aa0 con 0x55fcf1a22270 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fafa8e01640 1 -- 172.21.15.145:0/2289409714 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0b005eca0 con 0x55fcf1a22270 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fafa8e01640 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 0x7faf9803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fafa8e01640 1 -- 172.21.15.145:0/2289409714 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb0b0099db0 con 0x55fcf1a22270 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 0x7faf9803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.233+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 0x7faf9803ec40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800bf40 tx=0x7fb0a800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0c1020800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0c1020800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcf19fcfd0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56636/0 (socket says 172.21.15.145:56636) 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2520336447 learned_addr learned my addr 172.21.15.145:0/2520336447 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0beb0a640 1 -- 172.21.15.145:0/2520336447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1a2f5e0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.234+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/2520336447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00888b0 tx=0x7fb0b00883e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3024894c1cd248a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fafa27fc640 1 -- 172.21.15.145:0/2520336447 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0089480 con 0x55fcf1a2ec10 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fafa27fc640 1 -- 172.21.15.145:0/2520336447 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0002000 con 0x55fcf1a2ec10 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fafa27fc640 1 -- 172.21.15.145:0/2520336447 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0089620 con 0x55fcf1a2ec10 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- 172.21.15.145:0/2520336447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 msgr2=0x55fcf1a2eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2520336447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00888b0 tx=0x7fb0b00883e0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- 172.21.15.145:0/2520336447 shutdown_connections 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2520336447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a2eff0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- 172.21.15.145:0/2520336447 >> 172.21.15.145:0/2520336447 conn(0x55fcf1a2b010 msgr2=0x55fcf1a29250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- 172.21.15.145:0/2520336447 shutdown_connections 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- 172.21.15.145:0/2520336447 wait complete. 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 Processor -- start 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.235+0000 7fb0c1020800 1 -- start start 2024-09-10T04:50:34.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0c1020800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a36070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0c1020800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcf1a2fa70 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a36070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0beb0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a36070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56646/0 (socket says 172.21.15.145:56646) 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 learned_addr learned my addr 172.21.15.145:0/3835584105 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf1a365d0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a36070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb0b009bfb0 tx=0x7fb0b0096f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fafa0ff9640 1 -- 172.21.15.145:0/3835584105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b00969f0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fafa0ff9640 1 -- 172.21.15.145:0/3835584105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0096b90 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcf1a365d0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fafa0ff9640 1 -- 172.21.15.145:0/3835584105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0088a30 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.236+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf1a365d0 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.237+0000 7fafa0ff9640 1 -- 172.21.15.145:0/3835584105 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0b00be020 con 0x55fcf1a2ec10 2024-09-10T04:50:34.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.237+0000 7fafa0ff9640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf8803c730 0x7faf8803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.237+0000 7fafa0ff9640 1 -- 172.21.15.145:0/3835584105 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb0b00bc020 con 0x55fcf1a2ec10 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.237+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf8803c730 0x7faf8803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf8803c730 0x7faf8803ebf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c010 tx=0x7fb0a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1a41650 0x55fcf1a43b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a44260 con 0x55fcf1a41650 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1a41650 0x55fcf1a43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.238+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1a41650 0x55fcf1a43b10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 realm 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a40980 con 0x55fcf1a41650 2024-09-10T04:50:34.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a44cf0 con 0x55fcf1a41650 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a45ad0 0x55fcf1a47ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a48520 con 0x55fcf1a45ad0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.239+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a45ad0 0x55fcf1a47ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a45ad0 0x55fcf1a47ec0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a48d70 con 0x55fcf1a41650 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 20 searching for the correct realm 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcf1a4aae0 0x55fcf1a4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.240+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcf1a4aae0 0x55fcf1a4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0b7fff640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcf1a4aae0 0x55fcf1a4ced0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0beb0a640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb0b005f040 0x7fb0b00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.241+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb0b005f040 0x7fb0b00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb0b005f040 0x7fb0b00b78a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0b800a4d0 con 0x7fb0b005f040 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.242+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.243+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55fcf1a41650 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x7fb0b005f040 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0b8030040 con 0x7fb0b005f040 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.244+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.245+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.246+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x7fb0b005f040 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a41650 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x7fb0b005f040 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x7fb0b005f040 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8030040 con 0x7fb0b005f040 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.247+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.248+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4d5a0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a496f0 con 0x55fcf1a41650 2024-09-10T04:50:34.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b8030040 con 0x55fcf1a41650 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.249+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a49f90 con 0x55fcf1a45ad0 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a49330 con 0x7fb0b005f040 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 zone default found 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 4 Realm: () 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:34.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 zonegroup default 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4da20 con 0x7fb0b005f040 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.250+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4f510 con 0x55fcf1a4aae0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4fdb0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 20 started sync module instance, tier type = 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.251+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4e8b0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.252+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.252+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94544874237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4e8b0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.252+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a50600 con 0x55fcf1a41650 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.253+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.253+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94544874237088] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.253+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94544874242384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a50a20 con 0x55fcf1a41650 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.253+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a4e440 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.254+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94544874242384] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.254+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.254+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94544874243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a50990 con 0x55fcf1a45ad0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.254+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a51ab0 con 0x7fb0b005f040 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.255+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94544874243440] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.256+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.256+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94544874246112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a51ab0 con 0x7fb0b005f040 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.256+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a524f0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.256+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.257+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94544874250304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a52460 con 0x55fcf1a45ad0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.257+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a53410 con 0x55fcf1a4aae0 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.257+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94544874246112] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.257+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.257+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94544874250304] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.258+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94544874254176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a51600 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.258+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a53cb0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.259+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94544874254176] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.259+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.259+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94544874252512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a54550 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.259+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a54e20 con 0x7fb0b005f040 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94544874252512] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94544874260720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a55210 con 0x7fb0b005f040 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=0 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=1 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=2 2024-09-10T04:50:34.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=3 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=4 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=5 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.260+0000 7fb0c1020800 20 add_watcher() i=6 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.261+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94544874260720] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.261+0000 7fb0c1020800 20 add_watcher() i=7 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.261+0000 7fb0c1020800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.261+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a586a0 con 0x55fcf1a41650 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.262+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.262+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94544874258592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a55c30 con 0x55fcf1a41650 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94544874258592] v32'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7faf757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0c1020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0c1020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0c1020800 5 note: GC not initialized 2024-09-10T04:50:34.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7faeeffff640 20 reqs_thread_entry: start 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0c1020800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.263+0000 7fb0c1020800 20 Filter name: none 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7faeedffb640 20 reqs_thread_entry: start 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a8b730 con 0x55fcf1a41650 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a8e060 con 0x7fb0b005f040 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 20 disabling bucket name=myfoo 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.264+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a8c040 con 0x7fb0b005f040 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a8e930 con 0x55fcf1a4aae0 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(65 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:34.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.265+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a961d0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0c1020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0c1020800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0c1020800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0c1020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94544874500080 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a94eb0 con 0x55fcf1a41650 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== watch-notify(notify (1) cookie 94544874242384 notify 137438953477 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fb0b8010d30 con 0x55fcf1a41650 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fafa27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94544874242384 notifier 4594 bl.length()=760 2024-09-10T04:50:34.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fafa27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fafa27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fafa27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fafa27fc640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faf84003ea0 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.266+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(67 notify.1 [notify cookie 94544874500080 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== watch-notify(notify_complete (2) cookie 94544874500080 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb0b800d610 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0c1020800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0c1020800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0c1020800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0c1020800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.267+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a95a10 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0c1020800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0c1020800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0c1020800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94544874491024 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a8d0b0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94544874250304 notify 137438953504 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55fcf1a23500 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fafa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94544874250304 notifier 4594 bl.length()=567 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fafa1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fafa1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(70 notify.4 [notify cookie 94544874491024 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.268+0000 7fafa1ffb640 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faef4003430 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.269+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.269+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94544874491024 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fcf1a22cd0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.283 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:34.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.270+0000 7faf757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.270+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94544874258592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a41650 2024-09-10T04:50:34.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.271+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94544874258592] v32'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.271+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94544874237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.272+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94544874237088] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.272+0000 7fb0c1020800 20 remove_watcher() i=0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.272+0000 7fb0c1020800 2 removed watcher, disabling cache 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.272+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94544874242384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a41650 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.273+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94544874242384] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x55fcf1a41650 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.273+0000 7fb0c1020800 20 remove_watcher() i=1 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.273+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94544874243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.274+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94544874243440] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.274+0000 7fb0c1020800 20 remove_watcher() i=2 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.274+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94544874246112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x7fb0b005f040 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.275+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94544874246112] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.275+0000 7fb0c1020800 20 remove_watcher() i=3 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.275+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94544874250304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a45ad0 2024-09-10T04:50:34.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.276+0000 7fb0beb0a640 1 -- 172.21.15.145:0/3835584105 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94544874250304] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b008f020 con 0x55fcf1a45ad0 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.276+0000 7fb0c1020800 20 remove_watcher() i=4 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.276+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94544874254176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.277+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94544874254176] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.277+0000 7fb0c1020800 20 remove_watcher() i=5 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.277+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94544874252512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x55fcf1a4aae0 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.278+0000 7fb0b7fff640 1 -- 172.21.15.145:0/3835584105 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94544874252512] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0a8009050 con 0x55fcf1a4aae0 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.278+0000 7fb0c1020800 20 remove_watcher() i=6 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.278+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94544874260720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcf1a895d0 con 0x7fb0b005f040 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94544874260720] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8041040 con 0x7fb0b005f040 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 20 remove_watcher() i=7 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a45ad0 msgr2=0x55fcf1a47ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a45ad0 0x55fcf1a47ec0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1a41650 msgr2=0x55fcf1a43b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1a41650 0x55fcf1a43b10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb0b005f040 msgr2=0x7fb0b00b78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb0b005f040 0x7fb0b00b78a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcf1a4aae0 msgr2=0x55fcf1a4ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fcf1a4aae0 0x55fcf1a4ced0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf8803c730 msgr2=0x7faf8803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf8803c730 0x7faf8803ebf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c010 tx=0x7fb0a8010000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 msgr2=0x55fcf1a36070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/3835584105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a2ec10 0x55fcf1a36070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb0b009bfb0 tx=0x7fb0b0096f70 comp rx=0 tx=0).stop 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 reap_dead start 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0bf30b640 1 -- 172.21.15.145:0/3835584105 reap_dead start 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 shutdown_connections 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 >> 172.21.15.145:0/3835584105 conn(0x55fcf1a2b010 msgr2=0x55fcf1a29220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 shutdown_connections 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/3835584105 wait complete. 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 msgr2=0x7faf9803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 0x7faf9803ec40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800bf40 tx=0x7fb0a800f000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 msgr2=0x55fcf1a22690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb0b005db10 tx=0x7fb0b0074f60 comp rx=0 tx=0).stop 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 shutdown_connections 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faf9803c780 0x7faf9803ec40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 --2- 172.21.15.145:0/2289409714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf1a22270 0x55fcf1a22690 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 >> 172.21.15.145:0/2289409714 conn(0x55fcf1a16620 msgr2=0x55fcf1a16a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 shutdown_connections 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.279+0000 7fb0c1020800 1 -- 172.21.15.145:0/2289409714 wait complete. 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a0c560 msgr2=0x55fcf1a0e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fcf1a0c560 0x55fcf1a0e9d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1909de0 msgr2=0x55fcf1a0b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fcf1909de0 0x55fcf1a0b770 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcf1a11da0 msgr2=0x55fcf1a14190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fcf1a11da0 0x55fcf1a14190 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fafa403c780 msgr2=0x7fafa403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fafa403c780 0x7fafa403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8001d70 tx=0x7fb0a80012d0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 msgr2=0x55fcf1a04120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 --2- 172.21.15.145:0/376734045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcf19094a0 0x55fcf1a04120 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0025c20 tx=0x7fb0b0002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0bf30b640 1 -- 172.21.15.145:0/376734045 reap_dead start 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 shutdown_connections 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 >> 172.21.15.145:0/376734045 conn(0x55fcf19051f0 msgr2=0x55fcf19f6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 shutdown_connections 2024-09-10T04:50:34.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.280+0000 7fb0c1020800 1 -- 172.21.15.145:0/376734045 wait complete. 2024-09-10T04:50:34.294 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:34.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T04:50:34.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T04:50:34.297 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T04:50:34.341 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:34.341 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:34.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a4722800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557671ee7df0 0x557671ee8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a4722800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557671d92e40 con 0x557671ee9030 2024-09-10T04:50:34.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a4722800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x557671d5d680 con 0x557671ee7df0 2024-09-10T04:50:34.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa3a0468640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557671ee7df0 0x557671ee8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa39fc67640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x557671ee9030 0x557671eedd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:39364/0 (socket says 172.21.15.145:39364) 2024-09-10T04:50:34.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.341+0000 7fa39fc67640 1 -- 172.21.15.145:0/1678433800 learned_addr learned my addr 172.21.15.145:0/1678433800 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:34.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.342+0000 7fa39f466640 1 -- 172.21.15.145:0/1678433800 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584744090 0 0) 0x557671d92e40 con 0x557671ee9030 2024-09-10T04:50:34.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.342+0000 7fa39f466640 1 -- 172.21.15.145:0/1678433800 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa388001e10 con 0x557671ee9030 2024-09-10T04:50:34.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.342+0000 7fa3a0468640 1 -- 172.21.15.145:0/1678433800 >> v1:172.21.15.98:6789/0 conn(0x557671ee9030 legacy=0x557671eedd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.342+0000 7fa3a0468640 1 -- 172.21.15.145:0/1678433800 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671d796b0 con 0x557671ee7df0 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.343+0000 7fa3a0468640 1 --2- 172.21.15.145:0/1678433800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671ee8af0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a470 tx=0x7fa390045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9b0f1051887f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa39f466640 1 -- 172.21.15.145:0/1678433800 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390059070 con 0x557671ee7df0 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa39f466640 1 -- 172.21.15.145:0/1678433800 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390054570 con 0x557671ee7df0 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa39f466640 1 -- 172.21.15.145:0/1678433800 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390054870 con 0x557671ee7df0 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 -- 172.21.15.145:0/1678433800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 msgr2=0x557671ee8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1678433800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671ee8af0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a470 tx=0x7fa390045920 comp rx=0 tx=0).stop 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 -- 172.21.15.145:0/1678433800 shutdown_connections 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1678433800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671ee8af0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 -- 172.21.15.145:0/1678433800 >> 172.21.15.145:0/1678433800 conn(0x557671ee31c0 msgr2=0x557671ee5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 -- 172.21.15.145:0/1678433800 shutdown_connections 2024-09-10T04:50:34.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.344+0000 7fa3a4722800 1 -- 172.21.15.145:0/1678433800 wait complete. 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.358+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.358+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.358+0000 7fa3a4722800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.358+0000 7fa3a4722800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557671d81dd0 con 0x557671ee7df0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56658/0 (socket says 172.21.15.145:56658) 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa3a0468640 1 -- 172.21.15.145:0/4075825466 learned_addr learned my addr 172.21.15.145:0/4075825466 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa3a0468640 1 -- 172.21.15.145:0/4075825466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671d9ae10 con 0x557671ee7df0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa3a0468640 1 --2- 172.21.15.145:0/4075825466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a470 tx=0x7fa39004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2caba4083e8e336e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa28e60c640 1 -- 172.21.15.145:0/4075825466 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390065070 con 0x557671ee7df0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa28e60c640 1 -- 172.21.15.145:0/4075825466 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39005a040 con 0x557671ee7df0 2024-09-10T04:50:34.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.359+0000 7fa28e60c640 1 -- 172.21.15.145:0/4075825466 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390059070 con 0x557671ee7df0 2024-09-10T04:50:34.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- 172.21.15.145:0/4075825466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 msgr2=0x557671e5bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 --2- 172.21.15.145:0/4075825466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a470 tx=0x7fa39004e000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- 172.21.15.145:0/4075825466 shutdown_connections 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 --2- 172.21.15.145:0/4075825466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671e5bdb0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- 172.21.15.145:0/4075825466 >> 172.21.15.145:0/4075825466 conn(0x557671ee31c0 msgr2=0x557671fd2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- 172.21.15.145:0/4075825466 shutdown_connections 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- 172.21.15.145:0/4075825466 wait complete. 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.360+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a4722800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671fdfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a4722800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557671ee9720 con 0x557671ee7df0 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671fdfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671fdfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56666/0 (socket says 172.21.15.145:56666) 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a0468640 1 -- 172.21.15.145:0/1866543269 learned_addr learned my addr 172.21.15.145:0/1866543269 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a0468640 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671fe02e0 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a0468640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671fdfd80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa390025b20 tx=0x7fa390002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa28ce09640 1 -- 172.21.15.145:0/1866543269 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390071070 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa28ce09640 1 -- 172.21.15.145:0/1866543269 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390066040 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557671fe0570 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.361+0000 7fa28ce09640 1 -- 172.21.15.145:0/1866543269 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390065050 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.362+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557671fe0f70 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.362+0000 7fa28ce09640 1 -- 172.21.15.145:0/1866543269 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa390074070 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.362+0000 7fa28ce09640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa28803c780 0x7fa28803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa28ce09640 1 -- 172.21.15.145:0/1866543269 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa390096780 con 0x557671ee7df0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa28803c780 0x7fa28803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557671ee9030 0x557671fe73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557671fe7910 con 0x557671ee9030 2024-09-10T04:50:34.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557671ee9030 0x557671fe73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa28803c780 0x7fa28803ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa394001db0 tx=0x7fa394001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557671ee9030 0x557671fe73d0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a0c69640 1 -- 172.21.15.145:0/1866543269 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa39800a4d0 con 0x557671ee9030 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557671fe81c0 0x557671fea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.363+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557671feada0 con 0x557671fe81c0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a0468640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557671fe81c0 0x557671fea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a0468640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557671fe81c0 0x557671fea630 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a0468640 1 -- 172.21.15.145:0/1866543269 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa390073030 con 0x557671fe81c0 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557671fec650 con 0x557671ee9030 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a0c69640 1 -- 172.21.15.145:0/1866543269 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa39800a4d0 con 0x557671ee9030 2024-09-10T04:50:34.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.364+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557671feb880 con 0x557671fe81c0 2024-09-10T04:50:34.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa3a0468640 1 -- 172.21.15.145:0/1866543269 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa390073030 con 0x557671fe81c0 2024-09-10T04:50:34.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557671feda00 0x557671fefdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557671ff0330 con 0x557671feda00 2024-09-10T04:50:34.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557671feda00 0x557671fefdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557671feda00 0x557671fefdf0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.365+0000 7fa39fc67640 1 -- 172.21.15.145:0/1866543269 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa394009050 con 0x557671feda00 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a4722800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a4722800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557671ddfa00 con 0x557671ffde80 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56674/0 (socket says 172.21.15.145:56674) 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.366+0000 7fa3a0468640 1 -- 172.21.15.145:0/1256795618 learned_addr learned my addr 172.21.15.145:0/1256795618 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa3a0468640 1 -- 172.21.15.145:0/1256795618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671ffe8e0 con 0x557671ffde80 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa3a0468640 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa390096010 tx=0x7fa39005eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa285ffb640 1 -- 172.21.15.145:0/1256795618 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390086070 con 0x557671ffde80 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa285ffb640 1 -- 172.21.15.145:0/1256795618 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39006ba90 con 0x557671ffde80 2024-09-10T04:50:34.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa285ffb640 1 -- 172.21.15.145:0/1256795618 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39006bd70 con 0x557671ffde80 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557671fff110 con 0x557671ffde80 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.367+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557671fff6b0 con 0x557671ffde80 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa285ffb640 1 -- 172.21.15.145:0/1256795618 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa390093310 con 0x557671ffde80 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa285ffb640 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 0x7fa27803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa285ffb640 1 -- 172.21.15.145:0/1256795618 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa39008c440 con 0x557671ffde80 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 0x7fa27803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa39fc67640 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 0x7fa27803ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x557671fe1c60 tx=0x7fa39400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa3a4722800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.368+0000 7fa3a4722800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557671fdb0b0 con 0x557671fd7070 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56680/0 (socket says 172.21.15.145:56680) 2024-09-10T04:50:34.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa3a0468640 1 -- 172.21.15.145:0/2922693586 learned_addr learned my addr 172.21.15.145:0/2922693586 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa3a0468640 1 -- 172.21.15.145:0/2922693586 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557671fd7a40 con 0x557671fd7070 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa3a0468640 1 --2- 172.21.15.145:0/2922693586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa390057040 tx=0x7fa39008b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6e386b54df963 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa2777fe640 1 -- 172.21.15.145:0/2922693586 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3900a7070 con 0x557671fd7070 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa2777fe640 1 -- 172.21.15.145:0/2922693586 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39008be30 con 0x557671fd7070 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.369+0000 7fa2777fe640 1 -- 172.21.15.145:0/2922693586 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39006dd20 con 0x557671fd7070 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- 172.21.15.145:0/2922693586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 msgr2=0x557671fd7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 --2- 172.21.15.145:0/2922693586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa390057040 tx=0x7fa39008b650 comp rx=0 tx=0).stop 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- 172.21.15.145:0/2922693586 shutdown_connections 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 --2- 172.21.15.145:0/2922693586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557671fd7450 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- 172.21.15.145:0/2922693586 >> 172.21.15.145:0/2922693586 conn(0x557672006b40 msgr2=0x557672004d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- 172.21.15.145:0/2922693586 shutdown_connections 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- 172.21.15.145:0/2922693586 wait complete. 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 Processor -- start 2024-09-10T04:50:34.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- start start 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a4722800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557671fd7f50 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a0468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:56684/0 (socket says 172.21.15.145:56684) 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.370+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 learned_addr learned my addr 172.21.15.145:0/3135478792 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557672014280 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa3a0468640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa39008b7a0 tx=0x7fa39008c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa275ffb640 1 -- 172.21.15.145:0/3135478792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3900b2020 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa275ffb640 1 -- 172.21.15.145:0/3135478792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390093730 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557672014280 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa275ffb640 1 -- 172.21.15.145:0/3135478792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3900a7040 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.371+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557672014280 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.372+0000 7fa275ffb640 1 -- 172.21.15.145:0/3135478792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3900b5020 con 0x557671fd7070 2024-09-10T04:50:34.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.372+0000 7fa275ffb640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa26803c730 0x7fa26803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.372+0000 7fa275ffb640 1 -- 172.21.15.145:0/3135478792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa3900b8c60 con 0x557671fd7070 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.372+0000 7fa39fc67640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa26803c730 0x7fa26803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa39fc67640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa26803c730 0x7fa26803ebf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa39400efd0 tx=0x7fa394024000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55767201f300 0x5576720217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672021f10 con 0x55767201f300 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55767201f300 0x5576720217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55767201f300 0x5576720217c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 20 realm 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.373+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767201e630 con 0x55767201f300 2024-09-10T04:50:34.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576720229a0 con 0x55767201f300 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557672023780 0x557672025b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576720261d0 con 0x557672023780 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a0468640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557672023780 0x557672025b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.374+0000 7fa3a0468640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557672023780 0x557672025b70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672026a20 con 0x55767201f300 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 20 searching for the correct realm 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557672028790 0x55767202abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa39fc67640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557672028790 0x55767202abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.375+0000 7fa39fc67640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557672028790 0x55767202abc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0468640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa3900b7020 0x7fa39008c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa3900b7020 0x7fa39008c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0c69640 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa3900b7020 0x7fa39008c9f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa39800a4d0 con 0x7fa3900b7020 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.376+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.377+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39800a4d0 con 0x55767201f300 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x7fa3900b7020 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.378+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa398030040 con 0x7fa3900b7020 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.379+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.380+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x55767201f300 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.381+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398030040 con 0x7fa3900b7020 2024-09-10T04:50:34.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.382+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672028790 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55767202b290 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576720273a0 con 0x55767201f300 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa398030040 con 0x55767201f300 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.383+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672027c40 con 0x557672023780 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672026fe0 con 0x7fa3900b7020 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 zone default found 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 4 Realm: () 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 zonegroup default 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767202b750 con 0x7fa3900b7020 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767202d5d0 con 0x557672028790 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.384+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767202dee0 con 0x557672028790 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 20 started sync module instance, tier type = 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.385+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202ca20 con 0x557672023780 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.386+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.386+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967207288384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202ca20 con 0x557672023780 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.386+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202e730 con 0x55767201f300 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.387+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.387+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967207293568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202eb50 con 0x55767201f300 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.387+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967207288384] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.387+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202c5b0 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.388+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967207293568] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.388+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.388+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967207294624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202eac0 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.388+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202fc10 con 0x7fa3900b7020 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.389+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967207294624] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.389+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.389+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967207297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767202fc10 con 0x7fa3900b7020 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.390+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720305d0 con 0x557672023780 2024-09-10T04:50:34.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.390+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.390+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967207301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672030540 con 0x557672023780 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.391+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672031500 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.391+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967207297344] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.391+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.392+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967207305232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672031920 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.392+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967207301408] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.392+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720309f0 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.392+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967207305232] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.393+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.393+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967207308848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672032700 con 0x557672028790 2024-09-10T04:50:34.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.393+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672032f90 con 0x7fa3900b7020 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967207308848] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967207309904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672033380 con 0x7fa3900b7020 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=0 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=1 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=2 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=3 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=4 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=5 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.394+0000 7fa3a4722800 20 add_watcher() i=6 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967207309904] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a4722800 20 add_watcher() i=7 2024-09-10T04:50:34.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a4722800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576720367b0 con 0x55767201f300 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.395+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967207312032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557672033cd0 con 0x55767201f300 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.396+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967207312032] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.396+0000 7fa2567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.396+0000 7fa3a4722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.396+0000 7fa3a4722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 5 note: GC not initialized 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa2557e2640 20 reqs_thread_entry: start 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 20 Filter name: none 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa1c6ffd640 20 reqs_thread_entry: start 2024-09-10T04:50:34.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.397+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672069710 con 0x55767201f300 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767206c040 con 0x7fa3900b7020 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 20 enabling bucket name=myfoo 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767206a020 con 0x7fa3900b7020 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 : miss 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 20 rados->read ofs=0 len=0 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.398+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55767206c910 con 0x557672028790 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(65 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.399+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 8.b 8:d32c608a:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720740f0 con 0x557672028790 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(66 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a4722800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a4722800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a4722800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1, ofs0, ns] 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93967207550896 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557672072e70 con 0x55767201f300 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== watch-notify(notify (1) cookie 93967207293568 notify 137438953478 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fa398010d50 con 0x55767201f300 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa2777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93967207293568 notifier 4601 bl.length()=760 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa2777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 info.flags=0x17 2024-09-10T04:50:34.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa2777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1 to cache LRU end 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa2777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa2777fe640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa264003ea0 con 0x55767201f300 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.400+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(67 notify.1 [notify cookie 93967207550896 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== watch-notify(notify_complete (2) cookie 93967207550896 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa39800d610 con 0x55767201f300 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a4722800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_sources= new_sources= 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a4722800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential sources added=[] removed=[] 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a4722800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): orig_dests= new_dests= 2024-09-10T04:50:34.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a4722800 20 handle_bi_update(): bucket=:myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1]): potential dests added=[] removed=[] 2024-09-10T04:50:34.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.401+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55767206efb0 con 0x55767201f300 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.402+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.402+0000 7fa3a4722800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.402+0000 7fa3a4722800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.402+0000 7fa3a4722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.402+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93967207529872 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576720681b0 con 0x557672023780 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93967207301408 notify 137438953505 ret 0) ==== 609+0+0 (crc 0 0 0) 0x557671fff110 con 0x557672023780 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa276ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 93967207301408 notifier 4601 bl.length()=567 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa276ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa276ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(70 notify.4 [notify cookie 93967207529872 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa276ffd640 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1d4003430 con 0x557672023780 2024-09-10T04:50:34.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.403+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93967207529872 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557671ffe8e0 con 0x557672023780 2024-09-10T04:50:34.419 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.404+0000 7fa2567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.404+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967207312032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x55767201f300 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.405+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93967207312032] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.405+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967207288384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x557672023780 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.406+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93967207288384] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.406+0000 7fa3a4722800 20 remove_watcher() i=0 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.406+0000 7fa3a4722800 2 removed watcher, disabling cache 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.406+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967207293568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x55767201f300 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.407+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93967207293568] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x55767201f300 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.407+0000 7fa3a4722800 20 remove_watcher() i=1 2024-09-10T04:50:34.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.407+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967207294624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x557672023780 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.408+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93967207294624] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.408+0000 7fa3a4722800 20 remove_watcher() i=2 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.408+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967207297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x7fa3900b7020 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.409+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93967207297344] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.409+0000 7fa3a4722800 20 remove_watcher() i=3 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.409+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967207301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x557672023780 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.410+0000 7fa3a0468640 1 -- 172.21.15.145:0/3135478792 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93967207301408] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3900aa040 con 0x557672023780 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.410+0000 7fa3a4722800 20 remove_watcher() i=4 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.410+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967207305232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x557672028790 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.411+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93967207305232] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.411+0000 7fa3a4722800 20 remove_watcher() i=5 2024-09-10T04:50:34.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.411+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967207308848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x557672028790 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.412+0000 7fa39fc67640 1 -- 172.21.15.145:0/3135478792 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93967207308848] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa394009050 con 0x557672028790 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.412+0000 7fa3a4722800 20 remove_watcher() i=6 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.412+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967207309904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576720675b0 con 0x7fa3900b7020 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93967207309904] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398041040 con 0x7fa3900b7020 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 20 remove_watcher() i=7 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557672023780 msgr2=0x557672025b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557672023780 0x557672025b70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55767201f300 msgr2=0x5576720217c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55767201f300 0x5576720217c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa3900b7020 msgr2=0x7fa39008c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa3900b7020 0x7fa39008c9f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557672028790 msgr2=0x55767202abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557672028790 0x55767202abc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa26803c730 msgr2=0x7fa26803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa26803c730 0x7fa26803ebf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa39400efd0 tx=0x7fa394024000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 msgr2=0x557672013d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a0c69640 1 -- 172.21.15.145:0/3135478792 reap_dead start 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa39008b7a0 tx=0x7fa39008c080 comp rx=0 tx=0).stop 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 shutdown_connections 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 --2- 172.21.15.145:0/3135478792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671fd7070 0x557672013d20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 >> 172.21.15.145:0/3135478792 conn(0x557672006b40 msgr2=0x557672004d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 shutdown_connections 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.413+0000 7fa3a4722800 1 -- 172.21.15.145:0/3135478792 wait complete. 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 msgr2=0x7fa27803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 0x7fa27803ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x557671fe1c60 tx=0x7fa39400f000 comp rx=0 tx=0).stop 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 msgr2=0x557671ffe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa390096010 tx=0x7fa39005eca0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 shutdown_connections 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa27803c780 0x7fa27803ec40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1256795618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ffde80 0x557671ffe2a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 >> 172.21.15.145:0/1256795618 conn(0x557671ff2230 msgr2=0x557671ff2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 shutdown_connections 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1256795618 wait complete. 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557671fe81c0 msgr2=0x557671fea630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557671fe81c0 0x557671fea630 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557671ee9030 msgr2=0x557671fe73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557671ee9030 0x557671fe73d0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557671feda00 msgr2=0x557671fefdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557671feda00 0x557671fefdf0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa28803c780 msgr2=0x7fa28803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fa28803c780 0x7fa28803ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa394001db0 tx=0x7fa394001310 comp rx=0 tx=0).stop 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 msgr2=0x557671fdfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 --2- 172.21.15.145:0/1866543269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557671ee7df0 0x557671fdfd80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa390025b20 tx=0x7fa390002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a0c69640 1 -- 172.21.15.145:0/1866543269 reap_dead start 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 shutdown_connections 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 >> 172.21.15.145:0/1866543269 conn(0x557671ee31c0 msgr2=0x557671fd1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 shutdown_connections 2024-09-10T04:50:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:34.414+0000 7fa3a4722800 1 -- 172.21.15.145:0/1866543269 wait complete. 2024-09-10T04:50:34.430 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:34.438 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T04:50:34.663 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-10T04:50:34.671 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:49.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T04:50:49.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T04:50:49.673 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T04:50:49.724 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:49.725 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:49.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.724+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.724+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.724+0000 7f88fb546800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a15d440990 0x55a15d4465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.724+0000 7f88fb546800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a15d2eae40 con 0x55a15d440440 2024-09-10T04:50:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.724+0000 7f88fb546800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a15d2b5680 con 0x55a15d440990 2024-09-10T04:50:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.725+0000 7f88f3fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a15d440990 0x55a15d4465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.725+0000 7f88f9037640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55a15d440440 0x55a15d442de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51910/0 (socket says 172.21.15.145:51910) 2024-09-10T04:50:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.725+0000 7f88f9037640 1 -- 172.21.15.145:0/922781307 learned_addr learned my addr 172.21.15.145:0/922781307 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.725+0000 7f88f3fff640 1 -- 172.21.15.145:0/922781307 >> v1:172.21.15.98:6789/0 conn(0x55a15d440440 legacy=0x55a15d442de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.725+0000 7f88f3fff640 1 -- 172.21.15.145:0/922781307 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d2d16b0 con 0x55a15d440990 2024-09-10T04:50:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.727+0000 7f88f3fff640 1 --2- 172.21.15.145:0/922781307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440990 0x55a15d4465c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f88e400a470 tx=0x7f88e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5b265756f83a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.727+0000 7f88f8836640 1 -- 172.21.15.145:0/922781307 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e4053570 con 0x55a15d440990 2024-09-10T04:50:49.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.727+0000 7f88f8836640 1 -- 172.21.15.145:0/922781307 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e4058070 con 0x55a15d440990 2024-09-10T04:50:49.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.727+0000 7f88f8836640 1 -- 172.21.15.145:0/922781307 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e4053880 con 0x55a15d440990 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 -- 172.21.15.145:0/922781307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440990 msgr2=0x55a15d4465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 --2- 172.21.15.145:0/922781307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440990 0x55a15d4465c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f88e400a470 tx=0x7f88e4045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 -- 172.21.15.145:0/922781307 shutdown_connections 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 --2- 172.21.15.145:0/922781307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440990 0x55a15d4465c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 -- 172.21.15.145:0/922781307 >> 172.21.15.145:0/922781307 conn(0x55a15d43a920 msgr2=0x55a15d43cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 -- 172.21.15.145:0/922781307 shutdown_connections 2024-09-10T04:50:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.728+0000 7f88fb546800 1 -- 172.21.15.145:0/922781307 wait complete. 2024-09-10T04:50:49.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88fb546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88fb546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a15d2d9dd0 con 0x55a15d440440 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38158/0 (socket says 172.21.15.145:38158) 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.744+0000 7f88f9037640 1 -- 172.21.15.145:0/505164718 learned_addr learned my addr 172.21.15.145:0/505164718 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.745+0000 7f88f9037640 1 -- 172.21.15.145:0/505164718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d2f2e10 con 0x55a15d440440 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.745+0000 7f88f9037640 1 --2- 172.21.15.145:0/505164718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001dc0 tx=0x7f88ec00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f368761250a164a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.745+0000 7f87e7606640 1 -- 172.21.15.145:0/505164718 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec012020 con 0x55a15d440440 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.745+0000 7f87e7606640 1 -- 172.21.15.145:0/505164718 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec00e470 con 0x55a15d440440 2024-09-10T04:50:49.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.745+0000 7f87e7606640 1 -- 172.21.15.145:0/505164718 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec00e7b0 con 0x55a15d440440 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- 172.21.15.145:0/505164718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 msgr2=0x55a15d52f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 --2- 172.21.15.145:0/505164718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001dc0 tx=0x7f88ec00b6c0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- 172.21.15.145:0/505164718 shutdown_connections 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 --2- 172.21.15.145:0/505164718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d52f580 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- 172.21.15.145:0/505164718 >> 172.21.15.145:0/505164718 conn(0x55a15d43a920 msgr2=0x55a15d52af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- 172.21.15.145:0/505164718 shutdown_connections 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- 172.21.15.145:0/505164718 wait complete. 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.746+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88fb546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d43f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88fb546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a15d446f40 con 0x55a15d440440 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d43f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d43f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38162/0 (socket says 172.21.15.145:38162) 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88f9037640 1 -- 172.21.15.145:0/2039894472 learned_addr learned my addr 172.21.15.145:0/2039894472 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88f9037640 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d43fb30 con 0x55a15d440440 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.747+0000 7f88f9037640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d43f5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a15d530510 tx=0x7f88ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.748+0000 7f87e5e03640 1 -- 172.21.15.145:0/2039894472 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec012030 con 0x55a15d440440 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.748+0000 7f87e5e03640 1 -- 172.21.15.145:0/2039894472 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec001420 con 0x55a15d440440 2024-09-10T04:50:49.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.748+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15d53ac70 con 0x55a15d440440 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.748+0000 7f87e5e03640 1 -- 172.21.15.145:0/2039894472 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec01a7a0 con 0x55a15d440440 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.748+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15d53b230 con 0x55a15d440440 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f87e5e03640 1 -- 172.21.15.145:0/2039894472 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f88ec015020 con 0x55a15d440440 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f87e5e03640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87e003c780 0x7f87e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f87e5e03640 1 -- 172.21.15.145:0/2039894472 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f88ec020030 con 0x55a15d440440 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87e003c780 0x7f87e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d440990 0x55a15d53f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d53f7a0 con 0x55a15d440990 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f88f9838640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d440990 0x55a15d53f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.749+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87e003c780 0x7f87e003ec40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88e4057000 tx=0x7f88e4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.750+0000 7f88f9838640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d440990 0x55a15d53f1a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.750+0000 7f88f9838640 1 -- 172.21.15.145:0/2039894472 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d440990 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.750+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d540590 0x55a15d542980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.750+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d542fc0 con 0x55a15d540590 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.750+0000 7f88f9037640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d540590 0x55a15d542980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.751+0000 7f88f9037640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d540590 0x55a15d542980 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.751+0000 7f88f9037640 1 -- 172.21.15.145:0/2039894472 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d540590 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.751+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d544870 con 0x55a15d440990 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88f9838640 1 -- 172.21.15.145:0/2039894472 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d440990 2024-09-10T04:50:49.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d543aa0 con 0x55a15d540590 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88f9037640 1 -- 172.21.15.145:0/2039894472 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d540590 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a15d545c20 0x55a15d548010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d548550 con 0x55a15d545c20 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a15d545c20 0x55a15d548010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.752+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a15d545c20 0x55a15d548010 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.753+0000 7f88f3fff640 1 -- 172.21.15.145:0/2039894472 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d545c20 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.753+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.753+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.753+0000 7f88fb546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.753+0000 7f88fb546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a15d337a00 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38168/0 (socket says 172.21.15.145:38168) 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88f9037640 1 -- 172.21.15.145:0/1005638725 learned_addr learned my addr 172.21.15.145:0/1005638725 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88f9037640 1 -- 172.21.15.145:0/1005638725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d556ae0 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88f9037640 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f88ec051f20 tx=0x7f88ec04b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f87deffd640 1 -- 172.21.15.145:0/1005638725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec022780 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f87deffd640 1 -- 172.21.15.145:0/1005638725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec022920 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f87deffd640 1 -- 172.21.15.145:0/1005638725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec022c40 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15d557310 con 0x55a15d556080 2024-09-10T04:50:49.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.754+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15d557310 con 0x55a15d556080 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.755+0000 7f87deffd640 1 -- 172.21.15.145:0/1005638725 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f88ec00d5f0 con 0x55a15d556080 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.755+0000 7f87deffd640 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 0x7f87d003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.755+0000 7f87deffd640 1 -- 172.21.15.145:0/1005638725 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f88ec03cb00 con 0x55a15d556080 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.755+0000 7f88f3fff640 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 0x7f87d003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88f3fff640 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 0x7f87d003ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55a15d53c5c0 tx=0x7f88e4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88fb546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88fb546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a15d52fdd0 con 0x55a15d562740 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38178/0 (socket says 172.21.15.145:38178) 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88f9037640 1 -- 172.21.15.145:0/4278986221 learned_addr learned my addr 172.21.15.145:0/4278986221 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.756+0000 7f88f9037640 1 -- 172.21.15.145:0/4278986221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d563130 con 0x55a15d562740 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88f9037640 1 --2- 172.21.15.145:0/4278986221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f88ec016b90 tx=0x7f88ec037970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6af2c2ef27bd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f87dcff9640 1 -- 172.21.15.145:0/4278986221 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec053300 con 0x55a15d562740 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f87dcff9640 1 -- 172.21.15.145:0/4278986221 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec05c070 con 0x55a15d562740 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f87dcff9640 1 -- 172.21.15.145:0/4278986221 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec04c040 con 0x55a15d562740 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 -- 172.21.15.145:0/4278986221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 msgr2=0x55a15d562b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 --2- 172.21.15.145:0/4278986221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f88ec016b90 tx=0x7f88ec037970 comp rx=0 tx=0).stop 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 -- 172.21.15.145:0/4278986221 shutdown_connections 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 --2- 172.21.15.145:0/4278986221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d562b40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 -- 172.21.15.145:0/4278986221 >> 172.21.15.145:0/4278986221 conn(0x55a15d55eb40 msgr2=0x55a15d55cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 -- 172.21.15.145:0/4278986221 shutdown_connections 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.757+0000 7f88fb546800 1 -- 172.21.15.145:0/4278986221 wait complete. 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88fb546800 1 Processor -- start 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88fb546800 1 -- start start 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88fb546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88fb546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a15d5635a0 con 0x55a15d562740 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88f9037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38190/0 (socket says 172.21.15.145:38190) 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 learned_addr learned my addr 172.21.15.145:0/2404212724 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.758+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15d56a0c0 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f88f9037640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f88ec016b90 tx=0x7f88ec045f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f87ceffd640 1 -- 172.21.15.145:0/2404212724 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec037a40 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f87ceffd640 1 -- 172.21.15.145:0/2404212724 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec037be0 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15d56a0c0 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f87ceffd640 1 -- 172.21.15.145:0/2404212724 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88ec00d8e0 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.759+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15d56a0c0 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f87ceffd640 1 -- 172.21.15.145:0/2404212724 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f88ec06e020 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f87ceffd640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87c403c730 0x7f87c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f87ceffd640 1 -- 172.21.15.145:0/2404212724 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f88ec071d70 con 0x55a15d562740 2024-09-10T04:50:49.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87c403c730 0x7f87c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d574f50 0x55a15d577410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d577b60 con 0x55a15d574f50 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.760+0000 7f88f9838640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d574f50 0x55a15d577410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87c403c730 0x7f87c403ebf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88e40539f0 tx=0x7f88e4053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88f9838640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d574f50 0x55a15d577410 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 20 realm 2024-09-10T04:50:49.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d574280 con 0x55a15d574f50 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.761+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5785f0 con 0x55a15d574f50 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d5793d0 0x55a15d57b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57bdf0 con 0x55a15d5793d0 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88f9037640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d5793d0 0x55a15d57b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.762+0000 7f88f9037640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d5793d0 0x55a15d57b7c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57c690 con 0x55a15d574f50 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 20 searching for the correct realm 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a15d57e400 0x55a15d580830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a15d57e400 0x55a15d580830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.763+0000 7f88f3fff640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a15d57e400 0x55a15d580830 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f9037640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f88ec017050 0x7f88ec065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.764+0000 7f88f9838640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f88ec017050 0x7f88ec065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f88ec017050 0x7f88ec065130 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88f400a4d0 con 0x7f88ec017050 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.765+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.766+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f400a4d0 con 0x55a15d574f50 2024-09-10T04:50:49.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.767+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.768+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.769+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.770+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d574f50 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x7f88ec017050 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f4030040 con 0x7f88ec017050 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.771+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d57e400 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.772+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a15d580f00 con 0x55a15d5793d0 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57d040 con 0x55a15d574f50 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f4030040 con 0x55a15d574f50 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.773+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57d4c0 con 0x55a15d5793d0 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57d8e0 con 0x7f88ec017050 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:49.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 zone default found 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 4 Realm: () 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 zonegroup default 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d57d8e0 con 0x7f88ec017050 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582dc0 con 0x55a15d57e400 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.774+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d583160 con 0x55a15d57e400 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 20 started sync module instance, tier type = 2024-09-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.775+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582260 con 0x55a15d5793d0 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.776+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.776+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151544153952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582260 con 0x55a15d5793d0 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.776+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d583c00 con 0x55a15d574f50 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.778+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151544153952] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.778+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.778+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151544157936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582260 con 0x55a15d574f50 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.778+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5846c0 con 0x55a15d5793d0 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.779+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151544157936] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.779+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.779+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151544160656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582260 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.779+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d585190 con 0x7f88ec017050 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.780+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.780+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151544163456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d585150 con 0x7f88ec017050 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.780+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d586150 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.780+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151544160656] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.781+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151544163456] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.781+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.781+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151544165760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d586150 con 0x55a15d5793d0 2024-09-10T04:50:49.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.781+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5869f0 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.782+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.782+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151544169792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d586150 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.782+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d587920 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.783+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151544165760] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.783+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151544169792] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.784+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.784+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151544173584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d587d10 con 0x55a15d57e400 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.784+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5885c0 con 0x7f88ec017050 2024-09-10T04:50:49.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.785+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151544173584] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151544167552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5881c0 con 0x7f88ec017050 2024-09-10T04:50:49.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=0 2024-09-10T04:50:49.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=1 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=2 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=3 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=4 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=5 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.788+0000 7f88fb546800 20 add_watcher() i=6 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.790+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151544167552] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.790+0000 7f88fb546800 20 add_watcher() i=7 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.790+0000 7f88fb546800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.791+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d58b9e0 con 0x55a15d574f50 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.791+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.791+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151544176352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d588f20 con 0x55a15d574f50 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.792+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151544176352] v34'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.793+0000 7f87af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.793+0000 7f88fb546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.793+0000 7f88fb546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.793+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d593ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.794+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'48 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.794+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d593ed0 con 0x7f88ec017050 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.795+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.795+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d594510 con 0x55a15d57e400 2024-09-10T04:50:49.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.796+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.796+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d594a80 con 0x55a15d574f50 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.797+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'159 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.797+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d594f30 con 0x55a15d5793d0 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.799+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'50 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.799+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d594f30 con 0x55a15d57e400 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.800+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.800+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5954a0 con 0x55a15d5793d0 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.801+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.801+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5954a0 con 0x55a15d574f50 2024-09-10T04:50:49.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.802+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'36 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.802+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595950 con 0x55a15d5793d0 2024-09-10T04:50:49.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.803+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.803+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595950 con 0x55a15d5793d0 2024-09-10T04:50:49.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.805+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.805+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595950 con 0x55a15d5793d0 2024-09-10T04:50:49.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.806+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'51 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.806+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595950 con 0x55a15d57e400 2024-09-10T04:50:49.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.807+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.807+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595d50 con 0x55a15d5793d0 2024-09-10T04:50:49.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.808+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.808+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d595ca0 con 0x55a15d574f50 2024-09-10T04:50:49.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.809+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.809+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d596250 con 0x55a15d574f50 2024-09-10T04:50:49.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.811+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'160 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.811+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961f0 con 0x55a15d5793d0 2024-09-10T04:50:49.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.812+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.812+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d596190 con 0x55a15d5793d0 2024-09-10T04:50:49.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.813+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.813+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d57e400 2024-09-10T04:50:49.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.814+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.814+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d5793d0 2024-09-10T04:50:49.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.816+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.816+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d574f50 2024-09-10T04:50:49.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.817+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'161 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.817+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d5793d0 2024-09-10T04:50:49.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.818+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.819+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d5793d0 2024-09-10T04:50:49.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.820+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.820+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5960d0 con 0x55a15d57e400 2024-09-10T04:50:49.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.822+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.822+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d5793d0 2024-09-10T04:50:49.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.823+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.823+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d57e400 2024-09-10T04:50:49.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.825+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.825+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d57e400 2024-09-10T04:50:49.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.826+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.826+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d57e400 2024-09-10T04:50:49.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.827+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.827+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d5793d0 2024-09-10T04:50:49.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.828+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.828+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d574f50 2024-09-10T04:50:49.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.829+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'37 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.830+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d5793d0 2024-09-10T04:50:49.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.831+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.831+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x55a15d574f50 2024-09-10T04:50:49.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.832+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'49 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.832+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5961a0 con 0x7f88ec017050 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f87ae7e4640 20 reqs_thread_entry: start 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f88fb546800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f88fb546800 20 Filter name: none 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f871ffff640 20 reqs_thread_entry: start 2024-09-10T04:50:49.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.833+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.834+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.834+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.834+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv17 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.834+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.835+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.835+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.835+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.835+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.835+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x7f88ec017050 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.836+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv19 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.837+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.838+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.839+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.840+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv14 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.841+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.842+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.843+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.843+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.843+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.843+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.844+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.845+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.846+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.847+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f4041040 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.848+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.849+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.849+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.849+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.849+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 58 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.850+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.851+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 59 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.851+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.851+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.851+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 60 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.852+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 61 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 62 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.853+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.854+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.854+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.854+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.854+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.854+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 63 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 64 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 65 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 66 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.855+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 67 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 68 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.856+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 69 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 70 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.857+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 71 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.858+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.859+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.860+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.860+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.860+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.860+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 72 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 73 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 74 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.861+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c0ec0 con 0x55a15d574f50 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c1ed0 con 0x55a15d574f50 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(180 gc.28 [call out=1701b] v0'0 uv35 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.862+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25f0 con 0x55a15d5793d0 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 75 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c15a0 con 0x55a15d5793d0 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 76 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25b0 con 0x55a15d5793d0 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 77 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25b0 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.863+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c15a0 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25b0 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25b0 con 0x7f88ec017050 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x7f88ec017050 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.864+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c15a0 con 0x7f88ec017050 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.865+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f404d040 con 0x7f88ec017050 2024-09-10T04:50:49.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.865+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a15d5c25b0 con 0x7f88ec017050 2024-09-10T04:50:49.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.865+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f404d040 con 0x7f88ec017050 2024-09-10T04:50:49.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.866+0000 7f87af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:49.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.866+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151544176352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d591da0 con 0x55a15d574f50 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.867+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94151544176352] v34'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.867+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151544153952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d587eb0 con 0x55a15d5793d0 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.868+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 78 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94151544153952] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.868+0000 7f88fb546800 20 remove_watcher() i=0 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.868+0000 7f88fb546800 2 removed watcher, disabling cache 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.868+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151544157936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x55a15d574f50 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.869+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.1 v2:172.21.15.145:6808/819540050 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94151544157936] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f404d040 con 0x55a15d574f50 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.869+0000 7f88fb546800 20 remove_watcher() i=1 2024-09-10T04:50:49.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.869+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151544160656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x55a15d5793d0 2024-09-10T04:50:49.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.870+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 79 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94151544160656] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.870+0000 7f88fb546800 20 remove_watcher() i=2 2024-09-10T04:50:49.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.870+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151544163456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x7f88ec017050 2024-09-10T04:50:49.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.871+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94151544163456] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f404d040 con 0x7f88ec017050 2024-09-10T04:50:49.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.871+0000 7f88fb546800 20 remove_watcher() i=3 2024-09-10T04:50:49.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.871+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151544165760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x55a15d5793d0 2024-09-10T04:50:49.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.874+0000 7f88f9037640 1 -- 172.21.15.145:0/2404212724 <== osd.0 v2:172.21.15.98:6800/733739603 80 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94151544165760] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88ec0187b0 con 0x55a15d5793d0 2024-09-10T04:50:49.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.874+0000 7f88fb546800 20 remove_watcher() i=4 2024-09-10T04:50:49.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.874+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151544169792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x55a15d57e400 2024-09-10T04:50:49.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.875+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94151544169792] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.875+0000 7f88fb546800 20 remove_watcher() i=5 2024-09-10T04:50:49.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.875+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151544173584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d582760 con 0x55a15d57e400 2024-09-10T04:50:49.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.876+0000 7f88f3fff640 1 -- 172.21.15.145:0/2404212724 <== osd.3 v2:172.21.15.145:6800/4228232102 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94151544173584] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e4051070 con 0x55a15d57e400 2024-09-10T04:50:49.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.876+0000 7f88fb546800 20 remove_watcher() i=6 2024-09-10T04:50:49.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.876+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151544167552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a15d587410 con 0x7f88ec017050 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.877+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94151544167552] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f404d040 con 0x7f88ec017050 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.877+0000 7f88fb546800 20 remove_watcher() i=7 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.877+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d5793d0 msgr2=0x55a15d57b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.877+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d5793d0 0x55a15d57b7c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d574f50 msgr2=0x55a15d577410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d574f50 0x55a15d577410 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f88ec017050 msgr2=0x7f88ec065130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f88ec017050 0x7f88ec065130 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a15d57e400 msgr2=0x55a15d580830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a15d57e400 0x55a15d580830 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87c403c730 msgr2=0x7f87c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87c403c730 0x7f87c403ebf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88e40539f0 tx=0x7f88e4053000 comp rx=0 tx=0).stop 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 msgr2=0x55a15d569b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88f9838640 1 -- 172.21.15.145:0/2404212724 reap_dead start 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f88ec016b90 tx=0x7f88ec045f90 comp rx=0 tx=0).stop 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 shutdown_connections 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/2404212724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d562740 0x55a15d569b60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 >> 172.21.15.145:0/2404212724 conn(0x55a15d55eb40 msgr2=0x55a15d55cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 shutdown_connections 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/2404212724 wait complete. 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 msgr2=0x7f87d003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 0x7f87d003ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55a15d53c5c0 tx=0x7f88e4005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 msgr2=0x55a15d5564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f88ec051f20 tx=0x7f88ec04b160 comp rx=0 tx=0).stop 2024-09-10T04:50:49.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 shutdown_connections 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87d003c780 0x7f87d003ec40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 --2- 172.21.15.145:0/1005638725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d556080 0x55a15d5564a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 >> 172.21.15.145:0/1005638725 conn(0x55a15d54a430 msgr2=0x55a15d54a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 shutdown_connections 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.878+0000 7f88fb546800 1 -- 172.21.15.145:0/1005638725 wait complete. 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d540590 msgr2=0x55a15d542980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a15d540590 0x55a15d542980 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d440990 msgr2=0x55a15d53f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a15d440990 0x55a15d53f1a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a15d545c20 msgr2=0x55a15d548010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a15d545c20 0x55a15d548010 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87e003c780 msgr2=0x7f87e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f87e003c780 0x7f87e003ec40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88e4057000 tx=0x7f88e4052000 comp rx=0 tx=0).stop 2024-09-10T04:50:49.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 msgr2=0x55a15d43f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 --2- 172.21.15.145:0/2039894472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a15d440440 0x55a15d43f5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a15d530510 tx=0x7f88ec000bc0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88f9838640 1 -- 172.21.15.145:0/2039894472 reap_dead start 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 shutdown_connections 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 >> 172.21.15.145:0/2039894472 conn(0x55a15d43a920 msgr2=0x55a15d530860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 shutdown_connections 2024-09-10T04:50:49.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.879+0000 7f88fb546800 1 -- 172.21.15.145:0/2039894472 wait complete. 2024-09-10T04:50:49.888 INFO:teuthology.orchestra.run.smithi145.stdout:[{"tag":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1580503830620400483\u0000","time":"2024-09-10T04:50:49.667664+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_7","key":"","instance":""}]}] 2024-09-10T04:50:49.889 DEBUG:tasks.util.rgw: json result: [{'tag': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1580503830620400483\x00', 'time': '2024-09-10T04:50:49.667664+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_7', 'key': '', 'instance': ''}]}] 2024-09-10T04:50:49.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-10T04:50:49.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-10T04:50:49.889 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-10T04:50:49.932 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:49.932 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:49.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.931+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.931+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.931+0000 7f99560bb800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55639ca661e0 0x55639ca6bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.931+0000 7f99560bb800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55639c90fe40 con 0x55639ca64dd0 2024-09-10T04:50:49.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.931+0000 7f99560bb800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55639c8da680 con 0x55639ca661e0 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f994b3a4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55639ca661e0 0x55639ca6bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f9953ba5640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55639ca64dd0 0x55639ca65ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51922/0 (socket says 172.21.15.145:51922) 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f9953ba5640 1 -- 172.21.15.145:0/1104700080 learned_addr learned my addr 172.21.15.145:0/1104700080 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f99533a4640 1 -- 172.21.15.145:0/1104700080 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326404886 0 0) 0x55639c90fe40 con 0x55639ca64dd0 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f99533a4640 1 -- 172.21.15.145:0/1104700080 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940001e10 con 0x55639ca64dd0 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f994b3a4640 1 -- 172.21.15.145:0/1104700080 >> v1:172.21.15.98:6789/0 conn(0x55639ca64dd0 legacy=0x55639ca65ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.932+0000 7f994b3a4640 1 -- 172.21.15.145:0/1104700080 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639c8f66b0 con 0x55639ca661e0 2024-09-10T04:50:49.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.934+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1104700080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639ca6bd80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32078ea5542ea2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.934+0000 7f99533a4640 1 -- 172.21.15.145:0/1104700080 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c059070 con 0x55639ca661e0 2024-09-10T04:50:49.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.934+0000 7f99533a4640 1 -- 172.21.15.145:0/1104700080 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c054570 con 0x55639ca661e0 2024-09-10T04:50:49.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.934+0000 7f99533a4640 1 -- 172.21.15.145:0/1104700080 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c054870 con 0x55639ca661e0 2024-09-10T04:50:49.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 -- 172.21.15.145:0/1104700080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 msgr2=0x55639ca6bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 --2- 172.21.15.145:0/1104700080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639ca6bd80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c045920 comp rx=0 tx=0).stop 2024-09-10T04:50:49.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 -- 172.21.15.145:0/1104700080 shutdown_connections 2024-09-10T04:50:49.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 --2- 172.21.15.145:0/1104700080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639ca6bd80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 -- 172.21.15.145:0/1104700080 >> 172.21.15.145:0/1104700080 conn(0x55639ca601a0 msgr2=0x55639ca62600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 -- 172.21.15.145:0/1104700080 shutdown_connections 2024-09-10T04:50:49.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.935+0000 7f99560bb800 1 -- 172.21.15.145:0/1104700080 wait complete. 2024-09-10T04:50:49.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.948+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.948+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f99560bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f99560bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55639c8fedd0 con 0x55639ca64dd0 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38200/0 (socket says 172.21.15.145:38200) 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9953ba5640 1 -- 172.21.15.145:0/116844143 learned_addr learned my addr 172.21.15.145:0/116844143 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9953ba5640 1 -- 172.21.15.145:0/116844143 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639c917e10 con 0x55639ca64dd0 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9953ba5640 1 --2- 172.21.15.145:0/116844143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9944001e30 tx=0x7f994400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a93048609dc9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.949+0000 7f9841e0b640 1 -- 172.21.15.145:0/116844143 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944012020 con 0x55639ca64dd0 2024-09-10T04:50:49.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f9841e0b640 1 -- 172.21.15.145:0/116844143 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994400e470 con 0x55639ca64dd0 2024-09-10T04:50:49.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f9841e0b640 1 -- 172.21.15.145:0/116844143 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994400e790 con 0x55639ca64dd0 2024-09-10T04:50:49.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 -- 172.21.15.145:0/116844143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 msgr2=0x55639cb543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 --2- 172.21.15.145:0/116844143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9944001e30 tx=0x7f994400b780 comp rx=0 tx=0).stop 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 -- 172.21.15.145:0/116844143 shutdown_connections 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 --2- 172.21.15.145:0/116844143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca64dd0 0x55639cb543a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 -- 172.21.15.145:0/116844143 >> 172.21.15.145:0/116844143 conn(0x55639ca601a0 msgr2=0x55639cb4fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 -- 172.21.15.145:0/116844143 shutdown_connections 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.950+0000 7f99560bb800 1 -- 172.21.15.145:0/116844143 wait complete. 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f99560bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639cb5bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f99560bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55639ca668d0 con 0x55639ca661e0 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639cb5bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639cb5bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38214/0 (socket says 172.21.15.145:38214) 2024-09-10T04:50:49.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f9953ba5640 1 -- 172.21.15.145:0/3801596473 learned_addr learned my addr 172.21.15.145:0/3801596473 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f9953ba5640 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639cb5c430 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.951+0000 7f9953ba5640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639cb5bed0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55639cb55330 tx=0x7f99440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.952+0000 7f983bfff640 1 -- 172.21.15.145:0/3801596473 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944012030 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.952+0000 7f983bfff640 1 -- 172.21.15.145:0/3801596473 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994401c2e0 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.952+0000 7f983bfff640 1 -- 172.21.15.145:0/3801596473 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994400e8d0 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.952+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55639cb5c6c0 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.952+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639cb5d0c0 con 0x55639ca661e0 2024-09-10T04:50:49.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f983bfff640 1 -- 172.21.15.145:0/3801596473 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9944015020 con 0x55639ca661e0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f983bfff640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f983c03c780 0x7f983c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f983bfff640 1 -- 172.21.15.145:0/3801596473 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f9944022070 con 0x55639ca661e0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f994b3a4640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f983c03c780 0x7f983c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb600c0 0x55639cb624b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb629f0 con 0x55639cb600c0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f99543a6640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb600c0 0x55639cb624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f994b3a4640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f983c03c780 0x7f983c03ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55639ca64510 tx=0x7f993c050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.953+0000 7f99543a6640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb600c0 0x55639cb624b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.954+0000 7f99543a6640 1 -- 172.21.15.145:0/3801596473 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb600c0 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.954+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cb63780 0x55639cb65b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.954+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb661b0 con 0x55639cb63780 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.954+0000 7f9953ba5640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cb63780 0x55639cb65b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.954+0000 7f9953ba5640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cb63780 0x55639cb65b70 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f9953ba5640 1 -- 172.21.15.145:0/3801596473 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f994401ab60 con 0x55639cb63780 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb67a60 con 0x55639cb600c0 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f99543a6640 1 -- 172.21.15.145:0/3801596473 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb600c0 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb66c90 con 0x55639cb63780 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f9953ba5640 1 -- 172.21.15.145:0/3801596473 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f994401ab60 con 0x55639cb63780 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55639cb68e10 0x55639cb6b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb6b740 con 0x55639cb68e10 2024-09-10T04:50:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.955+0000 7f994b3a4640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55639cb68e10 0x55639cb6b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f994b3a4640 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55639cb68e10 0x55639cb6b200 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f994b3a4640 1 -- 172.21.15.145:0/3801596473 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f993c061430 con 0x55639cb68e10 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f99560bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.956+0000 7f99560bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55639c95ca00 con 0x55639cb792c0 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38220/0 (socket says 172.21.15.145:38220) 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f9953ba5640 1 -- 172.21.15.145:0/1751523203 learned_addr learned my addr 172.21.15.145:0/1751523203 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f9953ba5640 1 -- 172.21.15.145:0/1751523203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639cb79d20 con 0x55639cb792c0 2024-09-10T04:50:49.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f9953ba5640 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9944054160 tx=0x7f994400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f98397fa640 1 -- 172.21.15.145:0/1751523203 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944033070 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f98397fa640 1 -- 172.21.15.145:0/1751523203 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9944016570 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55639cb7a550 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f98397fa640 1 -- 172.21.15.145:0/1751523203 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944016870 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.957+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639cb7aaf0 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.958+0000 7f98397fa640 1 -- 172.21.15.145:0/1751523203 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9944043040 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.958+0000 7f98397fa640 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.958+0000 7f98397fa640 1 -- 172.21.15.145:0/1751523203 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f9944038d60 con 0x55639cb792c0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.958+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 0x7f982c03ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55639cb5d380 tx=0x7f993c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f99560bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f99560bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55639cb54bf0 con 0x55639cb8a030 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38236/0 (socket says 172.21.15.145:38236) 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f9953ba5640 1 -- 172.21.15.145:0/569479287 learned_addr learned my addr 172.21.15.145:0/569479287 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f9953ba5640 1 -- 172.21.15.145:0/569479287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639cb8aa00 con 0x55639cb8a030 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.959+0000 7f9953ba5640 1 --2- 172.21.15.145:0/569479287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9944016a90 tx=0x7f9944026bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4914785a99b5735 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f9832ffd640 1 -- 172.21.15.145:0/569479287 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944026cf0 con 0x55639cb8a030 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f9832ffd640 1 -- 172.21.15.145:0/569479287 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994405e030 con 0x55639cb8a030 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f9832ffd640 1 -- 172.21.15.145:0/569479287 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99440530f0 con 0x55639cb8a030 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- 172.21.15.145:0/569479287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 msgr2=0x55639cb8a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 --2- 172.21.15.145:0/569479287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9944016a90 tx=0x7f9944026bb0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- 172.21.15.145:0/569479287 shutdown_connections 2024-09-10T04:50:49.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 --2- 172.21.15.145:0/569479287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb8a410 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- 172.21.15.145:0/569479287 >> 172.21.15.145:0/569479287 conn(0x55639cb82020 msgr2=0x55639cb80260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- 172.21.15.145:0/569479287 shutdown_connections 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- 172.21.15.145:0/569479287 wait complete. 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 Processor -- start 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.960+0000 7f99560bb800 1 -- start start 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f99560bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f99560bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55639cb8ae90 con 0x55639cb8a030 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f9953ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38238/0 (socket says 172.21.15.145:38238) 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 learned_addr learned my addr 172.21.15.145:0/1772477713 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639cb919a0 con 0x55639cb8a030 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f9953ba5640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9944052fd0 tx=0x7f9944044f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f98317fa640 1 -- 172.21.15.145:0/1772477713 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944073070 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f98317fa640 1 -- 172.21.15.145:0/1772477713 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440475c0 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55639cb919a0 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f98317fa640 1 -- 172.21.15.145:0/1772477713 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944026cf0 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.961+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639cb919a0 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.962+0000 7f98317fa640 1 -- 172.21.15.145:0/1772477713 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9944076070 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.962+0000 7f98317fa640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981c03c730 0x7f981c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.962+0000 7f98317fa640 1 -- 172.21.15.145:0/1772477713 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f994406b070 con 0x55639cb8a030 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.962+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981c03c730 0x7f981c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981c03c730 0x7f981c03ebf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb9c940 0x55639cb9ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb9f550 con 0x55639cb9c940 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f99543a6640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb9c940 0x55639cb9ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.963+0000 7f99543a6640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb9c940 0x55639cb9ee00 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 realm 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb9bc70 con 0x55639cb9c940 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cb9ffe0 con 0x55639cb9c940 2024-09-10T04:50:49.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cba0dc0 0x55639cba31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba3810 con 0x55639cba0dc0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.964+0000 7f9953ba5640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cba0dc0 0x55639cba31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f9953ba5640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cba0dc0 0x55639cba31b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba4060 con 0x55639cb9c940 2024-09-10T04:50:49.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 20 searching for the correct realm 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55639cba5dd0 0x55639cba81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.965+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55639cba5dd0 0x55639cba81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f994b3a4640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55639cba5dd0 0x55639cba81e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f9953ba5640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9944078060 0x7f9944037a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f99543a6640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9944078060 0x7f9944037a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:49.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.966+0000 7f99543a6640 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9944078060 0x7f9944037a50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f994c00a4d0 con 0x7f9944078060 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.967+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.968+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x55639cb9c940 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.969+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.970+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.971+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cb9c940 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.972+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c030040 con 0x7f9944078060 2024-09-10T04:50:49.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba5dd0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.973+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55639cba88b0 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:49.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba49e0 con 0x55639cb9c940 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c030040 con 0x55639cb9c940 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.974+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba5280 con 0x55639cba0dc0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba4620 con 0x7f9944078060 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 zone default found 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 4 Realm: () 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 zonegroup default 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cba8d90 con 0x7f9944078060 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbaac10 con 0x55639cba5dd0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 20 rados->read ofs=0 len=0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.975+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbab0d0 con 0x55639cba5dd0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.976+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.976+0000 7f99560bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.976+0000 7f99560bb800 20 started sync module instance, tier type = 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.976+0000 7f99560bb800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.976+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbaa060 con 0x55639cba0dc0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.977+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.977+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886319600768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbab9e0 con 0x55639cba0dc0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.977+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbac230 con 0x55639cb9c940 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.978+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886319600768] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.978+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.978+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886319605040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbabea0 con 0x55639cb9c940 2024-09-10T04:50:49.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.978+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbac9c0 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.979+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886319605040] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.979+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.979+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886319608976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbac980 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.979+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbad440 con 0x7f9944078060 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.980+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886319608976] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.980+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.980+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886319611728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbad440 con 0x7f9944078060 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.980+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbade90 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.981+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886319611728] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.981+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.982+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886319606096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbade50 con 0x55639cba0dc0 2024-09-10T04:50:49.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.982+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbae8a0 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.982+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.982+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886319606096] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.983+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886319614368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbaec90 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.983+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbaf650 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.983+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.984+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886319622720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbb0310 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.984+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbb0e00 con 0x7f9944078060 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.984+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886319614368] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886319626448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbb11f0 con 0x7f9944078060 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=0 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=1 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=2 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=3 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=4 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=5 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886319622720] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.985+0000 7f99560bb800 20 add_watcher() i=6 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886319626448] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99560bb800 20 add_watcher() i=7 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99560bb800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:49.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbafe60 con 0x55639cb9c940 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.986+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886319617008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbafe60 con 0x55639cb9c940 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.987+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886319617008] v34'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.987+0000 7f9809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.987+0000 7f99560bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.987+0000 7f99560bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.987+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbca70 con 0x55639cba0dc0 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.989+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'49 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.989+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbcba0 con 0x7f9944078060 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.989+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.990+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbd230 con 0x55639cba5dd0 2024-09-10T04:50:49.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.991+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.991+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbd6e0 con 0x55639cb9c940 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.992+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'164 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.992+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbdc50 con 0x55639cba0dc0 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.993+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'53 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.993+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbdc50 con 0x55639cba5dd0 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.994+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:49.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.994+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbe100 con 0x55639cba0dc0 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.995+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.995+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbe100 con 0x55639cb9c940 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.996+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'38 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.996+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbc0e0 con 0x55639cba0dc0 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.997+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:49.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.997+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbc0e0 con 0x55639cba0dc0 2024-09-10T04:50:50.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.998+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.998+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbbf10 con 0x55639cba0dc0 2024-09-10T04:50:50.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.999+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'54 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:49.999+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbbf10 con 0x55639cba5dd0 2024-09-10T04:50:50.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.000+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.000+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbbf10 con 0x55639cba0dc0 2024-09-10T04:50:50.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.001+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.001+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbbf10 con 0x55639cb9c940 2024-09-10T04:50:50.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.002+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.002+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee50 con 0x55639cb9c940 2024-09-10T04:50:50.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.003+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'165 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.004+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee30 con 0x55639cba0dc0 2024-09-10T04:50:50.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.005+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.005+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee30 con 0x55639cba0dc0 2024-09-10T04:50:50.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.006+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.006+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee30 con 0x55639cba5dd0 2024-09-10T04:50:50.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.007+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.007+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee30 con 0x55639cba0dc0 2024-09-10T04:50:50.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.008+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.008+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbee30 con 0x55639cb9c940 2024-09-10T04:50:50.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.009+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'166 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.009+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba0dc0 2024-09-10T04:50:50.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.010+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.010+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba0dc0 2024-09-10T04:50:50.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.011+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.011+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba5dd0 2024-09-10T04:50:50.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.012+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.012+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba0dc0 2024-09-10T04:50:50.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.013+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.013+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba5dd0 2024-09-10T04:50:50.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.014+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.015+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba5dd0 2024-09-10T04:50:50.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.015+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.015+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba5dd0 2024-09-10T04:50:50.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.016+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.016+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba0dc0 2024-09-10T04:50:50.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.018+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.018+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cb9c940 2024-09-10T04:50:50.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.019+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.019+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cba0dc0 2024-09-10T04:50:50.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.020+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.020+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x55639cb9c940 2024-09-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.021+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'51 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.021+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbbf110 con 0x7f9944078060 2024-09-10T04:50:50.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f9808fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f99560bb800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f99560bb800 20 Filter name: none 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f97827fc640 20 reqs_thread_entry: start 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-10T04:50:50.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.022+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.023+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(94 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.023+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:95 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(95 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:96 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(96 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:97 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(97 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(98 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.024+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.025+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(99 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.025+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-10T04:50:50.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.025+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.026+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(100 gc.0 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.026+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(101 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:102 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(102 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:103 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(103 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(104 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.027+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:105 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.028+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(105 gc.0 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.028+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-10T04:50:50.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.028+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:106 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.029+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(106 gc.1 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.029+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:107 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.029+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(107 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.029+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:108 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(108 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:109 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== osd_op_reply(109 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:110 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(110 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.030+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:111 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x7f9944078060 2024-09-10T04:50:50.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.031+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(111 gc.1 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c041040 con 0x7f9944078060 2024-09-10T04:50:50.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.031+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-10T04:50:50.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.031+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:112 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.032+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(112 gc.2 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.032+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:113 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(113 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:114 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(114 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:115 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(115 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:116 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(116 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.033+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.034+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:117 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.035+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(117 gc.2 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.035+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-10T04:50:50.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.035+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:118 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(118 gc.3 [call] v34'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:119 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(119 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:120 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(120 gc.3 [call out=24b] v0'0 uv167 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.036+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:121 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(121 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c041040 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:122 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(122 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.037+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:123 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.038+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(123 gc.3 [call] v34'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.038+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-10T04:50:50.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.038+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(124 gc.4 [call] v34'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:125 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(125 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:126 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(126 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.039+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:127 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(127 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:128 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(128 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.040+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:129 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.041+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(129 gc.4 [call] v34'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.041+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-10T04:50:50.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.041+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:130 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(130 gc.5 [call] v34'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:131 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(131 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:132 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(132 gc.5 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.042+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:133 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(133 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:134 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(134 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.043+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:135 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.044+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(135 gc.5 [call] v34'46 uv46 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.044+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-10T04:50:50.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.044+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:136 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.045+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(136 gc.6 [call] v34'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.045+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:137 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.045+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(137 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:138 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(138 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:139 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(139 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:140 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(140 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.046+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:141 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.048+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(141 gc.6 [call] v34'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.048+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-10T04:50:50.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.048+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:142 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(142 gc.7 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:143 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(143 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:144 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(144 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:145 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(145 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.049+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:146 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.050+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(146 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.050+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.050+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:147 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.051+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(147 gc.7 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.051+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-10T04:50:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.051+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:148 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.052+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(148 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.052+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.052+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(149 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.052+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.052+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:150 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(150 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:151 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(151 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:152 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(152 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.053+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:153 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.055+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(153 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.055+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-10T04:50:50.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.055+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:154 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(154 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:155 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 58 ==== osd_op_reply(155 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:156 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 59 ==== osd_op_reply(156 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.056+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:157 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 60 ==== osd_op_reply(157 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:158 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 61 ==== osd_op_reply(158 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.057+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:159 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.058+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 62 ==== osd_op_reply(159 gc.9 [call] v34'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.058+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-10T04:50:50.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.058+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:160 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.059+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 63 ==== osd_op_reply(160 gc.10 [call] v34'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.059+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:161 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.059+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 64 ==== osd_op_reply(161 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.059+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.059+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:162 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 65 ==== osd_op_reply(162 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:163 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 66 ==== osd_op_reply(163 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:164 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 67 ==== osd_op_reply(164 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.060+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:165 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.061+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 68 ==== osd_op_reply(165 gc.10 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.061+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.061+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:166 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(166 gc.11 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:167 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(167 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:168 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(168 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.062+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:169 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(169 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:170 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(170 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.063+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:171 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.064+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(171 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.064+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-10T04:50:50.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.064+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:172 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.065+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 69 ==== osd_op_reply(172 gc.12 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.065+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:173 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.065+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 70 ==== osd_op_reply(173 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.065+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.065+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:174 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 71 ==== osd_op_reply(174 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:175 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 72 ==== osd_op_reply(175 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:176 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 73 ==== osd_op_reply(176 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.066+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:177 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.067+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 74 ==== osd_op_reply(177 gc.12 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.067+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-10T04:50:50.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.067+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:178 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.068+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(178 gc.13 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.068+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:179 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.068+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(179 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.068+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.068+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:180 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(180 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:181 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(181 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:182 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(182 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.069+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:183 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.070+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(183 gc.13 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.070+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-10T04:50:50.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.070+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:184 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.071+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(184 gc.14 [call] v34'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.071+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:185 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.071+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(185 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.071+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.071+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:186 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(186 gc.14 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:187 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(187 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:188 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 48 ==== osd_op_reply(188 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.072+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:189 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.073+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 49 ==== osd_op_reply(189 gc.14 [call] v34'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.073+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.073+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:190 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.074+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 75 ==== osd_op_reply(190 gc.15 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.074+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:191 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.074+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 76 ==== osd_op_reply(191 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.074+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.074+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:192 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 77 ==== osd_op_reply(192 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:193 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 78 ==== osd_op_reply(193 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:194 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 79 ==== osd_op_reply(194 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.075+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:195 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.076+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 80 ==== osd_op_reply(195 gc.15 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.076+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-10T04:50:50.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.076+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:196 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 81 ==== osd_op_reply(196 gc.16 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:197 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 82 ==== osd_op_reply(197 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:198 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.077+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 83 ==== osd_op_reply(198 gc.16 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:199 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 84 ==== osd_op_reply(199 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:200 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 85 ==== osd_op_reply(200 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.078+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:201 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.079+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 86 ==== osd_op_reply(201 gc.16 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.079+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.079+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:202 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(202 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:203 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(203 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:204 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(204 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.080+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:205 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(205 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:206 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 44 ==== osd_op_reply(206 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.081+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:207 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.082+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 45 ==== osd_op_reply(207 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.082+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-10T04:50:50.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.082+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:208 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 87 ==== osd_op_reply(208 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:209 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 88 ==== osd_op_reply(209 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 89 ==== osd_op_reply(210 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.083+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 90 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 91 ==== osd_op_reply(212 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.084+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.085+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 92 ==== osd_op_reply(213 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.085+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.085+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:214 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.086+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 50 ==== osd_op_reply(214 gc.19 [call] v34'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.086+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:215 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.086+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 51 ==== osd_op_reply(215 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.086+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.086+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 52 ==== osd_op_reply(216 gc.19 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 53 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 54 ==== osd_op_reply(218 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.087+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.088+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 55 ==== osd_op_reply(219 gc.19 [call] v34'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.088+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-10T04:50:50.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.088+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:220 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.089+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 93 ==== osd_op_reply(220 gc.20 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.089+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:221 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.089+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 94 ==== osd_op_reply(221 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.089+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.089+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 95 ==== osd_op_reply(222 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 96 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 97 ==== osd_op_reply(224 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.090+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.091+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 98 ==== osd_op_reply(225 gc.20 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.091+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-10T04:50:50.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.091+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:226 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 99 ==== osd_op_reply(226 gc.21 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:227 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 100 ==== osd_op_reply(227 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.092+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 101 ==== osd_op_reply(228 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 102 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 103 ==== osd_op_reply(230 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.093+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.094+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 104 ==== osd_op_reply(231 gc.21 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.094+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.094+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:232 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.095+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 46 ==== osd_op_reply(232 gc.22 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.095+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:233 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.095+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 47 ==== osd_op_reply(233 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.095+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.095+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 48 ==== osd_op_reply(234 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 49 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 50 ==== osd_op_reply(236 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.096+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.097+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 51 ==== osd_op_reply(237 gc.22 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.097+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.097+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:238 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.098+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 105 ==== osd_op_reply(238 gc.23 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.098+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:239 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 106 ==== osd_op_reply(239 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 107 ==== osd_op_reply(240 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 108 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 109 ==== osd_op_reply(242 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.099+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.100+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 110 ==== osd_op_reply(243 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.100+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.100+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:244 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.101+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 52 ==== osd_op_reply(244 gc.24 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.101+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:245 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.101+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 53 ==== osd_op_reply(245 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.101+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.101+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 54 ==== osd_op_reply(246 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 55 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 56 ==== osd_op_reply(248 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.102+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.103+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 57 ==== osd_op_reply(249 gc.24 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.103+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-10T04:50:50.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.103+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:250 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.104+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 58 ==== osd_op_reply(250 gc.25 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.104+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:251 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 59 ==== osd_op_reply(251 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 60 ==== osd_op_reply(252 gc.25 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 61 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 62 ==== osd_op_reply(254 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.105+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.106+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 63 ==== osd_op_reply(255 gc.25 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.106+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.106+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:256 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.107+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 64 ==== osd_op_reply(256 gc.26 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.107+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:257 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.107+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 65 ==== osd_op_reply(257 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.107+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.107+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 66 ==== osd_op_reply(258 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 67 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 68 ==== osd_op_reply(260 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.108+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba5dd0 2024-09-10T04:50:50.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.109+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 69 ==== osd_op_reply(261 gc.26 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.109+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.109+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:262 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.110+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 111 ==== osd_op_reply(262 gc.27 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.110+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:263 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.110+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 112 ==== osd_op_reply(263 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.110+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.110+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 113 ==== osd_op_reply(264 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 114 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 115 ==== osd_op_reply(266 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.111+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cba0dc0 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.112+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 116 ==== osd_op_reply(267 gc.27 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.112+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-10T04:50:50.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.112+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:268 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 56 ==== osd_op_reply(268 gc.28 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:269 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 57 ==== osd_op_reply(269 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9f50 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 58 ==== osd_op_reply(270 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.113+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 59 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbeaf60 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 60 ==== osd_op_reply(272 gc.28 [call out=1701b] v0'0 uv42 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 20 garbage collection: RGWGC::process iterating over entry tag='df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1580503830620400483', time=2024-09-10T04:50:49.667664+0000, chain.objs.size()=7 2024-09-10T04:50:50.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_1 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:273 3.39s0 3:9ef28b32:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe9200 con 0x55639cba5dd0 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_2 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:274 3.39s0 3:9f8822d2:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbee0f0 con 0x55639cba5dd0 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_3 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:275 3.1as0 3:598f08bd:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf0c20 con 0x55639cba0dc0 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_4 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:276 3.2ds0 3:b4458302:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbee0f0 con 0x55639cba5dd0 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_5 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:277 3.25s0 3:a50fca24:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf5a00 con 0x55639cb9c940 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_6 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:278 3.18s0 3:1a05949b:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf8270 con 0x55639cba5dd0 2024-09-10T04:50:50.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_7 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.114+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:279 3.3fs0 3:ffd820a9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbfaae0 con 0x55639cba0dc0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.117+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 70 ==== osd_op_reply(276 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.117+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 71 ==== osd_op_reply(273 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_1 [call] v34'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.117+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 117 ==== osd_op_reply(275 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.118+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 118 ==== osd_op_reply(279 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.118+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 72 ==== osd_op_reply(278 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.121+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 73 ==== osd_op_reply(274 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_2 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.121+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 61 ==== osd_op_reply(277 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1__shadow_.DBKdzxc-ZtPW0aXs4U3HMS1uJ3nea4Q_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.121+0000 7f99560bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T04:50:50.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.121+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:280 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8c30 con 0x55639cb9c940 2024-09-10T04:50:50.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.124+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 62 ==== osd_op_reply(280 gc.28 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.124+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:281 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8c30 con 0x55639cb9c940 2024-09-10T04:50:50.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.127+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 63 ==== osd_op_reply(281 gc.28 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.127+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-10T04:50:50.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.127+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:282 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8c30 con 0x55639cba0dc0 2024-09-10T04:50:50.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.128+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 119 ==== osd_op_reply(282 gc.29 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.128+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:283 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8c30 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.128+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 120 ==== osd_op_reply(283 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.128+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.128+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:284 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbef4f0 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 121 ==== osd_op_reply(284 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:285 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8c30 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 122 ==== osd_op_reply(285 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:286 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf0500 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 123 ==== osd_op_reply(286 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.129+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:287 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf0500 con 0x55639cba0dc0 2024-09-10T04:50:50.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.130+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 124 ==== osd_op_reply(287 gc.29 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.130+0000 7f99560bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-10T04:50:50.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.130+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:288 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf04b0 con 0x55639cb9c940 2024-09-10T04:50:50.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.131+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 64 ==== osd_op_reply(288 gc.30 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.131+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:289 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf04b0 con 0x55639cb9c940 2024-09-10T04:50:50.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 65 ==== osd_op_reply(289 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:290 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbef4a0 con 0x55639cb9c940 2024-09-10T04:50:50.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 66 ==== osd_op_reply(290 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:291 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf04b0 con 0x55639cb9c940 2024-09-10T04:50:50.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 67 ==== osd_op_reply(291 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.132+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:292 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf04b0 con 0x55639cb9c940 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.133+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 68 ==== osd_op_reply(292 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.133+0000 7f99560bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.133+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbf04b0 con 0x55639cb9c940 2024-09-10T04:50:50.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.134+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 69 ==== osd_op_reply(293 gc.30 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.135+0000 7f9809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.135+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886319617008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbe8480 con 0x55639cb9c940 2024-09-10T04:50:50.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.136+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 70 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93886319617008] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.136+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886319600768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbae3f0 con 0x55639cba0dc0 2024-09-10T04:50:50.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.137+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 125 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93886319600768] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.137+0000 7f99560bb800 20 remove_watcher() i=0 2024-09-10T04:50:50.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.137+0000 7f99560bb800 2 removed watcher, disabling cache 2024-09-10T04:50:50.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.137+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886319605040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbae3f0 con 0x55639cb9c940 2024-09-10T04:50:50.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.138+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.1 v2:172.21.15.145:6808/819540050 71 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93886319605040] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x55639cb9c940 2024-09-10T04:50:50.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.138+0000 7f99560bb800 20 remove_watcher() i=1 2024-09-10T04:50:50.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.138+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886319608976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbab530 con 0x55639cba0dc0 2024-09-10T04:50:50.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.139+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 126 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93886319608976] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.139+0000 7f99560bb800 20 remove_watcher() i=2 2024-09-10T04:50:50.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.139+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886319611728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbac490 con 0x7f9944078060 2024-09-10T04:50:50.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.140+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93886319611728] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x7f9944078060 2024-09-10T04:50:50.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.140+0000 7f99560bb800 20 remove_watcher() i=3 2024-09-10T04:50:50.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.140+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886319606096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbab530 con 0x55639cba0dc0 2024-09-10T04:50:50.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.141+0000 7f9953ba5640 1 -- 172.21.15.145:0/1772477713 <== osd.0 v2:172.21.15.98:6800/733739603 127 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93886319606096] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9944075030 con 0x55639cba0dc0 2024-09-10T04:50:50.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.141+0000 7f99560bb800 20 remove_watcher() i=4 2024-09-10T04:50:50.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.141+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886319614368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbacf50 con 0x55639cba5dd0 2024-09-10T04:50:50.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.142+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 74 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93886319614368] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.142+0000 7f99560bb800 20 remove_watcher() i=5 2024-09-10T04:50:50.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.142+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886319622720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbac490 con 0x55639cba5dd0 2024-09-10T04:50:50.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.143+0000 7f994b3a4640 1 -- 172.21.15.145:0/1772477713 <== osd.3 v2:172.21.15.145:6800/4228232102 75 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93886319622720] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c075070 con 0x55639cba5dd0 2024-09-10T04:50:50.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.143+0000 7f99560bb800 20 remove_watcher() i=6 2024-09-10T04:50:50.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.143+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886319626448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55639cbad9a0 con 0x7f9944078060 2024-09-10T04:50:50.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93886319626448] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c04d040 con 0x7f9944078060 2024-09-10T04:50:50.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 20 remove_watcher() i=7 2024-09-10T04:50:50.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cba0dc0 msgr2=0x55639cba31b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cba0dc0 0x55639cba31b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb9c940 msgr2=0x55639cb9ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb9c940 0x55639cb9ee00 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9944078060 msgr2=0x7f9944037a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f9944078060 0x7f9944037a50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55639cba5dd0 msgr2=0x55639cba81e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55639cba5dd0 0x55639cba81e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981c03c730 msgr2=0x7f981c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981c03c730 0x7f981c03ebf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c051000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 msgr2=0x55639cb91440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99543a6640 1 -- 172.21.15.145:0/1772477713 reap_dead start 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9944052fd0 tx=0x7f9944044f20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 shutdown_connections 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 --2- 172.21.15.145:0/1772477713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb8a030 0x55639cb91440 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.144+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 >> 172.21.15.145:0/1772477713 conn(0x55639cb82020 msgr2=0x55639cb80230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 shutdown_connections 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1772477713 wait complete. 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 msgr2=0x7f982c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 0x7f982c03ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55639cb5d380 tx=0x7f993c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 msgr2=0x55639cb796e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9944054160 tx=0x7f994400d650 comp rx=0 tx=0).stop 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 shutdown_connections 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/1751523203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639cb792c0 0x55639cb796e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 >> 172.21.15.145:0/1751523203 conn(0x55639cb6d670 msgr2=0x55639cb6da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 shutdown_connections 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/1751523203 wait complete. 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cb63780 msgr2=0x55639cb65b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55639cb63780 0x55639cb65b70 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb600c0 msgr2=0x55639cb624b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55639cb600c0 0x55639cb624b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55639cb68e10 msgr2=0x55639cb6b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55639cb68e10 0x55639cb6b200 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f983c03c780 msgr2=0x7f983c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f983c03c780 0x7f983c03ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55639ca64510 tx=0x7f993c050000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 msgr2=0x55639cb5bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 --2- 172.21.15.145:0/3801596473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55639ca661e0 0x55639cb5bed0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55639cb55330 tx=0x7f99440040e0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99543a6640 1 -- 172.21.15.145:0/3801596473 reap_dead start 2024-09-10T04:50:50.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 shutdown_connections 2024-09-10T04:50:50.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.145+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 >> 172.21.15.145:0/3801596473 conn(0x55639ca601a0 msgr2=0x55639cb55700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.146+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 shutdown_connections 2024-09-10T04:50:50.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.146+0000 7f99560bb800 1 -- 172.21.15.145:0/3801596473 wait complete. 2024-09-10T04:50:50.155 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T04:50:50.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T04:50:50.156 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T04:50:50.239 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:50.240 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.239+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.239+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.239+0000 7f992c142800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c62d1ce690 0x55c62d1d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.239+0000 7f992c142800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c62d077e40 con 0x55c62d1d1020 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.239+0000 7f992c142800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55c62d042680 con 0x55c62d1ce690 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f9927e86640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c62d1ce690 0x55c62d1d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f991ffff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55c62d1d1020 0x55c62d1d34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51926/0 (socket says 172.21.15.145:51926) 2024-09-10T04:50:50.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f9927e86640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c62d1ce690 0x55c62d1d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38254/0 (socket says 172.21.15.145:38254) 2024-09-10T04:50:50.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f991ffff640 1 -- 172.21.15.145:0/4213150442 learned_addr learned my addr 172.21.15.145:0/4213150442 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:50.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f9927e86640 1 -- 172.21.15.145:0/4213150442 >> v1:172.21.15.98:6789/0 conn(0x55c62d1d1020 legacy=0x55c62d1d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f9927e86640 1 -- 172.21.15.145:0/4213150442 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d05e6b0 con 0x55c62d1ce690 2024-09-10T04:50:50.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.240+0000 7f9927685640 1 -- 172.21.15.145:0/4213150442 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851169776 0 0) 0x55c62d077e40 con 0x55c62d1d1020 2024-09-10T04:50:50.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.242+0000 7f9927e86640 1 --2- 172.21.15.145:0/4213150442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1d0a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e99ee131d532d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.242+0000 7f9927685640 1 -- 172.21.15.145:0/4213150442 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053570 con 0x55c62d1ce690 2024-09-10T04:50:50.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.242+0000 7f9927685640 1 -- 172.21.15.145:0/4213150442 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918058070 con 0x55c62d1ce690 2024-09-10T04:50:50.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.242+0000 7f9927685640 1 -- 172.21.15.145:0/4213150442 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053880 con 0x55c62d1ce690 2024-09-10T04:50:50.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.242+0000 7f992c142800 1 -- 172.21.15.145:0/4213150442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 msgr2=0x55c62d1d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 --2- 172.21.15.145:0/4213150442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1d0a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 -- 172.21.15.145:0/4213150442 shutdown_connections 2024-09-10T04:50:50.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 --2- 172.21.15.145:0/4213150442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1d0a80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 -- 172.21.15.145:0/4213150442 >> 172.21.15.145:0/4213150442 conn(0x55c62d1c81f0 msgr2=0x55c62d1ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 -- 172.21.15.145:0/4213150442 shutdown_connections 2024-09-10T04:50:50.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.243+0000 7f992c142800 1 -- 172.21.15.145:0/4213150442 wait complete. 2024-09-10T04:50:50.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.256+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.256+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.256+0000 7f992c142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.256+0000 7f992c142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c62d066dd0 con 0x55c62d1ce690 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38270/0 (socket says 172.21.15.145:38270) 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9927e86640 1 -- 172.21.15.145:0/2397220515 learned_addr learned my addr 172.21.15.145:0/2397220515 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9927e86640 1 -- 172.21.15.145:0/2397220515 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d07fe10 con 0x55c62d1ce690 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9927e86640 1 --2- 172.21.15.145:0/2397220515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac31992727caf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9815e0b640 1 -- 172.21.15.145:0/2397220515 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053570 con 0x55c62d1ce690 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9815e0b640 1 -- 172.21.15.145:0/2397220515 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918063030 con 0x55c62d1ce690 2024-09-10T04:50:50.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.257+0000 7f9815e0b640 1 -- 172.21.15.145:0/2397220515 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918053840 con 0x55c62d1ce690 2024-09-10T04:50:50.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 -- 172.21.15.145:0/2397220515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 msgr2=0x55c62d1cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 --2- 172.21.15.145:0/2397220515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918051000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 -- 172.21.15.145:0/2397220515 shutdown_connections 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 --2- 172.21.15.145:0/2397220515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d1cde20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 -- 172.21.15.145:0/2397220515 >> 172.21.15.145:0/2397220515 conn(0x55c62d1c81f0 msgr2=0x55c62d2b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 -- 172.21.15.145:0/2397220515 shutdown_connections 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 -- 172.21.15.145:0/2397220515 wait complete. 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.258+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f992c142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d2c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f992c142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c62d1d5040 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d2c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d2c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38286/0 (socket says 172.21.15.145:38286) 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f9927e86640 1 -- 172.21.15.145:0/3834517259 learned_addr learned my addr 172.21.15.145:0/3834517259 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f9927e86640 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d2c7480 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f9927e86640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d2c6f20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f980ffff640 1 -- 172.21.15.145:0/3834517259 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918078070 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f980ffff640 1 -- 172.21.15.145:0/3834517259 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918068420 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c62d2c7710 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.259+0000 7f980ffff640 1 -- 172.21.15.145:0/3834517259 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918068700 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.260+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62d2c8320 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f980ffff640 1 -- 172.21.15.145:0/3834517259 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f991807b070 con 0x55c62d1ce690 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f980ffff640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981003c730 0x7f981003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f980ffff640 1 -- 172.21.15.145:0/3834517259 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f99180979a0 con 0x55c62d1ce690 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f991ffff640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981003c730 0x7f981003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d1d1020 0x55c62d2ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d2ceab0 con 0x55c62d1d1020 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f9928687640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d1d1020 0x55c62d2ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.261+0000 7f991ffff640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981003c730 0x7f981003ebf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9910000c00 tx=0x7f99100013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f9928687640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d1d1020 0x55c62d2ce570 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f9928687640 1 -- 172.21.15.145:0/3834517259 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d1d1020 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d2cf360 0x55c62d2d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d2d1f90 con 0x55c62d2cf360 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f9927e86640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d2cf360 0x55c62d2d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.262+0000 7f9927e86640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d2cf360 0x55c62d2d1820 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f9927e86640 1 -- 172.21.15.145:0/3834517259 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f991807a030 con 0x55c62d2cf360 2024-09-10T04:50:50.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d2d3890 con 0x55c62d1d1020 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f9928687640 1 -- 172.21.15.145:0/3834517259 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d1d1020 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d2d29d0 con 0x55c62d2cf360 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f9927e86640 1 -- 172.21.15.145:0/3834517259 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f991807a030 con 0x55c62d2cf360 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c62d2d3440 0x55c62d2d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d2d73c0 con 0x55c62d2d3440 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.263+0000 7f991ffff640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c62d2d3440 0x55c62d2d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f991ffff640 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c62d2d3440 0x55c62d2d6c50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f991ffff640 1 -- 172.21.15.145:0/3834517259 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f991000f670 con 0x55c62d2d3440 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f992c142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.264+0000 7f992c142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c62d0c4a00 con 0x55c62d2e5030 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38292/0 (socket says 172.21.15.145:38292) 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f9927e86640 1 -- 172.21.15.145:0/1465216741 learned_addr learned my addr 172.21.15.145:0/1465216741 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f9927e86640 1 -- 172.21.15.145:0/1465216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d2e5a90 con 0x55c62d2e5030 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f9927e86640 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f99180059d0 tx=0x7f991807cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f980d7fa640 1 -- 172.21.15.145:0/1465216741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9918068d60 con 0x55c62d2e5030 2024-09-10T04:50:50.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f980d7fa640 1 -- 172.21.15.145:0/1465216741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991807c3b0 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c62d2e62c0 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f980d7fa640 1 -- 172.21.15.145:0/1465216741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f991807c6b0 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.265+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62d2e6860 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.266+0000 7f980d7fa640 1 -- 172.21.15.145:0/1465216741 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f991809e060 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.266+0000 7f980d7fa640 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 0x7f980003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.266+0000 7f980d7fa640 1 -- 172.21.15.145:0/1465216741 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f9918091070 con 0x55c62d2e5030 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.266+0000 7f991ffff640 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 0x7f980003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f991ffff640 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 0x7f980003ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55c62d2c8e60 tx=0x7f9910006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f992c142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f992c142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c62d1cc6c0 con 0x55c62d2f1930 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38306/0 (socket says 172.21.15.145:38306) 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f9927e86640 1 -- 172.21.15.145:0/718938280 learned_addr learned my addr 172.21.15.145:0/718938280 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f9927e86640 1 -- 172.21.15.145:0/718938280 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d2f2300 con 0x55c62d2f1930 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.267+0000 7f9927e86640 1 --2- 172.21.15.145:0/718938280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9918052790 tx=0x7f991808b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865a4c6c8b37f238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f9806ffd640 1 -- 172.21.15.145:0/718938280 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f991805edf0 con 0x55c62d2f1930 2024-09-10T04:50:50.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f9806ffd640 1 -- 172.21.15.145:0/718938280 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99180af070 con 0x55c62d2f1930 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f9806ffd640 1 -- 172.21.15.145:0/718938280 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f991808e1f0 con 0x55c62d2f1930 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- 172.21.15.145:0/718938280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 msgr2=0x55c62d2f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 --2- 172.21.15.145:0/718938280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9918052790 tx=0x7f991808b440 comp rx=0 tx=0).stop 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- 172.21.15.145:0/718938280 shutdown_connections 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 --2- 172.21.15.145:0/718938280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f1d10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- 172.21.15.145:0/718938280 >> 172.21.15.145:0/718938280 conn(0x55c62d2edd30 msgr2=0x55c62d2ebf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- 172.21.15.145:0/718938280 shutdown_connections 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- 172.21.15.145:0/718938280 wait complete. 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 Processor -- start 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- start start 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.268+0000 7f992c142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c62d2f2790 con 0x55c62d2f1930 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f9927e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38308/0 (socket says 172.21.15.145:38308) 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 learned_addr learned my addr 172.21.15.145:0/256127172 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62d2f92d0 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f9927e86640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f8d70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9918052790 tx=0x7f99180a2f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f98057fa640 1 -- 172.21.15.145:0/256127172 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99180c2070 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f98057fa640 1 -- 172.21.15.145:0/256127172 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991808b600 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c62d2f92d0 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f98057fa640 1 -- 172.21.15.145:0/256127172 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f991808b8e0 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.269+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62d2f92d0 con 0x55c62d2f1930 2024-09-10T04:50:50.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.270+0000 7f98057fa640 1 -- 172.21.15.145:0/256127172 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f99180c5070 con 0x55c62d2f1930 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.270+0000 7f98057fa640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f97f003c780 0x7f97f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.270+0000 7f98057fa640 1 -- 172.21.15.145:0/256127172 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f99180a6040 con 0x55c62d2f1930 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.270+0000 7f991ffff640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f97f003c780 0x7f97f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d3040e0 0x55c62d3065a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d306cf0 con 0x55c62d3040e0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f9928687640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d3040e0 0x55c62d3065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f991ffff640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f97f003c780 0x7f97f003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55c62d2d77c0 tx=0x7f9910023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f9928687640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d3040e0 0x55c62d3065a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 realm 2024-09-10T04:50:50.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d303460 con 0x55c62d3040e0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.271+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d307780 con 0x55c62d3040e0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d308560 0x55c62d30a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30af80 con 0x55c62d308560 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f9927e86640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d308560 0x55c62d30a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f9927e86640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d308560 0x55c62d30a950 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.272+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30b820 con 0x55c62d3040e0 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 20 searching for the correct realm 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c62d30d590 0x55c62d30f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f991ffff640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c62d30d590 0x55c62d30f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f991ffff640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c62d30d590 0x55c62d30f9c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.273+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9927e86640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f99180c7060 0x7f99180bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9928687640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f99180c7060 0x7f99180bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9928687640 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f99180c7060 0x7f99180bd9a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f992000a4d0 con 0x7f99180c7060 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.274+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.275+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992000a4d0 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.276+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.277+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.278+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d3040e0 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.279+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x7f99180c7060 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9920030040 con 0x7f99180c7060 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.280+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d30d590 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c62d310090 con 0x55c62d308560 2024-09-10T04:50:50.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.281+0000 7f992c142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30c1d0 con 0x55c62d3040e0 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9920030040 con 0x55c62d3040e0 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30c650 con 0x55c62d308560 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30ca70 con 0x7f99180c7060 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 zone default found 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 4 Realm: () 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 zonegroup default 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.282+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d30ca70 con 0x7f99180c7060 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d311f50 con 0x55c62d30d590 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3122f0 con 0x55c62d30d590 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 started sync module instance, tier type = 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.283+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3113f0 con 0x55c62d308560 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.284+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.284+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94309650077984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3113f0 con 0x55c62d308560 2024-09-10T04:50:50.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.285+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312dc0 con 0x55c62d3040e0 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.285+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94309650077984] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.286+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.286+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94309650081936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312d80 con 0x55c62d3040e0 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.286+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3138a0 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.287+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94309650081936] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.287+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.287+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94309650084720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d313860 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.287+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d314320 con 0x7f99180c7060 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.288+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.288+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94309650087472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d314320 con 0x7f99180c7060 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.288+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3152a0 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.288+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94309650084720] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.289+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94309650087472] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.289+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.289+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94309650091408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d315260 con 0x55c62d308560 2024-09-10T04:50:50.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.289+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d315b70 con 0x55c62d30d590 2024-09-10T04:50:50.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.290+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.290+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94309650093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d315260 con 0x55c62d30d590 2024-09-10T04:50:50.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.290+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d316a90 con 0x55c62d30d590 2024-09-10T04:50:50.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.290+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94309650091408] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.291+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94309650093760] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.291+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.291+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94309650097504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d316e80 con 0x55c62d30d590 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.291+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d317710 con 0x7f99180c7060 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94309650097504] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94309650075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d317330 con 0x7f99180c7060 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=0 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=1 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=2 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=3 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=4 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=5 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.292+0000 7f992c142800 20 add_watcher() i=6 2024-09-10T04:50:50.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.293+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94309650075456] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.293+0000 7f992c142800 20 add_watcher() i=7 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.293+0000 7f992c142800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.293+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d31ab60 con 0x55c62d3040e0 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.294+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.294+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94309650100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3180b0 con 0x55c62d3040e0 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.295+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94309650100304] v34'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.295+0000 7f97ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.295+0000 7f992c142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.295+0000 7f992c142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.295+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d31cec0 con 0x55c62d308560 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.296+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.296+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d31ce30 con 0x7f99180c7060 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.297+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.297+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d323660 con 0x55c62d30d590 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.298+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.298+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d323b10 con 0x55c62d3040e0 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.299+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'175 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.299+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d322b00 con 0x55c62d308560 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.300+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.300+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3230d0 con 0x55c62d30d590 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.301+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.301+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324670 con 0x55c62d308560 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.302+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.302+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324670 con 0x55c62d3040e0 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.303+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.303+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324670 con 0x55c62d308560 2024-09-10T04:50:50.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.305+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.305+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324670 con 0x55c62d308560 2024-09-10T04:50:50.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.305+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.305+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324670 con 0x55c62d308560 2024-09-10T04:50:50.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.306+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.306+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3246b0 con 0x55c62d30d590 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.307+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.307+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324d20 con 0x55c62d308560 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.309+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.309+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d324d20 con 0x55c62d3040e0 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.310+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.310+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251d0 con 0x55c62d3040e0 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.311+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'176 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.311+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251d0 con 0x55c62d308560 2024-09-10T04:50:50.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.312+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.312+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.313+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.313+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d30d590 2024-09-10T04:50:50.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.314+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.314+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.315+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.315+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d3040e0 2024-09-10T04:50:50.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.316+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'177 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.316+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.317+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.317+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.318+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.318+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d30d590 2024-09-10T04:50:50.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.319+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.319+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.320+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.320+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d30d590 2024-09-10T04:50:50.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.321+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.321+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d30d590 2024-09-10T04:50:50.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.322+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.322+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d30d590 2024-09-10T04:50:50.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.323+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.323+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.325+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.325+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d3040e0 2024-09-10T04:50:50.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.326+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.326+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d308560 2024-09-10T04:50:50.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.327+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.327+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x55c62d3040e0 2024-09-10T04:50:50.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.328+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.328+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3251b0 con 0x7f99180c7060 2024-09-10T04:50:50.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f97dcfe1640 20 reqs_thread_entry: start 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f992c142800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f992c142800 20 Filter name: none 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f97567fc640 20 reqs_thread_entry: start 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.329+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321fa0 con 0x55c62d308560 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.330+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x7f99180c7060 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.331+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.332+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.333+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv46 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.334+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.335+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.336+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.337+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.338+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.339+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.340+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9920041040 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.341+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.342+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 58 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.343+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 59 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.344+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 60 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 61 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 62 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.345+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.346+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 63 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 64 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 65 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 66 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.347+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 67 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 68 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.348+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 69 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.349+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 70 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 71 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.350+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.351+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9910037040 con 0x55c62d30d590 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d30d590 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f991004f040 con 0x55c62d30d590 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.352+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.353+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 72 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.353+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.353+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 73 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.353+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.353+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 74 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.354+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 75 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 76 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 77 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.355+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x7f99180c7060 2024-09-10T04:50:50.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.356+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.357+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f992004d040 con 0x7f99180c7060 2024-09-10T04:50:50.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.357+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f60 con 0x7f99180c7060 2024-09-10T04:50:50.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.357+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f992004d040 con 0x7f99180c7060 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.358+0000 7f97ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.358+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94309650100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d321f00 con 0x55c62d3040e0 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.359+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94309650100304] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.359+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94309650077984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d317020 con 0x55c62d308560 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.360+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 78 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94309650077984] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.360+0000 7f992c142800 20 remove_watcher() i=0 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.360+0000 7f992c142800 2 removed watcher, disabling cache 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.360+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94309650081936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d311920 con 0x55c62d3040e0 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.361+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.1 v2:172.21.15.145:6808/819540050 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94309650081936] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992004d040 con 0x55c62d3040e0 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.361+0000 7f992c142800 20 remove_watcher() i=1 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.361+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94309650084720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312890 con 0x55c62d308560 2024-09-10T04:50:50.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.362+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 79 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94309650084720] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.362+0000 7f992c142800 20 remove_watcher() i=2 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.362+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94309650087472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312890 con 0x7f99180c7060 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.363+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94309650087472] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992004d040 con 0x7f99180c7060 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.363+0000 7f992c142800 20 remove_watcher() i=3 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.363+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94309650091408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312890 con 0x55c62d308560 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.364+0000 7f9927e86640 1 -- 172.21.15.145:0/256127172 <== osd.0 v2:172.21.15.98:6800/733739603 80 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94309650091408] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99180c4030 con 0x55c62d308560 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.364+0000 7f992c142800 20 remove_watcher() i=4 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.364+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94309650093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312890 con 0x55c62d30d590 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.365+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94309650093760] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f991004f040 con 0x55c62d30d590 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.365+0000 7f992c142800 20 remove_watcher() i=5 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.365+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94309650097504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d3156c0 con 0x55c62d30d590 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.366+0000 7f991ffff640 1 -- 172.21.15.145:0/256127172 <== osd.3 v2:172.21.15.145:6800/4228232102 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94309650097504] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f991004f040 con 0x55c62d30d590 2024-09-10T04:50:50.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.366+0000 7f992c142800 20 remove_watcher() i=6 2024-09-10T04:50:50.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.366+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94309650075456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c62d312890 con 0x7f99180c7060 2024-09-10T04:50:50.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94309650075456] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992004d040 con 0x7f99180c7060 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 20 remove_watcher() i=7 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d308560 msgr2=0x55c62d30a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d308560 0x55c62d30a950 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d3040e0 msgr2=0x55c62d3065a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d3040e0 0x55c62d3065a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f99180c7060 msgr2=0x7f99180bd9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f99180c7060 0x7f99180bd9a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c62d30d590 msgr2=0x55c62d30f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c62d30d590 0x55c62d30f9c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f97f003c780 msgr2=0x7f97f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f97f003c780 0x7f97f003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55c62d2d77c0 tx=0x7f9910023040 comp rx=0 tx=0).stop 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 msgr2=0x55c62d2f8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f992c142800 1 --2- 172.21.15.145:0/256127172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2f1930 0x55c62d2f8d70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9918052790 tx=0x7f99180a2f20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 reap_dead start 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.367+0000 7f9928687640 1 -- 172.21.15.145:0/256127172 reap_dead start 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 shutdown_connections 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 >> 172.21.15.145:0/256127172 conn(0x55c62d2edd30 msgr2=0x55c62d2ebf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 shutdown_connections 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/256127172 wait complete. 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 msgr2=0x7f980003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 0x7f980003ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55c62d2c8e60 tx=0x7f9910006000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 msgr2=0x55c62d2e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f99180059d0 tx=0x7f991807cdb0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 shutdown_connections 2024-09-10T04:50:50.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f980003c780 0x7f980003ec40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/1465216741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d2e5030 0x55c62d2e5450 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 >> 172.21.15.145:0/1465216741 conn(0x55c62d2d93e0 msgr2=0x55c62d2d97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 shutdown_connections 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/1465216741 wait complete. 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d2cf360 msgr2=0x55c62d2d1820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c62d2cf360 0x55c62d2d1820 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d1d1020 msgr2=0x55c62d2ce570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c62d1d1020 0x55c62d2ce570 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c62d2d3440 msgr2=0x55c62d2d6c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c62d2d3440 0x55c62d2d6c50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981003c730 msgr2=0x7f981003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f981003c730 0x7f981003ebf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9910000c00 tx=0x7f99100013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 msgr2=0x55c62d2c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f992c142800 1 --2- 172.21.15.145:0/3834517259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c62d1ce690 0x55c62d2c6f20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f991800a470 tx=0x7f9918002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.368+0000 7f9928687640 1 -- 172.21.15.145:0/3834517259 reap_dead start 2024-09-10T04:50:50.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.369+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 shutdown_connections 2024-09-10T04:50:50.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.369+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 >> 172.21.15.145:0/3834517259 conn(0x55c62d1c81f0 msgr2=0x55c62d2b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.369+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 shutdown_connections 2024-09-10T04:50:50.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.369+0000 7f992c142800 1 -- 172.21.15.145:0/3834517259 wait complete. 2024-09-10T04:50:50.378 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-10T04:50:50.378 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T04:50:50.378 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:50.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:50.379 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T04:50:50.462 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:50.463 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:50.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.462+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.462+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.462+0000 7fc4a0a0f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x565211a4e680 0x565211a50a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.462+0000 7fc4a0a0f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652118f7e40 con 0x565211a51010 2024-09-10T04:50:50.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.462+0000 7fc4a0a0f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5652118c2680 con 0x565211a4e680 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc49c122640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x565211a4e680 0x565211a50a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc493921640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x565211a51010 0x565211a534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51928/0 (socket says 172.21.15.145:51928) 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc493921640 1 -- 172.21.15.145:0/198918840 learned_addr learned my addr 172.21.15.145:0/198918840 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc49c122640 1 -- 172.21.15.145:0/198918840 >> v1:172.21.15.98:6789/0 conn(0x565211a51010 legacy=0x565211a534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc49c122640 1 -- 172.21.15.145:0/198918840 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652118de6b0 con 0x565211a4e680 2024-09-10T04:50:50.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.463+0000 7fc49b921640 1 -- 172.21.15.145:0/198918840 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621820910 0 0) 0x5652118f7e40 con 0x565211a51010 2024-09-10T04:50:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.465+0000 7fc49c122640 1 --2- 172.21.15.145:0/198918840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211a50a70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a02462b0ea9f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.465+0000 7fc49b921640 1 -- 172.21.15.145:0/198918840 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c053570 con 0x565211a4e680 2024-09-10T04:50:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.465+0000 7fc49b921640 1 -- 172.21.15.145:0/198918840 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c058070 con 0x565211a4e680 2024-09-10T04:50:50.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.465+0000 7fc49b921640 1 -- 172.21.15.145:0/198918840 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c053880 con 0x565211a4e680 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/198918840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 msgr2=0x565211a50a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/198918840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211a50a70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/198918840 shutdown_connections 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/198918840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211a50a70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/198918840 >> 172.21.15.145:0/198918840 conn(0x565211a481c0 msgr2=0x565211a4a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/198918840 shutdown_connections 2024-09-10T04:50:50.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.466+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/198918840 wait complete. 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.479+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.479+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc4a0a0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc4a0a0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5652118e6dd0 con 0x565211a4e680 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38316/0 (socket says 172.21.15.145:38316) 2024-09-10T04:50:50.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc49c122640 1 -- 172.21.15.145:0/1407096426 learned_addr learned my addr 172.21.15.145:0/1407096426 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.480+0000 7fc49c122640 1 -- 172.21.15.145:0/1407096426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652118ffe10 con 0x565211a4e680 2024-09-10T04:50:50.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc49c122640 1 --2- 172.21.15.145:0/1407096426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9961132f82e3431a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc38a60c640 1 -- 172.21.15.145:0/1407096426 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c053570 con 0x565211a4e680 2024-09-10T04:50:50.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc38a60c640 1 -- 172.21.15.145:0/1407096426 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c063030 con 0x565211a4e680 2024-09-10T04:50:50.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc38a60c640 1 -- 172.21.15.145:0/1407096426 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c053840 con 0x565211a4e680 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/1407096426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 msgr2=0x565211b3d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/1407096426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c051000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/1407096426 shutdown_connections 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/1407096426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b3d460 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.481+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/1407096426 >> 172.21.15.145:0/1407096426 conn(0x565211a481c0 msgr2=0x565211b38de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/1407096426 shutdown_connections 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/1407096426 wait complete. 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b44d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc4a0a0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565211a55030 con 0x565211a4e680 2024-09-10T04:50:50.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b44d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b44d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38330/0 (socket says 172.21.15.145:38330) 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc49c122640 1 -- 172.21.15.145:0/81545276 learned_addr learned my addr 172.21.15.145:0/81545276 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.482+0000 7fc49c122640 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565211b452b0 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc49c122640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b44d50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc388e09640 1 -- 172.21.15.145:0/81545276 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c078070 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc388e09640 1 -- 172.21.15.145:0/81545276 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c068420 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565211b45540 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc388e09640 1 -- 172.21.15.145:0/81545276 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c068700 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.483+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565211b46150 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc388e09640 1 -- 172.21.15.145:0/81545276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc48c07b070 con 0x565211a4e680 2024-09-10T04:50:50.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc388e09640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc38403c780 0x7fc38403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc388e09640 1 -- 172.21.15.145:0/81545276 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fc48c0979f0 con 0x565211a4e680 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc493921640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc38403c780 0x7fc38403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211a51010 0x565211b4c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b4c8e0 con 0x565211a51010 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc49c923640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211a51010 0x565211b4c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.484+0000 7fc493921640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc38403c780 0x7fc38403ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc484000c00 tx=0x7fc4840013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc49c923640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211a51010 0x565211b4c3a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc49c923640 1 -- 172.21.15.145:0/81545276 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211a51010 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b4d190 0x565211b4f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b4fdc0 con 0x565211b4d190 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc49c122640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b4d190 0x565211b4f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.485+0000 7fc49c122640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b4d190 0x565211b4f650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc49c122640 1 -- 172.21.15.145:0/81545276 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b4d190 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b51670 con 0x565211a51010 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc49c923640 1 -- 172.21.15.145:0/81545276 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211a51010 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b507b0 con 0x565211b4d190 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc49c122640 1 -- 172.21.15.145:0/81545276 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b4d190 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x565211b51220 0x565211b54a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b551a0 con 0x565211b51220 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.486+0000 7fc493921640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x565211b51220 0x565211b54a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc493921640 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x565211b51220 0x565211b54a30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc493921640 1 -- 172.21.15.145:0/81545276 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc48400f670 con 0x565211b51220 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc4a0a0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.487+0000 7fc4a0a0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565211944a00 con 0x565211b62e30 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38338/0 (socket says 172.21.15.145:38338) 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc49c122640 1 -- 172.21.15.145:0/2124741132 learned_addr learned my addr 172.21.15.145:0/2124741132 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc49c122640 1 -- 172.21.15.145:0/2124741132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565211b63890 con 0x565211b62e30 2024-09-10T04:50:50.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc49c122640 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc48c05cef0 tx=0x7fc48c07cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc381ffb640 1 -- 172.21.15.145:0/2124741132 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c068be0 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc381ffb640 1 -- 172.21.15.145:0/2124741132 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c07c3b0 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc381ffb640 1 -- 172.21.15.145:0/2124741132 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c07c6d0 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565211b640c0 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.488+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565211b64660 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.489+0000 7fc381ffb640 1 -- 172.21.15.145:0/2124741132 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc48c09e060 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.489+0000 7fc381ffb640 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 0x7fc37403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.489+0000 7fc381ffb640 1 -- 172.21.15.145:0/2124741132 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fc48c091070 con 0x565211b62e30 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.489+0000 7fc493921640 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 0x7fc37403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc493921640 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 0x7fc37403ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x565211b46ca0 tx=0x7fc484006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc4a0a0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc4a0a0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565211b3dc50 con 0x565211b6f6f0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38352/0 (socket says 172.21.15.145:38352) 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc49c122640 1 -- 172.21.15.145:0/2630745482 learned_addr learned my addr 172.21.15.145:0/2630745482 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc49c122640 1 -- 172.21.15.145:0/2630745482 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565211b700c0 con 0x565211b6f6f0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.490+0000 7fc49c122640 1 --2- 172.21.15.145:0/2630745482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc48c095770 tx=0x7fc48c095200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb47e72e8e434ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc3737fe640 1 -- 172.21.15.145:0/2630745482 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c0af020 con 0x565211b6f6f0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc3737fe640 1 -- 172.21.15.145:0/2630745482 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c05e940 con 0x565211b6f6f0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc3737fe640 1 -- 172.21.15.145:0/2630745482 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c052800 con 0x565211b6f6f0 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2630745482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 msgr2=0x565211b6fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2630745482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc48c095770 tx=0x7fc48c095200 comp rx=0 tx=0).stop 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2630745482 shutdown_connections 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2630745482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b6fad0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2630745482 >> 172.21.15.145:0/2630745482 conn(0x565211b6baf0 msgr2=0x565211b69d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2630745482 shutdown_connections 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.491+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2630745482 wait complete. 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc4a0a0f800 1 Processor -- start 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc4a0a0f800 1 -- start start 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc4a0a0f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc4a0a0f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565211b70550 con 0x565211b6f6f0 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc49c122640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38364/0 (socket says 172.21.15.145:38364) 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 learned_addr learned my addr 172.21.15.145:0/537946234 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.492+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565211b76f50 con 0x565211b6f6f0 2024-09-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc49c122640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc48c05ebf0 tx=0x7fc48c088f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc371ffb640 1 -- 172.21.15.145:0/537946234 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c05ecc0 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc371ffb640 1 -- 172.21.15.145:0/537946234 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c05ee60 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc371ffb640 1 -- 172.21.15.145:0/537946234 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c099b80 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565211b76f50 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565211b76f50 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.493+0000 7fc371ffb640 1 -- 172.21.15.145:0/537946234 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc48c0b2020 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc371ffb640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc36403c780 0x7fc36403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc371ffb640 1 -- 172.21.15.145:0/537946234 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fc48c084140 con 0x565211b6f6f0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc493921640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc36403c780 0x7fc36403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc493921640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc36403c780 0x7fc36403ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x565211b55580 tx=0x7fc484023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211b81d60 0x565211b84220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b84970 con 0x565211b81d60 2024-09-10T04:50:50.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.494+0000 7fc49c923640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211b81d60 0x565211b84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc49c923640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211b81d60 0x565211b84220 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 realm 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b81090 con 0x565211b81d60 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b85400 con 0x565211b81d60 2024-09-10T04:50:50.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b861e0 0x565211b885d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.495+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b88c30 con 0x565211b861e0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc49c122640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b861e0 0x565211b885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc49c122640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b861e0 0x565211b885d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc4a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b89480 con 0x565211b81d60 2024-09-10T04:50:50.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.496+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc4a0a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc4a0a0f800 20 searching for the correct realm 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x565211b8b1f0 0x565211b8d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc493921640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x565211b8b1f0 0x565211b8d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc493921640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x565211b8b1f0 0x565211b8d620 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.497+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c122640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc48c0b4040 0x7fc48c0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc48c0b4040 0x7fc48c0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc48c0b4040 0x7fc48c0a97a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc49400a4d0 con 0x7fc48c0b4040 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.498+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.499+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49400a4d0 con 0x565211b81d60 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.500+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.501+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.502+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b81d60 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.503+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x7fc48c0b4040 2024-09-10T04:50:50.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494030040 con 0x7fc48c0b4040 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.504+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b8b1f0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565211b8dcf0 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:50.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b89e00 con 0x565211b81d60 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc494030040 con 0x565211b81d60 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.505+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b8a6a0 con 0x565211b861e0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b89a40 con 0x7fc48c0b4040 2024-09-10T04:50:50.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 zone default found 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 4 Realm: () 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 zonegroup default 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b8a6c0 con 0x7fc48c0b4040 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.506+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b900b0 con 0x565211b8b1f0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b90480 con 0x565211b8b1f0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 20 started sync module instance, tier type = 2024-09-10T04:50:50.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.507+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8f540 con 0x565211b861e0 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.508+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.508+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910484642368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8f540 con 0x565211b861e0 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.508+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b90f60 con 0x565211b81d60 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.509+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.509+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910484646480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b91450 con 0x565211b81d60 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.509+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b91f20 con 0x565211b861e0 2024-09-10T04:50:50.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.509+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910484642368] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.511+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910484646480] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.511+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.511+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910484650416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b90f20 con 0x565211b861e0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.511+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b92500 con 0x7fc48c0b4040 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.512+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.512+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910484652112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b92470 con 0x7fc48c0b4040 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.512+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b934d0 con 0x565211b861e0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.512+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910484650416] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.513+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910484652112] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.513+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.513+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910484654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b93490 con 0x565211b861e0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.513+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b93930 con 0x565211b8b1f0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.514+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.514+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910484639888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b941d0 con 0x565211b8b1f0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.514+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b94c70 con 0x565211b8b1f0 2024-09-10T04:50:50.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.514+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910484654320] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.515+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910484639888] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.515+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.516+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910484662080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b95060 con 0x565211b8b1f0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.516+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b958f0 con 0x7fc48c0b4040 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910484662080] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910484656064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b95510 con 0x7fc48c0b4040 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=0 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=1 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=2 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=3 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=4 2024-09-10T04:50:50.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=5 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.517+0000 7fc4a0a0f800 20 add_watcher() i=6 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910484656064] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc4a0a0f800 20 add_watcher() i=7 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc4a0a0f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211b98dd0 con 0x565211b81d60 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.518+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910484664880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b96320 con 0x565211b81d60 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.519+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910484664880] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.519+0000 7fc352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.519+0000 7fc4a0a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.519+0000 7fc4a0a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.520+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba16e0 con 0x565211b861e0 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.520+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.521+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba1770 con 0x7fc48c0b4040 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.522+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.522+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba1ce0 con 0x565211b8b1f0 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.523+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.523+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba2250 con 0x565211b81d60 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.524+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'180 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.524+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba27c0 con 0x565211b861e0 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.525+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.525+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba27c0 con 0x565211b8b1f0 2024-09-10T04:50:50.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.526+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.526+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba2d30 con 0x565211b861e0 2024-09-10T04:50:50.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.527+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.527+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba2d30 con 0x565211b81d60 2024-09-10T04:50:50.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.528+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.528+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba31e0 con 0x565211b861e0 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.529+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.529+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba31e0 con 0x565211b861e0 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.530+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.530+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba31e0 con 0x565211b861e0 2024-09-10T04:50:50.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.531+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.531+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba31e0 con 0x565211b8b1f0 2024-09-10T04:50:50.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.532+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.532+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3750 con 0x565211b861e0 2024-09-10T04:50:50.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.533+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.533+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3750 con 0x565211b81d60 2024-09-10T04:50:50.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.534+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.535+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3750 con 0x565211b81d60 2024-09-10T04:50:50.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.536+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'181 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.536+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba37e0 con 0x565211b861e0 2024-09-10T04:50:50.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.537+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.537+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba37e0 con 0x565211b861e0 2024-09-10T04:50:50.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.538+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.538+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba37e0 con 0x565211b8b1f0 2024-09-10T04:50:50.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.539+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.540+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba39b0 con 0x565211b861e0 2024-09-10T04:50:50.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.540+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.541+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba39b0 con 0x565211b81d60 2024-09-10T04:50:50.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.542+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'182 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.542+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba39b0 con 0x565211b861e0 2024-09-10T04:50:50.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.543+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.543+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3bf0 con 0x565211b861e0 2024-09-10T04:50:50.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.544+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.544+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b8b1f0 2024-09-10T04:50:50.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.545+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.545+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b861e0 2024-09-10T04:50:50.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.546+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.546+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b8b1f0 2024-09-10T04:50:50.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.547+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.547+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b8b1f0 2024-09-10T04:50:50.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.548+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.548+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b8b1f0 2024-09-10T04:50:50.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.549+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.549+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b861e0 2024-09-10T04:50:50.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.550+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.550+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b81d60 2024-09-10T04:50:50.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.551+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.551+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b861e0 2024-09-10T04:50:50.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.552+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.552+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x565211b81d60 2024-09-10T04:50:50.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.553+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.553+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211ba3b60 con 0x7fc48c0b4040 2024-09-10T04:50:50.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.554+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.554+0000 7fc351fdb640 20 reqs_thread_entry: start 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.554+0000 7fc4a0a0f800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.554+0000 7fc4a0a0f800 20 Filter name: none 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc2c37fe640 20 reqs_thread_entry: start 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211bce800 con 0x565211b81d60 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565211bd1130 con 0x7fc48c0b4040 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.555+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.557 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T04:50:50.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.556+0000 7fc352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.556+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910484664880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b7abe0 con 0x565211b81d60 2024-09-10T04:50:50.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.557+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94910484664880] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.557+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910484642368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b95200 con 0x565211b861e0 2024-09-10T04:50:50.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.559+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94910484642368] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.559+0000 7fc4a0a0f800 20 remove_watcher() i=0 2024-09-10T04:50:50.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.559+0000 7fc4a0a0f800 2 removed watcher, disabling cache 2024-09-10T04:50:50.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.559+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910484646480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8fa40 con 0x565211b81d60 2024-09-10T04:50:50.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.560+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94910484646480] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x565211b81d60 2024-09-10T04:50:50.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.560+0000 7fc4a0a0f800 20 remove_watcher() i=1 2024-09-10T04:50:50.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.560+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910484650416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8fa40 con 0x565211b861e0 2024-09-10T04:50:50.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.561+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94910484650416] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.561+0000 7fc4a0a0f800 20 remove_watcher() i=2 2024-09-10T04:50:50.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.561+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910484652112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8fa40 con 0x7fc48c0b4040 2024-09-10T04:50:50.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.562+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94910484652112] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.562+0000 7fc4a0a0f800 20 remove_watcher() i=3 2024-09-10T04:50:50.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.562+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910484654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b92050 con 0x565211b861e0 2024-09-10T04:50:50.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.563+0000 7fc49c122640 1 -- 172.21.15.145:0/537946234 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94910484654320] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48c07a030 con 0x565211b861e0 2024-09-10T04:50:50.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.563+0000 7fc4a0a0f800 20 remove_watcher() i=4 2024-09-10T04:50:50.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.563+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910484639888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b8fa40 con 0x565211b8b1f0 2024-09-10T04:50:50.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.564+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94910484639888] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.564+0000 7fc4a0a0f800 20 remove_watcher() i=5 2024-09-10T04:50:50.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.564+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910484662080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b928f0 con 0x565211b8b1f0 2024-09-10T04:50:50.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.565+0000 7fc493921640 1 -- 172.21.15.145:0/537946234 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94910484662080] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc484037040 con 0x565211b8b1f0 2024-09-10T04:50:50.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.565+0000 7fc4a0a0f800 20 remove_watcher() i=6 2024-09-10T04:50:50.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.565+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910484656064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565211b92050 con 0x7fc48c0b4040 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94910484656064] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494041040 con 0x7fc48c0b4040 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 20 remove_watcher() i=7 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b861e0 msgr2=0x565211b885d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b861e0 0x565211b885d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211b81d60 msgr2=0x565211b84220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211b81d60 0x565211b84220 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc48c0b4040 msgr2=0x7fc48c0a97a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fc48c0b4040 0x7fc48c0a97a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x565211b8b1f0 msgr2=0x565211b8d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.566+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x565211b8b1f0 0x565211b8d620 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc36403c780 msgr2=0x7fc36403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc36403c780 0x7fc36403ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x565211b55580 tx=0x7fc484023040 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 msgr2=0x565211b769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc49c923640 1 -- 172.21.15.145:0/537946234 reap_dead start 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc48c05ebf0 tx=0x7fc48c088f70 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 shutdown_connections 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/537946234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b6f6f0 0x565211b769f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 >> 172.21.15.145:0/537946234 conn(0x565211b6baf0 msgr2=0x565211b69d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 shutdown_connections 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/537946234 wait complete. 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 msgr2=0x7fc37403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 0x7fc37403ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x565211b46ca0 tx=0x7fc484006000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 msgr2=0x565211b63250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc48c05cef0 tx=0x7fc48c07cb80 comp rx=0 tx=0).stop 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 shutdown_connections 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc37403c780 0x7fc37403ec40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/2124741132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211b62e30 0x565211b63250 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 >> 172.21.15.145:0/2124741132 conn(0x565211b571e0 msgr2=0x565211b575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 shutdown_connections 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/2124741132 wait complete. 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b4d190 msgr2=0x565211b4f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x565211b4d190 0x565211b4f650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211a51010 msgr2=0x565211b4c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x565211a51010 0x565211b4c3a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x565211b51220 msgr2=0x565211b54a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.567+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x565211b51220 0x565211b54a30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc38403c780 msgr2=0x7fc38403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc38403c780 0x7fc38403ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc484000c00 tx=0x7fc4840013b0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 msgr2=0x565211b44d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 --2- 172.21.15.145:0/81545276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565211a4e680 0x565211b44d50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a470 tx=0x7fc48c002fb0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc49c923640 1 -- 172.21.15.145:0/81545276 reap_dead start 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 shutdown_connections 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 >> 172.21.15.145:0/81545276 conn(0x565211a481c0 msgr2=0x565211b375d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 shutdown_connections 2024-09-10T04:50:50.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.568+0000 7fc4a0a0f800 1 -- 172.21.15.145:0/81545276 wait complete. 2024-09-10T04:50:50.577 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T04:50:50.586 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-10T04:50:50.593 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:50.620 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:50.633 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:50.677 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T04:50:50.682 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:50.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T04:50:50.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T04:50:50.682 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T04:50:50.728 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:50.728 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:50.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.727+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.727+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0a1814800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55600de50210 0x55600de526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0a1814800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55600dcf5e40 con 0x55600de4c6a0 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0a1814800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55600dcc0680 con 0x55600de50210 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0946ca640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55600de50210 0x55600de526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff09cecb640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55600de4c6a0 0x55600de4ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51932/0 (socket says 172.21.15.145:51932) 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff09cecb640 1 -- 172.21.15.145:0/3378934989 learned_addr learned my addr 172.21.15.145:0/3378934989 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0946ca640 1 -- 172.21.15.145:0/3378934989 >> v1:172.21.15.98:6789/0 conn(0x55600de4c6a0 legacy=0x55600de4ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff0946ca640 1 -- 172.21.15.145:0/3378934989 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600dcdc6b0 con 0x55600de50210 2024-09-10T04:50:50.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.728+0000 7ff097fff640 1 -- 172.21.15.145:0/3378934989 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426893117 0 0) 0x55600dcf5e40 con 0x55600de4c6a0 2024-09-10T04:50:50.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.730+0000 7ff0946ca640 1 --2- 172.21.15.145:0/3378934989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600de526d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff08400a470 tx=0x7ff084045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7db72b85138c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.730+0000 7ff097fff640 1 -- 172.21.15.145:0/3378934989 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff084053570 con 0x55600de50210 2024-09-10T04:50:50.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.730+0000 7ff097fff640 1 -- 172.21.15.145:0/3378934989 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff084058070 con 0x55600de50210 2024-09-10T04:50:50.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.730+0000 7ff097fff640 1 -- 172.21.15.145:0/3378934989 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff084053880 con 0x55600de50210 2024-09-10T04:50:50.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 -- 172.21.15.145:0/3378934989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 msgr2=0x55600de526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3378934989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600de526d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff08400a470 tx=0x7ff084045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 -- 172.21.15.145:0/3378934989 shutdown_connections 2024-09-10T04:50:50.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3378934989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600de526d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 -- 172.21.15.145:0/3378934989 >> 172.21.15.145:0/3378934989 conn(0x55600de46200 msgr2=0x55600de48640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 -- 172.21.15.145:0/3378934989 shutdown_connections 2024-09-10T04:50:50.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.731+0000 7ff0a1814800 1 -- 172.21.15.145:0/3378934989 wait complete. 2024-09-10T04:50:50.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff0a1814800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff0a1814800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55600dce4dd0 con 0x55600de4c6a0 2024-09-10T04:50:50.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38382/0 (socket says 172.21.15.145:38382) 2024-09-10T04:50:50.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff09cecb640 1 -- 172.21.15.145:0/2183979636 learned_addr learned my addr 172.21.15.145:0/2183979636 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.745+0000 7ff09cecb640 1 -- 172.21.15.145:0/2183979636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600dcfde10 con 0x55600de4c6a0 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff09cecb640 1 --2- 172.21.15.145:0/2183979636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001ea0 tx=0x7ff08c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c33896b06605d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7fef8ae0d640 1 -- 172.21.15.145:0/2183979636 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c008070 con 0x55600de4c6a0 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7fef8ae0d640 1 -- 172.21.15.145:0/2183979636 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c00d500 con 0x55600de4c6a0 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7fef8ae0d640 1 -- 172.21.15.145:0/2183979636 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c00d880 con 0x55600de4c6a0 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 -- 172.21.15.145:0/2183979636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 msgr2=0x55600df3b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 --2- 172.21.15.145:0/2183979636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001ea0 tx=0x7ff08c00b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 -- 172.21.15.145:0/2183979636 shutdown_connections 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 --2- 172.21.15.145:0/2183979636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4c6a0 0x55600df3b4b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 -- 172.21.15.145:0/2183979636 >> 172.21.15.145:0/2183979636 conn(0x55600de46200 msgr2=0x55600df36e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 -- 172.21.15.145:0/2183979636 shutdown_connections 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.746+0000 7ff0a1814800 1 -- 172.21.15.145:0/2183979636 wait complete. 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff0a1814800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600df430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff0a1814800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55600de53050 con 0x55600de50210 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600df430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600df430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38398/0 (socket says 172.21.15.145:38398) 2024-09-10T04:50:50.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff09cecb640 1 -- 172.21.15.145:0/1950951413 learned_addr learned my addr 172.21.15.145:0/1950951413 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.747+0000 7ff09cecb640 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600df43630 con 0x55600de50210 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7ff09cecb640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600df430d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0012f0 tx=0x7ff08c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7fef8960a640 1 -- 172.21.15.145:0/1950951413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c00de50 con 0x55600de50210 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7fef8960a640 1 -- 172.21.15.145:0/1950951413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c00f930 con 0x55600de50210 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600df438c0 con 0x55600de50210 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7fef8960a640 1 -- 172.21.15.145:0/1950951413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c00fc30 con 0x55600de50210 2024-09-10T04:50:50.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.748+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600df442c0 con 0x55600de50210 2024-09-10T04:50:50.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7fef8960a640 1 -- 172.21.15.145:0/1950951413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff08c017040 con 0x55600de50210 2024-09-10T04:50:50.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7fef8960a640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef8403c920 0x7fef8403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7fef8960a640 1 -- 172.21.15.145:0/1950951413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7ff08c015020 con 0x55600de50210 2024-09-10T04:50:50.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7ff0946ca640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef8403c920 0x7fef8403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df44dc0 0x55600df4a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df4aca0 con 0x55600df44dc0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df44dc0 0x55600df4a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.749+0000 7ff0946ca640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef8403c920 0x7fef8403ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff084057000 tx=0x7ff084052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.750+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df44dc0 0x55600df4a720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.750+0000 7ff09d6cc640 1 -- 172.21.15.145:0/1950951413 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df44dc0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.750+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df4ba90 0x55600df4de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.750+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df4e4c0 con 0x55600df4ba90 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.750+0000 7ff09cecb640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df4ba90 0x55600df4de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.751+0000 7ff09cecb640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df4ba90 0x55600df4de80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.751+0000 7ff09cecb640 1 -- 172.21.15.145:0/1950951413 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df4ba90 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.751+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df4fd70 con 0x55600df44dc0 2024-09-10T04:50:50.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.751+0000 7ff09d6cc640 1 -- 172.21.15.145:0/1950951413 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df44dc0 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.751+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df4efa0 con 0x55600df4ba90 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff09cecb640 1 -- 172.21.15.145:0/1950951413 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df4ba90 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55600df51120 0x55600df53510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df53a50 con 0x55600df51120 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0946ca640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55600df51120 0x55600df53510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0946ca640 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55600df51120 0x55600df53510 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0946ca640 1 -- 172.21.15.145:0/1950951413 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff084051070 con 0x55600df51120 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.752+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff0a1814800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff0a1814800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55600dd42a00 con 0x55600de4be40 2024-09-10T04:50:50.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38410/0 (socket says 172.21.15.145:38410) 2024-09-10T04:50:50.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff09cecb640 1 -- 172.21.15.145:0/3115283921 learned_addr learned my addr 172.21.15.145:0/3115283921 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff09cecb640 1 -- 172.21.15.145:0/3115283921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600de4c360 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7ff09cecb640 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01adc0 tx=0x7ff08c04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7fef827fc640 1 -- 172.21.15.145:0/3115283921 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c019470 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.753+0000 7fef827fc640 1 -- 172.21.15.145:0/3115283921 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c019610 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600de4abf0 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7fef827fc640 1 -- 172.21.15.145:0/3115283921 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c04b450 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600de4b140 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7fef827fc640 1 -- 172.21.15.145:0/3115283921 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff08c04b5f0 con 0x55600de4be40 2024-09-10T04:50:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7fef827fc640 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 0x7fef7403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7fef827fc640 1 -- 172.21.15.145:0/3115283921 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7ff08c03be30 con 0x55600de4be40 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.754+0000 7ff0946ca640 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 0x7fef7403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff0946ca640 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 0x7fef7403ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55600df446c0 tx=0x7ff084005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff0a1814800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff0a1814800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55600df3bd00 con 0x55600df70230 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38422/0 (socket says 172.21.15.145:38422) 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff09cecb640 1 -- 172.21.15.145:0/3793586312 learned_addr learned my addr 172.21.15.145:0/3793586312 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.755+0000 7ff09cecb640 1 -- 172.21.15.145:0/3793586312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600df70c20 con 0x55600df70230 2024-09-10T04:50:50.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff09cecb640 1 --2- 172.21.15.145:0/3793586312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff08c019ca0 tx=0x7ff08c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881f9ba185c8f85b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7fef73fff640 1 -- 172.21.15.145:0/3793586312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c01c9c0 con 0x55600df70230 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7fef73fff640 1 -- 172.21.15.145:0/3793586312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c05d070 con 0x55600df70230 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7fef73fff640 1 -- 172.21.15.145:0/3793586312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c0185f0 con 0x55600df70230 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 -- 172.21.15.145:0/3793586312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 msgr2=0x55600df70630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3793586312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff08c019ca0 tx=0x7ff08c01cce0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 -- 172.21.15.145:0/3793586312 shutdown_connections 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3793586312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df70630 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 -- 172.21.15.145:0/3793586312 >> 172.21.15.145:0/3793586312 conn(0x55600df6c630 msgr2=0x55600df6a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 -- 172.21.15.145:0/3793586312 shutdown_connections 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 -- 172.21.15.145:0/3793586312 wait complete. 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.756+0000 7ff0a1814800 1 Processor -- start 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff0a1814800 1 -- start start 2024-09-10T04:50:50.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff0a1814800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff0a1814800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55600df71090 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff09cecb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38436/0 (socket says 172.21.15.145:38436) 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 learned_addr learned my addr 172.21.15.145:0/42511410 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600df77ba0 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff09cecb640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01cd90 tx=0x7ff08c03a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7fef727fc640 1 -- 172.21.15.145:0/42511410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c06b020 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7fef727fc640 1 -- 172.21.15.145:0/42511410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c01c9c0 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600df77ba0 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.757+0000 7fef727fc640 1 -- 172.21.15.145:0/42511410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c0461a0 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.758+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600df77ba0 con 0x55600df70230 2024-09-10T04:50:50.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.758+0000 7fef727fc640 1 -- 172.21.15.145:0/42511410 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff08c06e020 con 0x55600df70230 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7fef727fc640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef6803c730 0x7fef6803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7fef727fc640 1 -- 172.21.15.145:0/42511410 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7ff08c071d60 con 0x55600df70230 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff0946ca640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef6803c730 0x7fef6803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff0946ca640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef6803c730 0x7fef6803ebf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff084045f20 tx=0x7ff08406b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df82ab0 0x55600df84f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df856c0 con 0x55600df82ab0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.759+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df82ab0 0x55600df84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df82ab0 0x55600df84f70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 realm 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df81de0 con 0x55600df82ab0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df86150 con 0x55600df82ab0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df86f30 0x55600df89320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df89980 con 0x55600df86f30 2024-09-10T04:50:50.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.760+0000 7ff09cecb640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df86f30 0x55600df89320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff09cecb640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df86f30 0x55600df89320 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df8a1d0 con 0x55600df82ab0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 20 searching for the correct realm 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55600df8bf40 0x55600df8e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.761+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff0946ca640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55600df8bf40 0x55600df8e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff0946ca640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55600df8bf40 0x55600df8e370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff09cecb640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff08c070020 0x7ff08c0588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.762+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff08c070020 0x7ff08c0588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff08c070020 0x7ff08c0588d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff09800a4d0 con 0x7ff08c070020 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.763+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.764+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff09800a4d0 con 0x55600df82ab0 2024-09-10T04:50:50.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.765+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.766+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.767+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df82ab0 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.768+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x7ff08c070020 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff098030040 con 0x7ff08c070020 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.769+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df8bf40 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ea40 con 0x55600df86f30 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.770+0000 7ff0a1814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:50.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df8ab80 con 0x55600df82ab0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff098030040 con 0x55600df82ab0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df8b420 con 0x55600df86f30 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df8a7c0 con 0x7ff08c070020 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 zone default found 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 4 Realm: () 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 zonegroup default 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.771+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df8eee0 con 0x7ff08c070020 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df90d40 con 0x55600df8bf40 2024-09-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df91220 con 0x55600df8bf40 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 started sync module instance, tier type = 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.772+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df901b0 con 0x55600df86f30 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.773+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.773+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871039645088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df8fe10 con 0x55600df86f30 2024-09-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.773+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df92020 con 0x55600df82ab0 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.775+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.775+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871039650608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df92500 con 0x55600df82ab0 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.775+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df93000 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.775+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93871039645088] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.776+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93871039650608] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.776+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.776+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871039654640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df92fc0 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.776+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df938d0 con 0x7ff08c070020 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.777+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93871039654640] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.777+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.777+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871039649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df92fc0 con 0x7ff08c070020 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.777+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df93f80 con 0x55600df86f30 2024-09-10T04:50:50.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.778+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93871039649408] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.778+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.778+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871039658608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df93f40 con 0x55600df86f30 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.778+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df949a0 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.779+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.779+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93871039658608] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.779+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871039656912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df94d40 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.779+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df95760 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.780+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93871039656912] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.780+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.781+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871039661136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df96030 con 0x55600df8bf40 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.781+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df969f0 con 0x7ff08c070020 2024-09-10T04:50:50.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871039669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df96e10 con 0x7ff08c070020 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=0 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=1 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=2 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=3 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=4 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=5 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93871039661136] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.782+0000 7ff0a1814800 20 add_watcher() i=6 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93871039669568] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff0a1814800 20 add_watcher() i=7 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff0a1814800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600df95b80 con 0x55600df82ab0 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.783+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871039670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600df95b80 con 0x55600df82ab0 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.784+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93871039670624] v34'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7fef537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 5 note: GC not initialized 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7fef527e4640 20 reqs_thread_entry: start 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 20 Filter name: none 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7fef4b7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.785+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600dfcd530 con 0x7ff08c070020 2024-09-10T04:50:50.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 : miss 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.d 8:b0f3c458:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600dfcef90 con 0x7ff08c070020 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(63 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 info.flags=0x17 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 to cache LRU end 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:50.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 20 get_obj_state: octx=0x7ff09800ab10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55600dfd1688 s->prefetch_data=0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.786+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 3.3es0 3:7d249ec9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df82ab0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.787+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(64 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.787+0000 7ff0a1814800 10 manifest: total_size = 5 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.787+0000 7ff0a1814800 20 get_obj_state: setting s->obj_tag to _Wt9nwsCTjm1yfrqiGsyubzO9NhuuIPj 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.787+0000 7fef537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.787+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871039670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df82ab0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.788+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93871039670624] v34'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.788+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871039645088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df86f30 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.789+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93871039645088] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.789+0000 7ff0a1814800 20 remove_watcher() i=0 2024-09-10T04:50:50.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.789+0000 7ff0a1814800 2 removed watcher, disabling cache 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.789+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871039650608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df82ab0 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.790+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93871039650608] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x55600df82ab0 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.790+0000 7ff0a1814800 20 remove_watcher() i=1 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.790+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871039654640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df86f30 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.792+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93871039654640] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.792+0000 7ff0a1814800 20 remove_watcher() i=2 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.792+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871039649408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x7ff08c070020 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.793+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93871039649408] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.793+0000 7ff0a1814800 20 remove_watcher() i=3 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.793+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871039658608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df86f30 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.794+0000 7ff09cecb640 1 -- 172.21.15.145:0/42511410 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93871039658608] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c02d070 con 0x55600df86f30 2024-09-10T04:50:50.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.794+0000 7ff0a1814800 20 remove_watcher() i=4 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.794+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871039656912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df8bf40 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.795+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93871039656912] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.795+0000 7ff0a1814800 20 remove_watcher() i=5 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.795+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871039661136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x55600df8bf40 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.796+0000 7ff0946ca640 1 -- 172.21.15.145:0/42511410 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93871039661136] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff084051070 con 0x55600df8bf40 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.796+0000 7ff0a1814800 20 remove_watcher() i=6 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.796+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871039669568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600dfd2650 con 0x7ff08c070020 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93871039669568] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff098041040 con 0x7ff08c070020 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 20 remove_watcher() i=7 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df86f30 msgr2=0x55600df89320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df86f30 0x55600df89320 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df82ab0 msgr2=0x55600df84f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df82ab0 0x55600df84f70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff08c070020 msgr2=0x7ff08c0588d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7ff08c070020 0x7ff08c0588d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55600df8bf40 msgr2=0x55600df8e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55600df8bf40 0x55600df8e370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef6803c730 msgr2=0x7fef6803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef6803c730 0x7fef6803ebf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff084045f20 tx=0x7ff08406b040 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 msgr2=0x55600df77640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01cd90 tx=0x7ff08c03a090 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff09d6cc640 1 -- 172.21.15.145:0/42511410 reap_dead start 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 shutdown_connections 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 --2- 172.21.15.145:0/42511410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600df70230 0x55600df77640 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 >> 172.21.15.145:0/42511410 conn(0x55600df6c630 msgr2=0x55600df6a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 shutdown_connections 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.797+0000 7ff0a1814800 1 -- 172.21.15.145:0/42511410 wait complete. 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 msgr2=0x7fef7403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 0x7fef7403ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55600df446c0 tx=0x7ff084005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 msgr2=0x55600de4a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff08c01adc0 tx=0x7ff08c04be50 comp rx=0 tx=0).stop 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 shutdown_connections 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef7403c780 0x7fef7403ec40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/3115283921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de4be40 0x55600de4a6b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 >> 172.21.15.145:0/3115283921 conn(0x55600df55930 msgr2=0x55600df55d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 shutdown_connections 2024-09-10T04:50:50.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/3115283921 wait complete. 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df4ba90 msgr2=0x55600df4de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55600df4ba90 0x55600df4de80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df44dc0 msgr2=0x55600df4a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55600df44dc0 0x55600df4a720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55600df51120 msgr2=0x55600df53510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55600df51120 0x55600df53510 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef8403c920 msgr2=0x7fef8403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fef8403c920 0x7fef8403ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff084057000 tx=0x7ff084052000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 msgr2=0x55600df430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 --2- 172.21.15.145:0/1950951413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55600de50210 0x55600df430d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0012f0 tx=0x7ff08c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff09d6cc640 1 -- 172.21.15.145:0/1950951413 reap_dead start 2024-09-10T04:50:50.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 shutdown_connections 2024-09-10T04:50:50.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 >> 172.21.15.145:0/1950951413 conn(0x55600de46200 msgr2=0x55600df3c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 shutdown_connections 2024-09-10T04:50:50.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.798+0000 7ff0a1814800 1 -- 172.21.15.145:0/1950951413 wait complete. 2024-09-10T04:50:50.811 INFO:teuthology.orchestra.run.smithi145.stdout:fooFoofooFooFULL_CONTROL 2024-09-10T04:50:50.811 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-10T04:50:50.813 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-10T04:50:50.818 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:50.818 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T04:50:50.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T04:50:50.818 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.865+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.865+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.865+0000 7f7645b0c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d194a97210 0x55d194a996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f7645b0c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d19493ce40 con 0x55d194a936a0 2024-09-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f7645b0c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55d194907680 con 0x55d194a97210 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f763bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55d194a97210 0x55d194a996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f76435f6640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55d194a936a0 0x55d194a95a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51938/0 (socket says 172.21.15.145:51938) 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f76435f6640 1 -- 172.21.15.145:0/893068862 learned_addr learned my addr 172.21.15.145:0/893068862 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f763bfff640 1 -- 172.21.15.145:0/893068862 >> v1:172.21.15.98:6789/0 conn(0x55d194a936a0 legacy=0x55d194a95a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f763bfff640 1 -- 172.21.15.145:0/893068862 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1949236b0 con 0x55d194a97210 2024-09-10T04:50:50.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.866+0000 7f7642df5640 1 -- 172.21.15.145:0/893068862 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327328083 0 0) 0x55d19493ce40 con 0x55d194a936a0 2024-09-10T04:50:50.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.868+0000 7f763bfff640 1 --2- 172.21.15.145:0/893068862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a97210 0x55d194a996d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f762c00a470 tx=0x7f762c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5146d5ad3dd2e69f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.868+0000 7f7642df5640 1 -- 172.21.15.145:0/893068862 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f762c053570 con 0x55d194a97210 2024-09-10T04:50:50.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.868+0000 7f7642df5640 1 -- 172.21.15.145:0/893068862 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c058070 con 0x55d194a97210 2024-09-10T04:50:50.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.868+0000 7f7642df5640 1 -- 172.21.15.145:0/893068862 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f762c053880 con 0x55d194a97210 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 -- 172.21.15.145:0/893068862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a97210 msgr2=0x55d194a996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 --2- 172.21.15.145:0/893068862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a97210 0x55d194a996d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f762c00a470 tx=0x7f762c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 -- 172.21.15.145:0/893068862 shutdown_connections 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 --2- 172.21.15.145:0/893068862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a97210 0x55d194a996d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 -- 172.21.15.145:0/893068862 >> 172.21.15.145:0/893068862 conn(0x55d194a8d200 msgr2=0x55d194a8f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 -- 172.21.15.145:0/893068862 shutdown_connections 2024-09-10T04:50:50.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.869+0000 7f7645b0c800 1 -- 172.21.15.145:0/893068862 wait complete. 2024-09-10T04:50:50.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.882+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f7645b0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f7645b0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d19492bdd0 con 0x55d194a936a0 2024-09-10T04:50:50.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38450/0 (socket says 172.21.15.145:38450) 2024-09-10T04:50:50.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f76435f6640 1 -- 172.21.15.145:0/3560116527 learned_addr learned my addr 172.21.15.145:0/3560116527 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.883+0000 7f76435f6640 1 -- 172.21.15.145:0/3560116527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d194944e10 con 0x55d194a936a0 2024-09-10T04:50:50.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.884+0000 7f76435f6640 1 --2- 172.21.15.145:0/3560116527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7634001ea0 tx=0x7f763400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a37b6ff16d5082 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.884+0000 7f753160a640 1 -- 172.21.15.145:0/3560116527 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634008070 con 0x55d194a936a0 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.884+0000 7f753160a640 1 -- 172.21.15.145:0/3560116527 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763400d500 con 0x55d194a936a0 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.884+0000 7f753160a640 1 -- 172.21.15.145:0/3560116527 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763400d880 con 0x55d194a936a0 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.884+0000 7f7645b0c800 1 -- 172.21.15.145:0/3560116527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 msgr2=0x55d194b824f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 --2- 172.21.15.145:0/3560116527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7634001ea0 tx=0x7f763400b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- 172.21.15.145:0/3560116527 shutdown_connections 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 --2- 172.21.15.145:0/3560116527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194b824f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- 172.21.15.145:0/3560116527 >> 172.21.15.145:0/3560116527 conn(0x55d194a8d200 msgr2=0x55d194b7de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- 172.21.15.145:0/3560116527 shutdown_connections 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- 172.21.15.145:0/3560116527 wait complete. 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194a92dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f7645b0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d194a9a050 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194a92dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194a92dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38466/0 (socket says 172.21.15.145:38466) 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.885+0000 7f76435f6640 1 -- 172.21.15.145:0/2510154435 learned_addr learned my addr 172.21.15.145:0/2510154435 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f76435f6640 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d194a93320 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f76435f6640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194a92dc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f60 tx=0x7f7634000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f752fe07640 1 -- 172.21.15.145:0/2510154435 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763400f8d0 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f752fe07640 1 -- 172.21.15.145:0/2510154435 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763400fa70 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d194a916d0 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f752fe07640 1 -- 172.21.15.145:0/2510154435 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763400fd50 con 0x55d194a936a0 2024-09-10T04:50:50.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.886+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d194a91c90 con 0x55d194a936a0 2024-09-10T04:50:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f752fe07640 1 -- 172.21.15.145:0/2510154435 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7634017040 con 0x55d194a936a0 2024-09-10T04:50:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f752fe07640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f752803c730 0x7f752803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f752fe07640 1 -- 172.21.15.145:0/2510154435 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f7634015020 con 0x55d194a936a0 2024-09-10T04:50:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f763bfff640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f752803c730 0x7f752803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194a97210 0x55d194b93360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194b938a0 con 0x55d194a97210 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.887+0000 7f7643df7640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194a97210 0x55d194b93360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f763bfff640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f752803c730 0x7f752803ebf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762c057000 tx=0x7f762c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f7643df7640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194a97210 0x55d194b93360 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f7643df7640 1 -- 172.21.15.145:0/2510154435 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194a97210 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194b94630 0x55d194b96a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194b97060 con 0x55d194b94630 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.888+0000 7f76435f6640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194b94630 0x55d194b96a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.889+0000 7f76435f6640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194b94630 0x55d194b96a20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.889+0000 7f76435f6640 1 -- 172.21.15.145:0/2510154435 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f763402d070 con 0x55d194b94630 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.889+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194b98910 con 0x55d194a97210 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.889+0000 7f7643df7640 1 -- 172.21.15.145:0/2510154435 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194a97210 2024-09-10T04:50:50.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.889+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194b97b40 con 0x55d194b94630 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f76435f6640 1 -- 172.21.15.145:0/2510154435 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f763402d070 con 0x55d194b94630 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d194b99cc0 0x55d194b9c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194b9c5f0 con 0x55d194b99cc0 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f763bfff640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d194b99cc0 0x55d194b9c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f763bfff640 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d194b99cc0 0x55d194b9c0b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.890+0000 7f763bfff640 1 -- 172.21.15.145:0/2510154435 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f762c051070 con 0x55d194b99cc0 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f7645b0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f7645b0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d194989a00 con 0x55d194baa140 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38482/0 (socket says 172.21.15.145:38482) 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f76435f6640 1 -- 172.21.15.145:0/1512586436 learned_addr learned my addr 172.21.15.145:0/1512586436 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.891+0000 7f76435f6640 1 -- 172.21.15.145:0/1512586436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d194baaba0 con 0x55d194baa140 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f76435f6640 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f763400eb00 tx=0x7f7634052f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f752d602640 1 -- 172.21.15.145:0/1512586436 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634044bc0 con 0x55d194baa140 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f752d602640 1 -- 172.21.15.145:0/1512586436 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7634048020 con 0x55d194baa140 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f752d602640 1 -- 172.21.15.145:0/1512586436 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76340183d0 con 0x55d194baa140 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d194bab3d0 con 0x55d194baa140 2024-09-10T04:50:50.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.892+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d194bab970 con 0x55d194baa140 2024-09-10T04:50:50.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f752d602640 1 -- 172.21.15.145:0/1512586436 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7634018570 con 0x55d194baa140 2024-09-10T04:50:50.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f752d602640 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 0x7f751c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f752d602640 1 -- 172.21.15.145:0/1512586436 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f7634049030 con 0x55d194baa140 2024-09-10T04:50:50.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f763bfff640 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 0x7f751c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f763bfff640 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 0x7f751c03ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d194a920e0 tx=0x7f762c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f7645b0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f7645b0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d194b82d40 con 0x55d194bb6c20 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.893+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38492/0 (socket says 172.21.15.145:38492) 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f76435f6640 1 -- 172.21.15.145:0/2839127297 learned_addr learned my addr 172.21.15.145:0/2839127297 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f76435f6640 1 -- 172.21.15.145:0/2839127297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d194bb7610 con 0x55d194bb6c20 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f76435f6640 1 --2- 172.21.15.145:0/2839127297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7634026dd0 tx=0x7f76340448b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560016a8e7a066aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7526ffd640 1 -- 172.21.15.145:0/2839127297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634035040 con 0x55d194bb6c20 2024-09-10T04:50:50.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7526ffd640 1 -- 172.21.15.145:0/2839127297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7634026e40 con 0x55d194bb6c20 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7526ffd640 1 -- 172.21.15.145:0/2839127297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634026430 con 0x55d194bb6c20 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7645b0c800 1 -- 172.21.15.145:0/2839127297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 msgr2=0x55d194bb7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2839127297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7634026dd0 tx=0x7f76340448b0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7645b0c800 1 -- 172.21.15.145:0/2839127297 shutdown_connections 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2839127297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bb7020 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.894+0000 7f7645b0c800 1 -- 172.21.15.145:0/2839127297 >> 172.21.15.145:0/2839127297 conn(0x55d194bb3020 msgr2=0x55d194bb1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 -- 172.21.15.145:0/2839127297 shutdown_connections 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 -- 172.21.15.145:0/2839127297 wait complete. 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 Processor -- start 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 -- start start 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f7645b0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d194bb7a80 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f76435f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38496/0 (socket says 172.21.15.145:38496) 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 learned_addr learned my addr 172.21.15.145:0/4155670617 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.895+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d194bbe590 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f76435f6640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f763403efd0 tx=0x7f76340398b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f75257fa640 1 -- 172.21.15.145:0/4155670617 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634035040 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f75257fa640 1 -- 172.21.15.145:0/4155670617 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7634064030 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d194bbe590 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f75257fa640 1 -- 172.21.15.145:0/4155670617 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634018860 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d194bbe590 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.896+0000 7f75257fa640 1 -- 172.21.15.145:0/4155670617 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76340307e0 con 0x55d194bb6c20 2024-09-10T04:50:50.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f75257fa640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f750c03c730 0x7f750c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f75257fa640 1 -- 172.21.15.145:0/4155670617 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f763406ad80 con 0x55d194bb6c20 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f763bfff640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f750c03c730 0x7f750c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f763bfff640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f750c03c730 0x7f750c03ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f762c000c00 tx=0x7f762c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194bc9600 0x55d194bcbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.897+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bcc210 con 0x55d194bc9600 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7643df7640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194bc9600 0x55d194bcbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7643df7640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194bc9600 0x55d194bcbac0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 20 realm 2024-09-10T04:50:50.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bc8930 con 0x55d194bc9600 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.898+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bccca0 con 0x55d194bc9600 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194bcda80 0x55d194bcfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd0500 con 0x55d194bcda80 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f76435f6640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194bcda80 0x55d194bcfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.899+0000 7f76435f6640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194bcda80 0x55d194bcfe70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd0d50 con 0x55d194bc9600 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 20 searching for the correct realm 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d194bd2ac0 0x55d194bd4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f763bfff640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d194bd2ac0 0x55d194bd4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.900+0000 7f763bfff640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d194bd2ac0 0x55d194bd4eb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f76435f6640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f763403e460 0x7f76340547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f7643df7640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f763403e460 0x7f76340547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.901+0000 7f7643df7640 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f763403e460 0x7f76340547f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f763c00a4d0 con 0x7f763403e460 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.902+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c00a4d0 con 0x55d194bc9600 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.903+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.904+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.905+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.906+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bc9600 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.907+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x7f763403e460 2024-09-10T04:50:50.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c030040 con 0x7f763403e460 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.908+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bd2ac0 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5580 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:50.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd1700 con 0x55d194bc9600 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c030040 con 0x55d194bc9600 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.909+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd1fa0 con 0x55d194bcda80 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:50.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd1340 con 0x7f763403e460 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 zone default found 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 4 Realm: () 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 zonegroup default 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.910+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd5a70 con 0x7f763403e460 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd78d0 con 0x55d194bd2ac0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd7d80 con 0x55d194bd2ac0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 started sync module instance, tier type = 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:50.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.911+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd6d40 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.913+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.913+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94358631969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd6d40 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.913+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd8880 con 0x55d194bc9600 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.914+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.914+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94358631973712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd8880 con 0x55d194bc9600 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.914+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd9880 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.914+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94358631969344] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.915+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94358631973712] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.915+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.915+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94358631977840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bd9840 con 0x55d194bcda80 2024-09-10T04:50:50.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.915+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bda120 con 0x7f763403e460 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.916+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.916+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94358631980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bda540 con 0x7f763403e460 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.916+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdad90 con 0x55d194bcda80 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.916+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94358631977840] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.917+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94358631980144] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.917+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.917+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94358631981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bda960 con 0x55d194bcda80 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.918+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdb1f0 con 0x55d194bd2ac0 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.919+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.919+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94358631983968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdba90 con 0x55d194bd2ac0 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.919+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94358631981200] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.919+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdc020 con 0x55d194bd2ac0 2024-09-10T04:50:50.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.920+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94358631983968] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.920+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.920+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94358631986656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdc4d0 con 0x55d194bd2ac0 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.920+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdce90 con 0x7f763403e460 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94358631986656] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94358631989760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdce90 con 0x7f763403e460 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=0 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=1 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=2 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=3 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=4 2024-09-10T04:50:50.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=5 2024-09-10T04:50:50.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.921+0000 7f7645b0c800 20 add_watcher() i=6 2024-09-10T04:50:50.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94358631989760] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7645b0c800 20 add_watcher() i=7 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7645b0c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194be0290 con 0x55d194bc9600 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.922+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94358631992240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194bdd7e0 con 0x55d194bc9600 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94358631992240] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f74f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 5 note: GC not initialized 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f74f8fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 20 Filter name: none 2024-09-10T04:50:50.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f74727fc640 20 reqs_thread_entry: start 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.924+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194c13860 con 0x7f763403e460 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 : miss 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 20 rados->read ofs=0 len=0 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.d 8:b0f3c458:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194c152c0 con 0x7f763403e460 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(63 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:50.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 info.flags=0x17 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 to cache LRU end 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 20 get_obj_state: octx=0x7f763c00ab50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d194c179b8 s->prefetch_data=0 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 3.3es0 3:7d249ec9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bc9600 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(64 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 10 manifest: total_size = 5 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.925+0000 7f7645b0c800 20 get_obj_state: setting s->obj_tag to _Je93jnNENuHmVDaVdfU20fUpm4RKFNN 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.926+0000 7f74f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.926+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94358631992240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bc9600 2024-09-10T04:50:50.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.927+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94358631992240] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.927+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94358631969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bcda80 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.928+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94358631969344] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.928+0000 7f7645b0c800 20 remove_watcher() i=0 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.928+0000 7f7645b0c800 2 removed watcher, disabling cache 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.928+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94358631973712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bc9600 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.929+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94358631973712] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x55d194bc9600 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.929+0000 7f7645b0c800 20 remove_watcher() i=1 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.929+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94358631977840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bcda80 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.930+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94358631977840] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.930+0000 7f7645b0c800 20 remove_watcher() i=2 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.930+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94358631980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x7f763403e460 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.931+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94358631980144] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.931+0000 7f7645b0c800 20 remove_watcher() i=3 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.931+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94358631981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bcda80 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.932+0000 7f76435f6640 1 -- 172.21.15.145:0/4155670617 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94358631981200] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634070070 con 0x55d194bcda80 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.932+0000 7f7645b0c800 20 remove_watcher() i=4 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.932+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94358631983968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bd2ac0 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.933+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94358631983968] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.933+0000 7f7645b0c800 20 remove_watcher() i=5 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.933+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94358631986656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x55d194bd2ac0 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.934+0000 7f763bfff640 1 -- 172.21.15.145:0/4155670617 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94358631986656] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c07c040 con 0x55d194bd2ac0 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.934+0000 7f7645b0c800 20 remove_watcher() i=6 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.934+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94358631989760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d194c189a0 con 0x7f763403e460 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.935+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94358631989760] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c041040 con 0x7f763403e460 2024-09-10T04:50:50.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.935+0000 7f7645b0c800 20 remove_watcher() i=7 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194bcda80 msgr2=0x55d194bcfe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194bcda80 0x55d194bcfe70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194bc9600 msgr2=0x55d194bcbac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194bc9600 0x55d194bcbac0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f763403e460 msgr2=0x7f76340547f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f763403e460 0x7f76340547f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d194bd2ac0 msgr2=0x55d194bd4eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55d194bd2ac0 0x55d194bd4eb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f750c03c730 msgr2=0x7f750c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f750c03c730 0x7f750c03ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f762c000c00 tx=0x7f762c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 msgr2=0x55d194bbe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7643df7640 1 -- 172.21.15.145:0/4155670617 reap_dead start 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f763403efd0 tx=0x7f76340398b0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 shutdown_connections 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/4155670617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194bb6c20 0x55d194bbe030 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 >> 172.21.15.145:0/4155670617 conn(0x55d194bb3020 msgr2=0x55d194bb1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 shutdown_connections 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/4155670617 wait complete. 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 msgr2=0x7f751c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 0x7f751c03ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d194a920e0 tx=0x7f762c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 msgr2=0x55d194baa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f763400eb00 tx=0x7f7634052f00 comp rx=0 tx=0).stop 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 shutdown_connections 2024-09-10T04:50:50.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f751c03c780 0x7f751c03ec40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 --2- 172.21.15.145:0/1512586436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194baa140 0x55d194baa560 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 >> 172.21.15.145:0/1512586436 conn(0x55d194b9e4f0 msgr2=0x55d194b9e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 shutdown_connections 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.936+0000 7f7645b0c800 1 -- 172.21.15.145:0/1512586436 wait complete. 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194b94630 msgr2=0x55d194b96a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55d194b94630 0x55d194b96a20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194a97210 msgr2=0x55d194b93360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55d194a97210 0x55d194b93360 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d194b99cc0 msgr2=0x55d194b9c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55d194b99cc0 0x55d194b9c0b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f752803c730 msgr2=0x7f752803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f752803c730 0x7f752803ebf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762c057000 tx=0x7f762c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 msgr2=0x55d194a92dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 --2- 172.21.15.145:0/2510154435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d194a936a0 0x55d194a92dc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f60 tx=0x7f7634000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7643df7640 1 -- 172.21.15.145:0/2510154435 reap_dead start 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 shutdown_connections 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 >> 172.21.15.145:0/2510154435 conn(0x55d194a8d200 msgr2=0x55d194b837d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 shutdown_connections 2024-09-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:50.937+0000 7f7645b0c800 1 -- 172.21.15.145:0/2510154435 wait complete. 2024-09-10T04:50:50.949 INFO:teuthology.orchestra.run.smithi145.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T04:50:50.949 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T04:50:50.951 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-10T04:50:50.970 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:51.065 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T04:50:51.065 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T04:50:51.065 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T04:50:51.066 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T04:50:51.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T04:50:51.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T04:50:51.066 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-10T04:50:51.112 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:51.112 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb2692e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55969d979210 0x55969d97edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb2692e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55969d822e40 con 0x55969d977e00 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb2692e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55969d7ed680 con 0x55969d979210 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb21edc640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55969d979210 0x55969d97edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb226dd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55969d977e00 0x55969d978b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51952/0 (socket says 172.21.15.145:51952) 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.112+0000 7fdb226dd640 1 -- 172.21.15.145:0/2951706407 learned_addr learned my addr 172.21.15.145:0/2951706407 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.113+0000 7fdb21edc640 1 -- 172.21.15.145:0/2951706407 >> v1:172.21.15.98:6789/0 conn(0x55969d977e00 legacy=0x55969d978b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.113+0000 7fdb216db640 1 -- 172.21.15.145:0/2951706407 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273078626 0 0) 0x55969d822e40 con 0x55969d977e00 2024-09-10T04:50:51.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.113+0000 7fdb21edc640 1 -- 172.21.15.145:0/2951706407 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969d8096b0 con 0x55969d979210 2024-09-10T04:50:51.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.114+0000 7fdb21edc640 1 --2- 172.21.15.145:0/2951706407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d979210 0x55969d97edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800a470 tx=0x7fdb18045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135d94a47c1d7a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb216db640 1 -- 172.21.15.145:0/2951706407 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18053570 con 0x55969d979210 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb216db640 1 -- 172.21.15.145:0/2951706407 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb18058070 con 0x55969d979210 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb216db640 1 -- 172.21.15.145:0/2951706407 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18053880 con 0x55969d979210 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 -- 172.21.15.145:0/2951706407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d979210 msgr2=0x55969d97edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2951706407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d979210 0x55969d97edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800a470 tx=0x7fdb18045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 -- 172.21.15.145:0/2951706407 shutdown_connections 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2951706407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d979210 0x55969d97edb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 -- 172.21.15.145:0/2951706407 >> 172.21.15.145:0/2951706407 conn(0x55969d9731d0 msgr2=0x55969d975630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 -- 172.21.15.145:0/2951706407 shutdown_connections 2024-09-10T04:50:51.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.115+0000 7fdb2692e800 1 -- 172.21.15.145:0/2951706407 wait complete. 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb2692e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb2692e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55969d811dd0 con 0x55969d977e00 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38520/0 (socket says 172.21.15.145:38520) 2024-09-10T04:50:51.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb226dd640 1 -- 172.21.15.145:0/901004509 learned_addr learned my addr 172.21.15.145:0/901004509 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.129+0000 7fdb226dd640 1 -- 172.21.15.145:0/901004509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969d82ae10 con 0x55969d977e00 2024-09-10T04:50:51.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.130+0000 7fdb226dd640 1 --2- 172.21.15.145:0/901004509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdb14001ea0 tx=0x7fdb1400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d17c452928ec82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.130+0000 7fda10608640 1 -- 172.21.15.145:0/901004509 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb14008070 con 0x55969d977e00 2024-09-10T04:50:51.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.130+0000 7fda10608640 1 -- 172.21.15.145:0/901004509 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1400d500 con 0x55969d977e00 2024-09-10T04:50:51.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.130+0000 7fda10608640 1 -- 172.21.15.145:0/901004509 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1400d880 con 0x55969d977e00 2024-09-10T04:50:51.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- 172.21.15.145:0/901004509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 msgr2=0x55969d8ebd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 --2- 172.21.15.145:0/901004509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdb14001ea0 tx=0x7fdb1400b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- 172.21.15.145:0/901004509 shutdown_connections 2024-09-10T04:50:51.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 --2- 172.21.15.145:0/901004509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969d8ebd20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- 172.21.15.145:0/901004509 >> 172.21.15.145:0/901004509 conn(0x55969d9731d0 msgr2=0x55969da62ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- 172.21.15.145:0/901004509 shutdown_connections 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- 172.21.15.145:0/901004509 wait complete. 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969da71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb2692e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55969d979900 con 0x55969d977e00 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969da71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969da71ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38526/0 (socket says 172.21.15.145:38526) 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.131+0000 7fdb226dd640 1 -- 172.21.15.145:0/3219622442 learned_addr learned my addr 172.21.15.145:0/3219622442 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fdb226dd640 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969da72550 con 0x55969d977e00 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fdb226dd640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969da71ff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb140012f0 tx=0x7fdb14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fda0ee05640 1 -- 172.21.15.145:0/3219622442 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1400f9d0 con 0x55969d977e00 2024-09-10T04:50:51.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fda0ee05640 1 -- 172.21.15.145:0/3219622442 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1400fb70 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55969da727e0 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fda0ee05640 1 -- 172.21.15.145:0/3219622442 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1400fe50 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.132+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969da731e0 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fda0ee05640 1 -- 172.21.15.145:0/3219622442 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdb14017040 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fda0ee05640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fda0803c8d0 0x7fda0803ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fda0ee05640 1 -- 172.21.15.145:0/3219622442 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdb14015020 con 0x55969d977e00 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fdb21edc640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fda0803c8d0 0x7fda0803ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969d979210 0x55969da79640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969da79b80 con 0x55969d979210 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fdb22ede640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969d979210 0x55969da79640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.133+0000 7fdb21edc640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fda0803c8d0 0x7fda0803ed90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdb18057000 tx=0x7fdb18052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb22ede640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969d979210 0x55969da79640 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb22ede640 1 -- 172.21.15.145:0/3219622442 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969d979210 2024-09-10T04:50:51.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969da7a430 0x55969da7c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969da7d060 con 0x55969da7a430 2024-09-10T04:50:51.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb226dd640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969da7a430 0x55969da7c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.134+0000 7fdb226dd640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969da7a430 0x55969da7c8f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb226dd640 1 -- 172.21.15.145:0/3219622442 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb1402d070 con 0x55969da7a430 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969da7e910 con 0x55969d979210 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb22ede640 1 -- 172.21.15.145:0/3219622442 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969d979210 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969da7db40 con 0x55969da7a430 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb226dd640 1 -- 172.21.15.145:0/3219622442 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb1402d070 con 0x55969da7a430 2024-09-10T04:50:51.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55969da7fcc0 0x55969da820b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.135+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969da825f0 con 0x55969da7fcc0 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.136+0000 7fdb21edc640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55969da7fcc0 0x55969da820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.136+0000 7fdb21edc640 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55969da7fcc0 0x55969da820b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.136+0000 7fdb21edc640 1 -- 172.21.15.145:0/3219622442 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb18051070 con 0x55969da7fcc0 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.136+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb2692e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb2692e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55969d86fa00 con 0x55969da90170 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38528/0 (socket says 172.21.15.145:38528) 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb226dd640 1 -- 172.21.15.145:0/691728397 learned_addr learned my addr 172.21.15.145:0/691728397 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb226dd640 1 -- 172.21.15.145:0/691728397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969da90bd0 con 0x55969da90170 2024-09-10T04:50:51.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb226dd640 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c010 tx=0x7fdb1400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fda07fff640 1 -- 172.21.15.145:0/691728397 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1404b3d0 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fda07fff640 1 -- 172.21.15.145:0/691728397 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1401ace0 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55969da91400 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fda07fff640 1 -- 172.21.15.145:0/691728397 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1401c970 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.137+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969da919a0 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.138+0000 7fda07fff640 1 -- 172.21.15.145:0/691728397 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdb1401cb10 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.138+0000 7fda07fff640 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 0x7fd9fc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.138+0000 7fda07fff640 1 -- 172.21.15.145:0/691728397 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdb1403bd90 con 0x55969da90170 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.138+0000 7fdb21edc640 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 0x7fd9fc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb21edc640 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 0x7fd9fc03ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55969da73f20 tx=0x7fdb18005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb2692e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb2692e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55969da6d420 con 0x55969da9ca70 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38536/0 (socket says 172.21.15.145:38536) 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb226dd640 1 -- 172.21.15.145:0/3812703061 learned_addr learned my addr 172.21.15.145:0/3812703061 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb226dd640 1 -- 172.21.15.145:0/3812703061 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969da9d460 con 0x55969da9ca70 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.139+0000 7fdb226dd640 1 --2- 172.21.15.145:0/3812703061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401b710 tx=0x7fdb1401cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613940126657672c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fda05ffb640 1 -- 172.21.15.145:0/3812703061 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1402ec00 con 0x55969da9ca70 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fda05ffb640 1 -- 172.21.15.145:0/3812703061 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1402eda0 con 0x55969da9ca70 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fda05ffb640 1 -- 172.21.15.145:0/3812703061 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb14010c80 con 0x55969da9ca70 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- 172.21.15.145:0/3812703061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 msgr2=0x55969da9ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3812703061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401b710 tx=0x7fdb1401cf20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- 172.21.15.145:0/3812703061 shutdown_connections 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3812703061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969da9ce70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- 172.21.15.145:0/3812703061 >> 172.21.15.145:0/3812703061 conn(0x55969da98e70 msgr2=0x55969da970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- 172.21.15.145:0/3812703061 shutdown_connections 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- 172.21.15.145:0/3812703061 wait complete. 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 Processor -- start 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- start start 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.140+0000 7fdb2692e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55969da9d8d0 con 0x55969da9ca70 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb226dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38546/0 (socket says 172.21.15.145:38546) 2024-09-10T04:50:51.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 learned_addr learned my addr 172.21.15.145:0/2193550821 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969daa4430 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb226dd640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401b710 tx=0x7fdb14010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fd9f3fff640 1 -- 172.21.15.145:0/2193550821 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1406e070 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fd9f3fff640 1 -- 172.21.15.145:0/2193550821 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1403e380 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55969daa4430 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fd9f3fff640 1 -- 172.21.15.145:0/2193550821 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1402ec00 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.141+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969daa4430 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.142+0000 7fd9f3fff640 1 -- 172.21.15.145:0/2193550821 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdb14071070 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.142+0000 7fd9f3fff640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9ec03c780 0x7fd9ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fd9f3fff640 1 -- 172.21.15.145:0/2193550821 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdb14066070 con 0x55969da9ca70 2024-09-10T04:50:51.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb21edc640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9ec03c780 0x7fd9ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb21edc640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9ec03c780 0x7fd9ec03ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb18045f20 tx=0x7fdb1806b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969daaf3e0 0x55969dab18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab1ff0 con 0x55969daaf3e0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.143+0000 7fdb22ede640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969daaf3e0 0x55969dab18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb22ede640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969daaf3e0 0x55969dab18a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 realm 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969daae710 con 0x55969daaf3e0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab2a80 con 0x55969daaf3e0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969dab3860 0x55969dab5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab62b0 con 0x55969dab3860 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.144+0000 7fdb226dd640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969dab3860 0x55969dab5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb226dd640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969dab3860 0x55969dab5c50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab6b00 con 0x55969daaf3e0 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 20 searching for the correct realm 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55969dab8870 0x55969dabaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.145+0000 7fdb21edc640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55969dab8870 0x55969dabaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb21edc640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55969dab8870 0x55969dabaca0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb226dd640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fdb14073060 0x7fdb14069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.146+0000 7fdb22ede640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fdb14073060 0x7fdb14069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fdb14073060 0x7fdb14069410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x7fdb14073060 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.147+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.148+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c00a4d0 con 0x55969daaf3e0 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.149+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.150+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.151+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969daaf3e0 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x7fdb14073060 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c030040 con 0x7fdb14073060 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.152+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.153+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.153+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.153+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.153+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab8870 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb370 con 0x55969dab3860 2024-09-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab74b0 con 0x55969daaf3e0 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.154+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c030040 con 0x55969daaf3e0 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab7d50 con 0x55969dab3860 2024-09-10T04:50:51.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dab70f0 con 0x7fdb14073060 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 zone default found 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 4 Realm: () 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 zonegroup default 2024-09-10T04:50:51.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.155+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dabb810 con 0x7fdb14073060 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dabd670 con 0x55969dab8870 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dabdb50 con 0x55969dab8870 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 started sync module instance, tier type = 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.156+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabcae0 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.158+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.158+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94105378737872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabe460 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.158+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabecb0 con 0x55969daaf3e0 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.158+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94105378737872] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.159+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.159+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94105378742192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabe900 con 0x55969daaf3e0 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.159+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabf420 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.160+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94105378742192] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.160+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.160+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94105378746096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabf3e0 con 0x55969dab3860 2024-09-10T04:50:51.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.160+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabfed0 con 0x7fdb14073060 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.161+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.161+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94105378748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabfed0 con 0x7fdb14073060 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.161+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac0e70 con 0x55969dab3860 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.161+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94105378746096] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.162+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94105378748896] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.162+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.162+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94105378751216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac0e30 con 0x55969dab3860 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.162+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac1710 con 0x55969dab8870 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.163+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.163+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94105378755168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac0e30 con 0x55969dab8870 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.163+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac2670 con 0x55969dab8870 2024-09-10T04:50:51.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.163+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94105378751216] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.164+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94105378755168] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.164+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.164+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94105378759040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac2a90 con 0x55969dab8870 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.164+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac32e0 con 0x7fdb14073060 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94105378761840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac3750 con 0x7fdb14073060 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=0 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=1 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=2 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=3 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=4 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb2692e800 20 add_watcher() i=5 2024-09-10T04:50:51.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.165+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94105378759040] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.166+0000 7fdb2692e800 20 add_watcher() i=6 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.166+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94105378761840] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.166+0000 7fdb2692e800 20 add_watcher() i=7 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.166+0000 7fdb2692e800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.166+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dac0940 con 0x55969daaf3e0 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.167+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.167+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94105378763152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac0940 con 0x55969daaf3e0 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.168+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94105378763152] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.168+0000 7fd9d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.168+0000 7fdb2692e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.168+0000 7fdb2692e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:51.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.168+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacf110 con 0x55969dab3860 2024-09-10T04:50:51.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.169+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.169+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacf110 con 0x7fdb14073060 2024-09-10T04:50:51.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.170+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.170+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacf110 con 0x55969dab8870 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.171+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.172+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacfb30 con 0x55969daaf3e0 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.172+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'189 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.172+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacff30 con 0x55969dab3860 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.173+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.173+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dacff70 con 0x55969dab8870 2024-09-10T04:50:51.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.174+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.174+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad05c0 con 0x55969dab3860 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.176+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.176+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad05a0 con 0x55969daaf3e0 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.177+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.177+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad0b70 con 0x55969dab3860 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.178+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.178+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad0b10 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.178+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.179+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad0b10 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.179+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.180+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad0b10 con 0x55969dab8870 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.181+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.181+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1080 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.182+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.182+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad14e0 con 0x55969daaf3e0 2024-09-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.183+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.183+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1250 con 0x55969daaf3e0 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.184+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'190 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.184+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1250 con 0x55969dab3860 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.185+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.185+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1250 con 0x55969dab3860 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.186+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.186+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1270 con 0x55969dab8870 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.187+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.187+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad13a0 con 0x55969dab3860 2024-09-10T04:50:51.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.188+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.188+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad13a0 con 0x55969daaf3e0 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.189+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'191 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.189+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad13a0 con 0x55969dab3860 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.190+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.190+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad13a0 con 0x55969dab3860 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.191+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.191+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad13a0 con 0x55969dab8870 2024-09-10T04:50:51.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.192+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.192+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad14d0 con 0x55969dab3860 2024-09-10T04:50:51.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.193+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.193+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad14d0 con 0x55969dab8870 2024-09-10T04:50:51.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.194+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.194+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad15c0 con 0x55969dab8870 2024-09-10T04:50:51.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.195+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.195+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad15c0 con 0x55969dab8870 2024-09-10T04:50:51.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.196+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.196+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad15a0 con 0x55969dab3860 2024-09-10T04:50:51.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.197+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.197+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1560 con 0x55969daaf3e0 2024-09-10T04:50:51.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.198+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.198+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1560 con 0x55969dab3860 2024-09-10T04:50:51.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.199+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.199+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad1560 con 0x55969daaf3e0 2024-09-10T04:50:51.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.200+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.200+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dad15c0 con 0x7fdb14073060 2024-09-10T04:50:51.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fd9537fe640 20 reqs_thread_entry: start 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb2692e800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb2692e800 20 Filter name: none 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fd9517fa640 20 reqs_thread_entry: start 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb2692e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.201+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dafc4e0 con 0x7fdb14073060 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:50:51.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 : miss 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:95 8.d 8:b0f3c458:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969dafdf50 con 0x7fdb14073060 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(95 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 info.flags=0x17 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 to cache LRU end 2024-09-10T04:50:51.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:51.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:50:51.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 2024-09-10T04:50:51.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.202+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 4.26 4:66cfa2d4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7b440 con 0x55969daaf3e0 2024-09-10T04:50:51.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.203+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(96 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.203+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 4.31 4:8e79b240:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7b440 con 0x55969dab3860 2024-09-10T04:50:51.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.203+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(97 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.203+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7b440 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb2692e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 4.2b 4:d7613517:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7b4b0 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(99 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 4.25 4:a4166f93:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ba80 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(100 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.204+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:101 4.2f 4:f5100425:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ba80 con 0x55969daaf3e0 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(101 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ba80 con 0x7fdb14073060 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(102 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb2692e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:103 4.10 4:08e066d9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ba80 con 0x55969dab8870 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(103 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.205+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:104 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ba80 con 0x55969daaf3e0 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(104 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb2692e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:105 4.3 4:c129ded8:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7c0d0 con 0x7fdb14073060 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(105 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:106 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7c0d0 con 0x55969daaf3e0 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.206+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(106 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [call out=702b] v0'0 uv15 ondisk = 0) ==== 195+0+702 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:107 3.25s0 3:a7f35b2b:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db78df0 con 0x55969daaf3e0 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(107 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 10 manifest: total_size = 6 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.12427851880483498526 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 20 prepare_atomic_modification: state is not atomic. state=0x55969db7a8f8 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.207+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db03290 con 0x55969dab3860 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.208+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(108 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb14070030 con 0x55969dab3860 2024-09-10T04:50:51.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.208+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:109 3.25s0 3:a7f35b2b:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db032f0 con 0x55969daaf3e0 2024-09-10T04:50:51.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(109 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_9c8454ddf7aa50116496bac348d7550d [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:110 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db03bc0 con 0x55969dab3860 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:111 3.3fs0 3:fe4f9e9c:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db03bc0 con 0x55969dab3860 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(111 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 10 manifest: total_size = 3 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.1773837337102064832 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 20 prepare_atomic_modification: state is not atomic. state=0x55969db7a8f8 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.210+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:112 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08840 con 0x7fdb14073060 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.211+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(110 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.211+0000 7fda05ffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.211+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(112 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.211+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:113 3.3fs0 3:fe4f9e9c:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969daffba0 con 0x55969dab3860 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.212+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(113 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.212+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:114 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969daffba0 con 0x7fdb14073060 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.212+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.212+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:115 3.22s0 3:454ba8b9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969daffba0 con 0x55969dab8870 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(115 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 10 manifest: total_size = 4 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.16673374144376385647 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 20 prepare_atomic_modification: state is not atomic. state=0x55969db7a8f8 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 2024-09-10T04:50:51.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.213+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:116 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08390 con 0x55969daaf3e0 2024-09-10T04:50:51.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.214+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(114 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.214+0000 7fda057fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-10T04:50:51.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.214+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(116 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.214+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:117 3.22s0 3:454ba8b9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dafffc0 con 0x55969dab8870 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.215+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(117 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.215+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:118 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db05360 con 0x55969daaf3e0 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.215+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.215+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:119 3.35s0 3:aeef435c:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db05b00 con 0x55969dab3860 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(119 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 10 manifest: total_size = 5 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.12822088527599075272 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 20 prepare_atomic_modification: state is not atomic. state=0x55969db7a8f8 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.216+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:120 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db07b20 con 0x55969daaf3e0 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.217+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(118 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.217+0000 7fda05ffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T04:50:51.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.217+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(120 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [stat,call,call] v34'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.217+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:121 3.35s0 3:aeef435c:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db080c0 con 0x55969dab3860 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.218+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(121 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:122 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db080c0 con 0x55969daaf3e0 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:123 3.3es0 3:7d249ec9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db080c0 con 0x55969daaf3e0 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(123 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 10 manifest: total_size = 5 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 20 get_obj_state: setting s->obj_tag to _Je93jnNENuHmVDaVdfU20fUpm4RKFNN 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 20 get_obj_state: octx=0x7fdb1c00ab10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55969db7a8f8 s->prefetch_data=0 2024-09-10T04:50:51.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 20 prepare_atomic_modification: state is not atomic. state=0x55969db7a8f8 2024-09-10T04:50:51.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 2024-09-10T04:50:51.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.219+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:124 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db07ce0 con 0x55969daaf3e0 2024-09-10T04:50:51.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.220+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(122 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [stat,call,call] v34'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.220+0000 7fda057fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-10T04:50:51.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.220+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(124 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [stat,call,call] v34'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.220+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:125 3.3es0 3:7d249ec9:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db080c0 con 0x55969daaf3e0 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.221+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(125 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.221+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:126 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db05810 con 0x55969daaf3e0 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.221+0000 7fdb2692e800 20 list_objects_ordered: starting attempt 1 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.221+0000 7fdb2692e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.221+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:127 4.26 4:66cfa2d4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db05810 con 0x55969daaf3e0 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:128 4.31 4:8e79b240:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db05810 con 0x55969dab3860 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:129 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db05810 con 0x55969dab3860 2024-09-10T04:50:51.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:130 4.2b 4:d7613517:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db05810 con 0x55969dab3860 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:131 4.25 4:a4166f93:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db11760 con 0x55969dab3860 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:132 4.2f 4:f5100425:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x55969daaf3e0 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:133 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x7fdb14073060 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:134 4.10 4:08e066d9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db19720 con 0x55969dab8870 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:135 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db1c580 con 0x55969daaf3e0 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(128 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:136 4.3 4:c129ded8:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db1f400 con 0x7fdb14073060 2024-09-10T04:50:51.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:137 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db22280 con 0x55969daaf3e0 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(133 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(129 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(136 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(130 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.222+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(131 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(134 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(127 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(132 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(135 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(126 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fda057fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(137 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [call out=128b] v0'0 uv19 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5])"; uploads.size()=0; is_truncated=0 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:138 4.26 4:66cfa2d4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x55969daaf3e0 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:139 4.31 4:8e79b240:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db19130 con 0x55969dab3860 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:140 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db790b0 con 0x55969dab3860 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:141 4.2b 4:d7613517:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x55969dab3860 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:142 4.25 4:a4166f93:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db19130 con 0x55969dab3860 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:143 4.2f 4:f5100425:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db13bf0 con 0x55969daaf3e0 2024-09-10T04:50:51.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:144 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x7fdb14073060 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:145 4.10 4:08e066d9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db19130 con 0x55969dab8870 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:146 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ac90 con 0x55969daaf3e0 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(138 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.223+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:147 4.3 4:c129ded8:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x7fdb14073060 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:148 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db19110 con 0x55969daaf3e0 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(144 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(145 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(143 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(140 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(146 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(139 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(142 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== osd_op_reply(147 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(141 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(148 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [call out=128b] v0'0 uv19 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.224+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x7fdb14073060 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.225+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.225+0000 7fdb2692e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-10T04:50:51.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.225+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x7fdb14073060 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb2692e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb2692e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94105379508400 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db14440 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== watch-notify(notify (1) cookie 94105378759040 notify 146028888076 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55969dad0eb0 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fda057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94105378759040 notifier 4650 bl.length()=149 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fda057fa640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd958003320 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.226+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(151 notify.6 [notify cookie 94105379508400 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.227+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.227+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== watch-notify(notify_complete (2) cookie 94105379508400 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55969dacffc0 con 0x55969dab8870 2024-09-10T04:50:51.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.227+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:153 8.d 8:b0f3c458:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08800 con 0x7fdb14073060 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== osd_op_reply(153 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 from cache 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5, ofs0, ns] 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify cookie 94105379508400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db08800 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 48 ==== watch-notify(notify (1) cookie 94105378742192 notify 146028888075 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55969dafc390 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fda05ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94105378742192 notifier 4650 bl.length()=206 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fda05ffb640 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:155 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9e8003d60 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 49 ==== osd_op_reply(154 notify.1 [notify cookie 94105379508400 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 50 ==== watch-notify(notify_complete (2) cookie 94105379508400 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55969dad0940 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 51 ==== osd_op_reply(155 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:156 4.26 4:66cfa2d4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08800 con 0x55969daaf3e0 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:157 4.31 4:8e79b240:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db19620 con 0x55969dab3860 2024-09-10T04:50:51.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:158 4.d 4:b125195b:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db1eca0 con 0x55969dab3860 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:159 4.2b 4:d7613517:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db7a7e0 con 0x55969dab3860 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:160 4.25 4:a4166f93:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08800 con 0x55969dab3860 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:161 4.2f 4:f5100425:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ac10 con 0x55969daaf3e0 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:162 4.13 4:ca5ab614:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db1eca0 con 0x7fdb14073060 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:163 4.10 4:08e066d9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dafb020 con 0x55969dab8870 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.228+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:164 4.2a 4:54f3c099:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db7a7e0 con 0x55969daaf3e0 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.229+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:165 4.3 4:c129ded8:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db1eca0 con 0x7fdb14073060 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.229+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:166 4.12 4:4a227718:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db7ac10 con 0x55969daaf3e0 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(157 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.1 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(162 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 52 ==== osd_op_reply(164 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(159 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 53 ==== osd_op_reply(166 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.10 [delete] v34'20 uv20 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(158 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(160 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.4 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(163 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.230+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(165 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.9 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 54 ==== osd_op_reply(156 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 55 ==== osd_op_reply(161 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 : miss 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:167 6.9 6:97771c7d:::pubsub..bucket.myfoo%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55969db08730 con 0x55969dab8870 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(167 pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 info.flags=0x0 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 10 adding default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 to cache LRU end 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.231+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:168 6.9 6:97771c7d:::pubsub..bucket.myfoo%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08730 con 0x55969dab8870 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.233+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(168 pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.5 [delete] v34'55 uv48 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.233+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08730 con 0x7fdb14073060 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.234+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 31 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.235+0000 7fd9d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.235+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94105378763152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969db08730 con 0x55969daaf3e0 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.236+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 56 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94105378763152] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.236+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94105378737872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac3150 con 0x55969dab3860 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.237+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94105378737872] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.237+0000 7fdb2692e800 20 remove_watcher() i=0 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.237+0000 7fdb2692e800 2 removed watcher, disabling cache 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.237+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94105378742192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabced0 con 0x55969daaf3e0 2024-09-10T04:50:51.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.238+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.1 v2:172.21.15.145:6808/819540050 57 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94105378742192] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x55969daaf3e0 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.238+0000 7fdb2692e800 20 remove_watcher() i=1 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.238+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94105378746096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabced0 con 0x55969dab3860 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.239+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94105378746096] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.239+0000 7fdb2692e800 20 remove_watcher() i=2 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.239+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94105378748896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabeef0 con 0x7fdb14073060 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.240+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 32 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94105378748896] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.240+0000 7fdb2692e800 20 remove_watcher() i=3 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.240+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94105378751216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabced0 con 0x55969dab3860 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.241+0000 7fdb226dd640 1 -- 172.21.15.145:0/2193550821 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94105378751216] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1409b390 con 0x55969dab3860 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.241+0000 7fdb2692e800 20 remove_watcher() i=4 2024-09-10T04:50:51.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.241+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94105378755168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabeef0 con 0x55969dab8870 2024-09-10T04:50:51.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.242+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94105378755168] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.242+0000 7fdb2692e800 20 remove_watcher() i=5 2024-09-10T04:50:51.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.242+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94105378759040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dac02f0 con 0x55969dab8870 2024-09-10T04:50:51.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.243+0000 7fdb21edc640 1 -- 172.21.15.145:0/2193550821 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94105378759040] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb18051070 con 0x55969dab8870 2024-09-10T04:50:51.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.243+0000 7fdb2692e800 20 remove_watcher() i=6 2024-09-10T04:50:51.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.243+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94105378761840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55969dabced0 con 0x7fdb14073060 2024-09-10T04:50:51.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.244+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 <== osd.2 v2:172.21.15.145:6816/1789112018 33 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94105378761840] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c041040 con 0x7fdb14073060 2024-09-10T04:50:51.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 20 remove_watcher() i=7 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969dab3860 msgr2=0x55969dab5c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969dab3860 0x55969dab5c50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969daaf3e0 msgr2=0x55969dab18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969daaf3e0 0x55969dab18a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fdb14073060 msgr2=0x7fdb14069410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fdb14073060 0x7fdb14069410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55969dab8870 msgr2=0x55969dabaca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55969dab8870 0x55969dabaca0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9ec03c780 msgr2=0x7fd9ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9ec03c780 0x7fd9ec03ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb18045f20 tx=0x7fdb1806b040 comp rx=0 tx=0).stop 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 msgr2=0x55969daa3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdb1401b710 tx=0x7fdb14010ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb22ede640 1 -- 172.21.15.145:0/2193550821 reap_dead start 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 shutdown_connections 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/2193550821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da9ca70 0x55969daa3ed0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 >> 172.21.15.145:0/2193550821 conn(0x55969da98e70 msgr2=0x55969da97080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 shutdown_connections 2024-09-10T04:50:51.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/2193550821 wait complete. 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 msgr2=0x7fd9fc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 0x7fd9fc03ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55969da73f20 tx=0x7fdb18005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 msgr2=0x55969da90590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c010 tx=0x7fdb1400e940 comp rx=0 tx=0).stop 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 shutdown_connections 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fd9fc03c730 0x7fd9fc03ebf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 --2- 172.21.15.145:0/691728397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969da90170 0x55969da90590 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 >> 172.21.15.145:0/691728397 conn(0x55969da84520 msgr2=0x55969da84900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 shutdown_connections 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.245+0000 7fdb2692e800 1 -- 172.21.15.145:0/691728397 wait complete. 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969da7a430 msgr2=0x55969da7c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55969da7a430 0x55969da7c8f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969d979210 msgr2=0x55969da79640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55969d979210 0x55969da79640 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55969da7fcc0 msgr2=0x55969da820b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55969da7fcc0 0x55969da820b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fda0803c8d0 msgr2=0x7fda0803ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fda0803c8d0 0x7fda0803ed90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdb18057000 tx=0x7fdb18052000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 msgr2=0x55969da71ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 --2- 172.21.15.145:0/3219622442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55969d977e00 0x55969da71ff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb140012f0 tx=0x7fdb14000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb22ede640 1 -- 172.21.15.145:0/3219622442 reap_dead start 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 shutdown_connections 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 >> 172.21.15.145:0/3219622442 conn(0x55969d9731d0 msgr2=0x55969da614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 shutdown_connections 2024-09-10T04:50:51.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.246+0000 7fdb2692e800 1 -- 172.21.15.145:0/3219622442 wait complete. 2024-09-10T04:50:51.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T04:50:51.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T04:50:51.256 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-10T04:50:51.303 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:51.303 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:51.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.302+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.302+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.302+0000 7f3d13146800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555772bb9a70 0x555772c4db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.302+0000 7f3d13146800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555772aeee40 con 0x555772bb8f60 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.302+0000 7f3d13146800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x555772ab9680 con 0x555772bb9a70 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d0bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555772bb9a70 0x555772c4db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d10c37640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x555772bb8f60 0x555772bb9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51954/0 (socket says 172.21.15.145:51954) 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d10c37640 1 -- 172.21.15.145:0/2629121117 learned_addr learned my addr 172.21.15.145:0/2629121117 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d0bfff640 1 -- 172.21.15.145:0/2629121117 >> v1:172.21.15.98:6789/0 conn(0x555772bb8f60 legacy=0x555772bb9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d0b7fe640 1 -- 172.21.15.145:0/2629121117 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172335277 0 0) 0x555772aeee40 con 0x555772bb8f60 2024-09-10T04:50:51.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.303+0000 7f3d0bfff640 1 -- 172.21.15.145:0/2629121117 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772ad56b0 con 0x555772bb9a70 2024-09-10T04:50:51.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.305+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/2629121117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb9a70 0x555772c4db20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a470 tx=0x7f3cfc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361a12e27b3417c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.305+0000 7f3d0b7fe640 1 -- 172.21.15.145:0/2629121117 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cfc053570 con 0x555772bb9a70 2024-09-10T04:50:51.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.305+0000 7f3d0b7fe640 1 -- 172.21.15.145:0/2629121117 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc058070 con 0x555772bb9a70 2024-09-10T04:50:51.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.305+0000 7f3d0b7fe640 1 -- 172.21.15.145:0/2629121117 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cfc053880 con 0x555772bb9a70 2024-09-10T04:50:51.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 -- 172.21.15.145:0/2629121117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb9a70 msgr2=0x555772c4db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 --2- 172.21.15.145:0/2629121117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb9a70 0x555772c4db20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a470 tx=0x7f3cfc045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 -- 172.21.15.145:0/2629121117 shutdown_connections 2024-09-10T04:50:51.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 --2- 172.21.15.145:0/2629121117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb9a70 0x555772c4db20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 -- 172.21.15.145:0/2629121117 >> 172.21.15.145:0/2629121117 conn(0x555772c403d0 msgr2=0x555772c42830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 -- 172.21.15.145:0/2629121117 shutdown_connections 2024-09-10T04:50:51.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.306+0000 7f3d13146800 1 -- 172.21.15.145:0/2629121117 wait complete. 2024-09-10T04:50:51.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d13146800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d13146800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555772adddd0 con 0x555772bb8f60 2024-09-10T04:50:51.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38572/0 (socket says 172.21.15.145:38572) 2024-09-10T04:50:51.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d10c37640 1 -- 172.21.15.145:0/3603755371 learned_addr learned my addr 172.21.15.145:0/3603755371 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.320+0000 7f3d10c37640 1 -- 172.21.15.145:0/3603755371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772af6e10 con 0x555772bb8f60 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.321+0000 7f3d10c37640 1 --2- 172.21.15.145:0/3603755371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001ea0 tx=0x7f3d0400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9384d1cd9bc330c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.321+0000 7f3bfee05640 1 -- 172.21.15.145:0/3603755371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04008070 con 0x555772bb8f60 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.321+0000 7f3bfee05640 1 -- 172.21.15.145:0/3603755371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0400d500 con 0x555772bb8f60 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.321+0000 7f3bfee05640 1 -- 172.21.15.145:0/3603755371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d0400d880 con 0x555772bb8f60 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- 172.21.15.145:0/3603755371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 msgr2=0x555772d36620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 --2- 172.21.15.145:0/3603755371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001ea0 tx=0x7f3d0400b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- 172.21.15.145:0/3603755371 shutdown_connections 2024-09-10T04:50:51.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 --2- 172.21.15.145:0/3603755371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d36620 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- 172.21.15.145:0/3603755371 >> 172.21.15.145:0/3603755371 conn(0x555772c403d0 msgr2=0x555772d31fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- 172.21.15.145:0/3603755371 shutdown_connections 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- 172.21.15.145:0/3603755371 wait complete. 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d3df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d13146800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555772c4e330 con 0x555772bb8f60 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d3df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d3df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38586/0 (socket says 172.21.15.145:38586) 2024-09-10T04:50:51.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.322+0000 7f3d10c37640 1 -- 172.21.15.145:0/4271913196 learned_addr learned my addr 172.21.15.145:0/4271913196 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3d10c37640 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772d3e4d0 con 0x555772bb8f60 2024-09-10T04:50:51.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3d10c37640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d3df70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000f60 tx=0x7f3d04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3bfd602640 1 -- 172.21.15.145:0/4271913196 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d0400f8d0 con 0x555772bb8f60 2024-09-10T04:50:51.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3bfd602640 1 -- 172.21.15.145:0/4271913196 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0400fa70 con 0x555772bb8f60 2024-09-10T04:50:51.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555772d3e760 con 0x555772bb8f60 2024-09-10T04:50:51.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3bfd602640 1 -- 172.21.15.145:0/4271913196 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d0400fd50 con 0x555772bb8f60 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.323+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772d3f160 con 0x555772bb8f60 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3bfd602640 1 -- 172.21.15.145:0/4271913196 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d04017040 con 0x555772bb8f60 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3bfd602640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bf803c730 0x7f3bf803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3bfd602640 1 -- 172.21.15.145:0/4271913196 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3d04015020 con 0x555772bb8f60 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bf803c730 0x7f3bf803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772bb9a70 0x555772d455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d45b00 con 0x555772bb9a70 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.324+0000 7f3d11438640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772bb9a70 0x555772d455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bf803c730 0x7f3bf803ebf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc057000 tx=0x7f3cfc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d11438640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772bb9a70 0x555772d455c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d11438640 1 -- 172.21.15.145:0/4271913196 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772bb9a70 2024-09-10T04:50:51.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d463b0 0x555772d48840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d48fb0 con 0x555772d463b0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.325+0000 7f3d10c37640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d463b0 0x555772d48840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.326+0000 7f3d10c37640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d463b0 0x555772d48840 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.326+0000 7f3d10c37640 1 -- 172.21.15.145:0/4271913196 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d463b0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.326+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d4a860 con 0x555772bb9a70 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.326+0000 7f3d11438640 1 -- 172.21.15.145:0/4271913196 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772bb9a70 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.326+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d49a90 con 0x555772d463b0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d10c37640 1 -- 172.21.15.145:0/4271913196 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d463b0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d4bc10 0x555772d4e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d4e540 con 0x555772d4bc10 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d4bc10 0x555772d4e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d4bc10 0x555772d4e000 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.327+0000 7f3d0bfff640 1 -- 172.21.15.145:0/4271913196 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d4bc10 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d13146800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d13146800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555772b3ba00 con 0x555772d5c090 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38590/0 (socket says 172.21.15.145:38590) 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d10c37640 1 -- 172.21.15.145:0/1735062753 learned_addr learned my addr 172.21.15.145:0/1735062753 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.328+0000 7f3d10c37640 1 -- 172.21.15.145:0/1735062753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772d5caf0 con 0x555772d5c090 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3d10c37640 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400eb00 tx=0x7f3d04052ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3bf67fc640 1 -- 172.21.15.145:0/1735062753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04044bc0 con 0x555772d5c090 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3bf67fc640 1 -- 172.21.15.145:0/1735062753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d04044d60 con 0x555772d5c090 2024-09-10T04:50:51.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555772d5d320 con 0x555772d5c090 2024-09-10T04:50:51.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3bf67fc640 1 -- 172.21.15.145:0/1735062753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d040183d0 con 0x555772d5c090 2024-09-10T04:50:51.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772d5d8c0 con 0x555772d5c090 2024-09-10T04:50:51.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.329+0000 7f3bf67fc640 1 -- 172.21.15.145:0/1735062753 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d04018570 con 0x555772d5c090 2024-09-10T04:50:51.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3bf67fc640 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 0x7f3be803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3bf67fc640 1 -- 172.21.15.145:0/1735062753 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3d04053c70 con 0x555772d5c090 2024-09-10T04:50:51.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 0x7f3be803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 0x7f3be803ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x555772d3fe60 tx=0x7f3cfc005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d13146800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d13146800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555772d36e70 con 0x555772d68b70 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38606/0 (socket says 172.21.15.145:38606) 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.330+0000 7f3d10c37640 1 -- 172.21.15.145:0/1521961294 learned_addr learned my addr 172.21.15.145:0/1521961294 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d10c37640 1 -- 172.21.15.145:0/1521961294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772d69560 con 0x555772d68b70 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d10c37640 1 --2- 172.21.15.145:0/1521961294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d04026dd0 tx=0x7f3d040267f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2804a189f000fc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3be7fff640 1 -- 172.21.15.145:0/1521961294 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04018860 con 0x555772d68b70 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3be7fff640 1 -- 172.21.15.145:0/1521961294 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d040269b0 con 0x555772d68b70 2024-09-10T04:50:51.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3be7fff640 1 -- 172.21.15.145:0/1521961294 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04053980 con 0x555772d68b70 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 -- 172.21.15.145:0/1521961294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 msgr2=0x555772d68f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 --2- 172.21.15.145:0/1521961294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d04026dd0 tx=0x7f3d040267f0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 -- 172.21.15.145:0/1521961294 shutdown_connections 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 --2- 172.21.15.145:0/1521961294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d68b70 0x555772d68f70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 -- 172.21.15.145:0/1521961294 >> 172.21.15.145:0/1521961294 conn(0x555772d64f70 msgr2=0x555772d631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 -- 172.21.15.145:0/1521961294 shutdown_connections 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.331+0000 7f3d13146800 1 -- 172.21.15.145:0/1521961294 wait complete. 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d13146800 1 Processor -- start 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d13146800 1 -- start start 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d13146800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 0x555772d705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d13146800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555772d699d0 con 0x555772d701a0 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 0x555772d705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d10c37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 0x555772d705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38612/0 (socket says 172.21.15.145:38612) 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 learned_addr learned my addr 172.21.15.145:0/3552847896 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.332+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772d70b20 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3d10c37640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 0x555772d705c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3d04026ba0 tx=0x7f3d04053800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3be67fc640 1 -- 172.21.15.145:0/3552847896 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04018860 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3be67fc640 1 -- 172.21.15.145:0/3552847896 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0401a3c0 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3be67fc640 1 -- 172.21.15.145:0/3552847896 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d04030560 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555772d70b20 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772d70b20 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.333+0000 7f3be67fc640 1 -- 172.21.15.145:0/3552847896 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d0403e230 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3be67fc640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bdc03c6e0 0x7f3bdc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3be67fc640 1 -- 172.21.15.145:0/3552847896 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3d0405b030 con 0x555772d701a0 2024-09-10T04:50:51.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bdc03c6e0 0x7f3bdc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bdc03c6e0 0x7f3bdc03eba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc045f20 tx=0x7f3cfc06b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772d7bb10 0x555772d7dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d7e720 con 0x555772d7bb10 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.334+0000 7f3d11438640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772d7bb10 0x555772d7dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d11438640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772d7bb10 0x555772d7dfd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 realm 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d7ae40 con 0x555772d7bb10 2024-09-10T04:50:51.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d7f1b0 con 0x555772d7bb10 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d7ff90 0x555772d82380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.335+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d82a10 con 0x555772d7ff90 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d10c37640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d7ff90 0x555772d82380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d10c37640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d7ff90 0x555772d82380 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d83260 con 0x555772d7bb10 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 20 searching for the correct realm 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555772d84fd0 0x555772d87420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.336+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555772d84fd0 0x555772d87420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d0bfff640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555772d84fd0 0x555772d87420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d10c37640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d68b70 0x7f3d040733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.337+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d68b70 0x7f3d040733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d68b70 0x7f3d040733f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d68b70 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.338+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.339+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c00a4d0 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.340+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.341+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.342+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.343+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d68b70 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d68b70 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d84fd0 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.344+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555772d87af0 con 0x555772d7ff90 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d83bb0 con 0x555772d7bb10 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0c030040 con 0x555772d7bb10 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d837f0 con 0x555772d7ff90 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.345+0000 7f3d13146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d84550 con 0x555772d68b70 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 zone default found 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 4 Realm: () 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:51.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 zonegroup default 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d87f70 con 0x555772d68b70 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d89db0 con 0x555772d84fd0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.346+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d8a240 con 0x555772d84fd0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.347+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.347+0000 7f3d13146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.347+0000 7f3d13146800 20 started sync module instance, tier type = 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.347+0000 7f3d13146800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.347+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d89220 con 0x555772d7ff90 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.348+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.348+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834077312528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8ab50 con 0x555772d7ff90 2024-09-10T04:50:51.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.348+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8b3a0 con 0x555772d7bb10 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.349+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.349+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834077317968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8b540 con 0x555772d7bb10 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.349+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834077312528] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.349+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8bb30 con 0x555772d7ff90 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.350+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.350+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834077317968] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.350+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834077316768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8bb30 con 0x555772d7ff90 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.351+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8b010 con 0x555772d68b70 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.351+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.351+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834077324784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8b010 con 0x555772d68b70 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.351+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8d520 con 0x555772d7ff90 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.352+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834077316768] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.352+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834077324784] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.353+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.353+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834077325840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8b010 con 0x555772d7ff90 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.353+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8c010 con 0x555772d84fd0 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.354+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.354+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834077329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8e210 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.354+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834077325840] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.354+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8d070 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.355+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834077329728] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.355+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.355+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834077333408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8f070 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.355+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8f900 con 0x555772d68b70 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834077333408] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834077335792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d8f9c0 con 0x555772d68b70 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=0 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=1 2024-09-10T04:50:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=2 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=3 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=4 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=5 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.356+0000 7f3d13146800 20 add_watcher() i=6 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834077335792] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d13146800 20 add_watcher() i=7 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d13146800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772d92dc0 con 0x555772d7bb10 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.357+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834077337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772d902e0 con 0x555772d7bb10 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.358+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834077337312] v34'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.358+0000 7f3bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.358+0000 7f3d13146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.358+0000 7f3d13146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 5 note: GC not initialized 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3bc67e4640 20 reqs_thread_entry: start 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 20 Filter name: none 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3bbffff640 20 reqs_thread_entry: start 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772dc5d70 con 0x555772d7bb10 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:51.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.359+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dcbd50 con 0x555772d7bb10 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.360+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.360+0000 7f3d13146800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.360+0000 7f3d13146800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.360+0000 7f3d13146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93834077583216 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555772dc7690 con 0x555772d7ff90 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93834077325840 notify 146028888098 ret 0) ==== 621+0+0 (crc 0 0 0) 0x555772d5d8c0 con 0x555772d7ff90 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3be7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 93834077325840 notifier 4657 bl.length()=579 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3be7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3be7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3be7fff640 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3bd4003ea0 con 0x555772d7ff90 2024-09-10T04:50:51.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.361+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93834077583216 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.362+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.362+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93834077583216 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555772d5d320 con 0x555772d7ff90 2024-09-10T04:50:51.377 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.362+0000 7f3bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.362+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834077337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d7bb10 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.363+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93834077337312] v34'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.363+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834077312528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d7ff90 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.365+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93834077312528] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.365+0000 7f3d13146800 20 remove_watcher() i=0 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.365+0000 7f3d13146800 2 removed watcher, disabling cache 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.365+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834077317968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d7bb10 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.366+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93834077317968] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d7bb10 2024-09-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.366+0000 7f3d13146800 20 remove_watcher() i=1 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.366+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834077316768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d7ff90 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.367+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93834077316768] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.367+0000 7f3d13146800 20 remove_watcher() i=2 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.367+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834077324784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d68b70 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.368+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93834077324784] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.368+0000 7f3d13146800 20 remove_watcher() i=3 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.368+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834077325840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d7ff90 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.369+0000 7f3d10c37640 1 -- 172.21.15.145:0/3552847896 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93834077325840] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0402d070 con 0x555772d7ff90 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.369+0000 7f3d13146800 20 remove_watcher() i=4 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.369+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834077329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d84fd0 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.370+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93834077329728] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.370+0000 7f3d13146800 20 remove_watcher() i=5 2024-09-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.370+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834077333408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d84fd0 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.371+0000 7f3d0bfff640 1 -- 172.21.15.145:0/3552847896 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93834077333408] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc051070 con 0x555772d84fd0 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.371+0000 7f3d13146800 20 remove_watcher() i=6 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.371+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834077335792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555772dc3c10 con 0x555772d68b70 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93834077335792] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0c041040 con 0x555772d68b70 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 20 remove_watcher() i=7 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d7ff90 msgr2=0x555772d82380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d7ff90 0x555772d82380 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772d7bb10 msgr2=0x555772d7dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772d7bb10 0x555772d7dfd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d68b70 msgr2=0x7f3d040733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d68b70 0x7f3d040733f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555772d84fd0 msgr2=0x555772d87420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555772d84fd0 0x555772d87420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bdc03c6e0 msgr2=0x7f3bdc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bdc03c6e0 0x7f3bdc03eba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc045f20 tx=0x7f3cfc06b040 comp rx=0 tx=0).stop 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 msgr2=0x555772d705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 --2- 172.21.15.145:0/3552847896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d701a0 0x555772d705c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3d04026ba0 tx=0x7f3d04053800 comp rx=0 tx=0).stop 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 reap_dead start 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d11438640 1 -- 172.21.15.145:0/3552847896 reap_dead start 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 shutdown_connections 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.372+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 >> 172.21.15.145:0/3552847896 conn(0x555772d64f70 msgr2=0x555772d63180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 shutdown_connections 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/3552847896 wait complete. 2024-09-10T04:50:51.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 msgr2=0x7f3be803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 0x7f3be803ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x555772d3fe60 tx=0x7f3cfc005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 msgr2=0x555772d5c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400eb00 tx=0x7f3d04052ec0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 shutdown_connections 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3be803c780 0x7f3be803ec40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/1735062753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772d5c090 0x555772d5c4b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 >> 172.21.15.145:0/1735062753 conn(0x555772d50440 msgr2=0x555772d50820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 shutdown_connections 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/1735062753 wait complete. 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d463b0 msgr2=0x555772d48840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555772d463b0 0x555772d48840 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772bb9a70 msgr2=0x555772d455c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555772bb9a70 0x555772d455c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d4bc10 msgr2=0x555772d4e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555772d4bc10 0x555772d4e000 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bf803c730 msgr2=0x7f3bf803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3bf803c730 0x7f3bf803ebf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc057000 tx=0x7f3cfc052000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 msgr2=0x555772d3df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 --2- 172.21.15.145:0/4271913196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555772bb8f60 0x555772d3df70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000f60 tx=0x7f3d04000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d11438640 1 -- 172.21.15.145:0/4271913196 reap_dead start 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 shutdown_connections 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.373+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 >> 172.21.15.145:0/4271913196 conn(0x555772c403d0 msgr2=0x555772d37900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.374+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 shutdown_connections 2024-09-10T04:50:51.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.374+0000 7f3d13146800 1 -- 172.21.15.145:0/4271913196 wait complete. 2024-09-10T04:50:51.388 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:51.389 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T04:50:51.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T04:50:51.389 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-10T04:50:51.436 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:51.436 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.435+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.435+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.435+0000 7f756d820800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fe7a17afc0 0x55fe7a183ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.435+0000 7f756d820800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe7a024e40 con 0x55fe7a1794a0 2024-09-10T04:50:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.435+0000 7f756d820800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55fe79fef680 con 0x55fe7a17afc0 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f7562b10640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fe7a17afc0 0x55fe7a183ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f7562b10640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55fe7a17afc0 0x55fe7a183ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38616/0 (socket says 172.21.15.145:38616) 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f756b311640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55fe7a1794a0 0x55fe7a1798a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51956/0 (socket says 172.21.15.145:51956) 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f7562b10640 1 -- 172.21.15.145:0/26888568 learned_addr learned my addr 172.21.15.145:0/26888568 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f7562b10640 1 -- 172.21.15.145:0/26888568 >> v1:172.21.15.98:6789/0 conn(0x55fe7a1794a0 legacy=0x55fe7a1798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f7562b10640 1 -- 172.21.15.145:0/26888568 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a00b6b0 con 0x55fe7a17afc0 2024-09-10T04:50:51.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.436+0000 7f756ab10640 1 -- 172.21.15.145:0/26888568 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052016906 0 0) 0x55fe7a024e40 con 0x55fe7a1794a0 2024-09-10T04:50:51.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f7562b10640 1 --2- 172.21.15.145:0/26888568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a17afc0 0x55fe7a183ae0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f755400a520 tx=0x7f7554045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822bdac991a4abd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756ab10640 1 -- 172.21.15.145:0/26888568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7554055070 con 0x55fe7a17afc0 2024-09-10T04:50:51.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756ab10640 1 -- 172.21.15.145:0/26888568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75540515b0 con 0x55fe7a17afc0 2024-09-10T04:50:51.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756ab10640 1 -- 172.21.15.145:0/26888568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75540518d0 con 0x55fe7a17afc0 2024-09-10T04:50:51.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756d820800 1 -- 172.21.15.145:0/26888568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a17afc0 msgr2=0x55fe7a183ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756d820800 1 --2- 172.21.15.145:0/26888568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a17afc0 0x55fe7a183ae0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f755400a520 tx=0x7f7554045ba0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756d820800 1 -- 172.21.15.145:0/26888568 shutdown_connections 2024-09-10T04:50:51.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756d820800 1 --2- 172.21.15.145:0/26888568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a17afc0 0x55fe7a183ae0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.438+0000 7f756d820800 1 -- 172.21.15.145:0/26888568 >> 172.21.15.145:0/26888568 conn(0x55fe7a1751d0 msgr2=0x55fe7a177630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.439+0000 7f756d820800 1 -- 172.21.15.145:0/26888568 shutdown_connections 2024-09-10T04:50:51.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.439+0000 7f756d820800 1 -- 172.21.15.145:0/26888568 wait complete. 2024-09-10T04:50:51.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.452+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.452+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.452+0000 7f756d820800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.452+0000 7f756d820800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a013dd0 con 0x55fe7a1794a0 2024-09-10T04:50:51.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38630/0 (socket says 172.21.15.145:38630) 2024-09-10T04:50:51.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f756b311640 1 -- 172.21.15.145:0/3239540401 learned_addr learned my addr 172.21.15.145:0/3239540401 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f756b311640 1 -- 172.21.15.145:0/3239540401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a02ce10 con 0x55fe7a1794a0 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f756b311640 1 --2- 172.21.15.145:0/3239540401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f755c001ea0 tx=0x7f755c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb53bd89e0362b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f745960a640 1 -- 172.21.15.145:0/3239540401 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c008070 con 0x55fe7a1794a0 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f745960a640 1 -- 172.21.15.145:0/3239540401 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c00d500 con 0x55fe7a1794a0 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.453+0000 7f745960a640 1 -- 172.21.15.145:0/3239540401 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c00d880 con 0x55fe7a1794a0 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- 172.21.15.145:0/3239540401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 msgr2=0x55fe7a26c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 --2- 172.21.15.145:0/3239540401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f755c001ea0 tx=0x7f755c00b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- 172.21.15.145:0/3239540401 shutdown_connections 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 --2- 172.21.15.145:0/3239540401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a26c6d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- 172.21.15.145:0/3239540401 >> 172.21.15.145:0/3239540401 conn(0x55fe7a1751d0 msgr2=0x55fe7a268050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- 172.21.15.145:0/3239540401 shutdown_connections 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- 172.21.15.145:0/3239540401 wait complete. 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.454+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756d820800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a274020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756d820800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a1842f0 con 0x55fe7a1794a0 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a274020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a274020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38646/0 (socket says 172.21.15.145:38646) 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756b311640 1 -- 172.21.15.145:0/4091770074 learned_addr learned my addr 172.21.15.145:0/4091770074 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756b311640 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a274580 con 0x55fe7a1794a0 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f756b311640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a274020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f755c0012f0 tx=0x7f755c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.455+0000 7f7457e07640 1 -- 172.21.15.145:0/4091770074 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c00f9d0 con 0x55fe7a1794a0 2024-09-10T04:50:51.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.456+0000 7f7457e07640 1 -- 172.21.15.145:0/4091770074 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c00fb70 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.456+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7a274810 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.456+0000 7f7457e07640 1 -- 172.21.15.145:0/4091770074 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c00fe50 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.456+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7a275210 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.456+0000 7f7457e07640 1 -- 172.21.15.145:0/4091770074 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f755c017040 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f7457e07640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f745003c920 0x7f745003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f7457e07640 1 -- 172.21.15.145:0/4091770074 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f755c015020 con 0x55fe7a1794a0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f7562b10640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f745003c920 0x7f745003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a17afc0 0x55fe7a27b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a27bbb0 con 0x55fe7a17afc0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f756bb12640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a17afc0 0x55fe7a27b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f7562b10640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f745003c920 0x7f745003ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7554057000 tx=0x7f7554052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.457+0000 7f756bb12640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a17afc0 0x55fe7a27b670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.458+0000 7f756bb12640 1 -- 172.21.15.145:0/4091770074 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a17afc0 2024-09-10T04:50:51.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.458+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a27c460 0x55fe7a27e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.458+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a27f090 con 0x55fe7a27c460 2024-09-10T04:50:51.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.458+0000 7f756b311640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a27c460 0x55fe7a27e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.458+0000 7f756b311640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a27c460 0x55fe7a27e920 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756b311640 1 -- 172.21.15.145:0/4091770074 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755c02d070 con 0x55fe7a27c460 2024-09-10T04:50:51.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a280940 con 0x55fe7a17afc0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756bb12640 1 -- 172.21.15.145:0/4091770074 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a17afc0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a27fb70 con 0x55fe7a27c460 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756b311640 1 -- 172.21.15.145:0/4091770074 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755c02d070 con 0x55fe7a27c460 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fe7a281cf0 0x55fe7a2840e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a284620 con 0x55fe7a281cf0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.459+0000 7f7562b10640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fe7a281cf0 0x55fe7a2840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f7562b10640 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fe7a281cf0 0x55fe7a2840e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f7562b10640 1 -- 172.21.15.145:0/4091770074 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a281cf0 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f756d820800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.460+0000 7f756d820800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a071a00 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38658/0 (socket says 172.21.15.145:38658) 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756b311640 1 -- 172.21.15.145:0/194011541 learned_addr learned my addr 172.21.15.145:0/194011541 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756b311640 1 -- 172.21.15.145:0/194011541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a292bd0 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756b311640 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c010 tx=0x7f755c018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f7455602640 1 -- 172.21.15.145:0/194011541 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c04b330 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f7455602640 1 -- 172.21.15.145:0/194011541 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c01a3c0 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7a293400 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f7455602640 1 -- 172.21.15.145:0/194011541 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c044910 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.461+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7a2939a0 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.462+0000 7f7455602640 1 -- 172.21.15.145:0/194011541 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f755c044ab0 con 0x55fe7a292170 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.462+0000 7f7455602640 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 0x7f744403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.462+0000 7f7455602640 1 -- 172.21.15.145:0/194011541 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f755c03c5e0 con 0x55fe7a292170 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.462+0000 7f7562b10640 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 0x7f744403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.462+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f7562b10640 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 0x7f744403ec40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55fe7a275f50 tx=0x7f7554005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756d820800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756d820800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a26cf20 con 0x55fe7a29ec50 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38674/0 (socket says 172.21.15.145:38674) 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756b311640 1 -- 172.21.15.145:0/2510050387 learned_addr learned my addr 172.21.15.145:0/2510050387 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756b311640 1 -- 172.21.15.145:0/2510050387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a29f640 con 0x55fe7a29ec50 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f756b311640 1 --2- 172.21.15.145:0/2510050387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f755c01a6c0 tx=0x7f755c01a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df9286d09b6cd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f744effd640 1 -- 172.21.15.145:0/2510050387 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c026d50 con 0x55fe7a29ec50 2024-09-10T04:50:51.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f744effd640 1 -- 172.21.15.145:0/2510050387 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c02fd50 con 0x55fe7a29ec50 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.463+0000 7f744effd640 1 -- 172.21.15.145:0/2510050387 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c03fa10 con 0x55fe7a29ec50 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- 172.21.15.145:0/2510050387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 msgr2=0x55fe7a29f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 --2- 172.21.15.145:0/2510050387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f755c01a6c0 tx=0x7f755c01a8c0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- 172.21.15.145:0/2510050387 shutdown_connections 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 --2- 172.21.15.145:0/2510050387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a29f050 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- 172.21.15.145:0/2510050387 >> 172.21.15.145:0/2510050387 conn(0x55fe7a29b050 msgr2=0x55fe7a299290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- 172.21.15.145:0/2510050387 shutdown_connections 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- 172.21.15.145:0/2510050387 wait complete. 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 Processor -- start 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- start start 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a2a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756d820800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fe7a29fab0 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.464+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a2a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756b311640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a2a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38686/0 (socket says 172.21.15.145:38686) 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 learned_addr learned my addr 172.21.15.145:0/130616425 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7a2a65c0 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756b311640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a2a6060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f755c04bc40 tx=0x7f755c03a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f744d7fa640 1 -- 172.21.15.145:0/130616425 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c06c070 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f744d7fa640 1 -- 172.21.15.145:0/130616425 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c03fa10 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe7a2a65c0 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f744d7fa640 1 -- 172.21.15.145:0/130616425 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f755c026560 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.465+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7a2a65c0 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.466+0000 7f744d7fa640 1 -- 172.21.15.145:0/130616425 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f755c06f070 con 0x55fe7a29ec50 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.466+0000 7f744d7fa640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f743403c780 0x7f743403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.466+0000 7f744d7fa640 1 -- 172.21.15.145:0/130616425 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f755c072da0 con 0x55fe7a29ec50 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.466+0000 7f7562b10640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f743403c780 0x7f743403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f7562b10640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f743403c780 0x7f743403ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7554000c00 tx=0x7f7554053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a2b13b0 0x55fe7a2b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b3fc0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f756bb12640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a2b13b0 0x55fe7a2b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.467+0000 7f756bb12640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a2b13b0 0x55fe7a2b3870 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 realm 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b06e0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b4a50 con 0x55fe7a2b13b0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a2b5830 0x55fe7a2b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b82b0 con 0x55fe7a2b5830 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756b311640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a2b5830 0x55fe7a2b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.468+0000 7f756b311640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a2b5830 0x55fe7a2b7c20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b8b00 con 0x55fe7a2b13b0 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 20 searching for the correct realm 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fe7a2ba870 0x55fe7a2bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f7562b10640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fe7a2ba870 0x55fe7a2bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.469+0000 7f7562b10640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fe7a2ba870 0x55fe7a2bcc60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f756b311640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f755c071060 0x7f755c03c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f756bb12640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f755c071060 0x7f755c03c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.470+0000 7f756bb12640 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f755c071060 0x7f755c03c7e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f756400a4d0 con 0x7f755c071060 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.471+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f756400a4d0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.472+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.473+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.474+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b13b0 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.475+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x7f755c071060 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7564030040 con 0x7f755c071060 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.476+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2ba870 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.477+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd330 con 0x55fe7a2b5830 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b9480 con 0x55fe7a2b13b0 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7564030040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b9d20 con 0x55fe7a2b5830 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2b90c0 con 0x7f755c071060 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 zone default found 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 4 Realm: () 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:51.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 zonegroup default 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.478+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bd810 con 0x7f755c071060 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bf690 con 0x55fe7a2ba870 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bfb70 con 0x55fe7a2ba870 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 started sync module instance, tier type = 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.479+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2beae0 con 0x55fe7a2b5830 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.481+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.481+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94551459753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2be740 con 0x55fe7a2b5830 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.481+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c0990 con 0x55fe7a2b13b0 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.482+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.482+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94551459759232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c1230 con 0x55fe7a2b13b0 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.482+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94551459753680] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.482+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2bffd0 con 0x55fe7a2b5830 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.483+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94551459759232] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.483+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.483+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94551459761536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c11a0 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.483+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c11a0 con 0x7f755c071060 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.484+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.484+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94551459765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c2750 con 0x7f755c071060 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.484+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c3240 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.484+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94551459761536] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.485+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94551459765824] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.485+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.485+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94551459769616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c3200 con 0x55fe7a2b5830 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.485+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c3ae0 con 0x55fe7a2ba870 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.486+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.486+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94551459771952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c3200 con 0x55fe7a2ba870 2024-09-10T04:50:51.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.486+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94551459769616] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.487+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c49f0 con 0x55fe7a2ba870 2024-09-10T04:50:51.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.487+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94551459771952] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.488+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.488+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94551459774080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c4d90 con 0x55fe7a2ba870 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.488+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c5750 con 0x7f755c071060 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94551459779232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c5b70 con 0x7f755c071060 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=0 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=1 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=2 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=3 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=4 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=5 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94551459774080] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.489+0000 7f756d820800 20 add_watcher() i=6 2024-09-10T04:50:51.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94551459779232] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756d820800 20 add_watcher() i=7 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756d820800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c4500 con 0x55fe7a2b13b0 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.490+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94551459780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2c4500 con 0x55fe7a2b13b0 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.491+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94551459780288] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.491+0000 7f7421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.491+0000 7f756d820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.491+0000 7f756d820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 5 note: GC not initialized 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f7420fe1640 20 reqs_thread_entry: start 2024-09-10T04:50:51.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 20 Filter name: none 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f739a7fc640 20 reqs_thread_entry: start 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.492+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2fbca0 con 0x55fe7a2b13b0 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756d820800 20 rados_obj.operate() r=0 bl.length=403 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756d820800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756d820800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756d820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.493+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a301c60 con 0x55fe7a2b13b0 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756d820800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756d820800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756d820800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94551460026016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2fd5c0 con 0x55fe7a2b5830 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94551459769616 notify 146028888099 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55fe7a2939a0 con 0x55fe7a2b5830 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f744effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94551459769616 notifier 4664 bl.length()=567 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f744effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f744effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f744effd640 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7430003ea0 con 0x55fe7a2b5830 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94551460026016 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.494+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.495+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94551460026016 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fe7a293400 con 0x55fe7a2b5830 2024-09-10T04:50:51.509 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T04:50:28.016881Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:50:28.016869Z","tags":[],"group_ids":[]} 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.495+0000 7f7421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.495+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94551459780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2b13b0 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.496+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94551459780288] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.496+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94551459753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2b5830 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.497+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94551459753680] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.497+0000 7f756d820800 20 remove_watcher() i=0 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.497+0000 7f756d820800 2 removed watcher, disabling cache 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.497+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94551459759232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2b13b0 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.498+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94551459759232] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x55fe7a2b13b0 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.498+0000 7f756d820800 20 remove_watcher() i=1 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.498+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94551459761536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2b5830 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.499+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94551459761536] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.499+0000 7f756d820800 20 remove_watcher() i=2 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.499+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94551459765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x7f755c071060 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.500+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94551459765824] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.500+0000 7f756d820800 20 remove_watcher() i=3 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.500+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94551459769616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2b5830 2024-09-10T04:50:51.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.501+0000 7f756b311640 1 -- 172.21.15.145:0/130616425 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94551459769616] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f755c06e030 con 0x55fe7a2b5830 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.501+0000 7f756d820800 20 remove_watcher() i=4 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.501+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94551459771952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2ba870 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.502+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94551459771952] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.502+0000 7f756d820800 20 remove_watcher() i=5 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.502+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94551459774080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x55fe7a2ba870 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.503+0000 7f7562b10640 1 -- 172.21.15.145:0/130616425 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94551459774080] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7554057030 con 0x55fe7a2ba870 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.503+0000 7f756d820800 20 remove_watcher() i=6 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.503+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94551459779232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe7a2f9b40 con 0x7f755c071060 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.504+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94551459779232] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7564041040 con 0x7f755c071060 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.504+0000 7f756d820800 20 remove_watcher() i=7 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a2b5830 msgr2=0x55fe7a2b7c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a2b5830 0x55fe7a2b7c20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a2b13b0 msgr2=0x55fe7a2b3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a2b13b0 0x55fe7a2b3870 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f755c071060 msgr2=0x7f755c03c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f755c071060 0x7f755c03c7e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fe7a2ba870 msgr2=0x55fe7a2bcc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55fe7a2ba870 0x55fe7a2bcc60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f743403c780 msgr2=0x7f743403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f743403c780 0x7f743403ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7554000c00 tx=0x7f7554053000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 msgr2=0x55fe7a2a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/130616425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a29ec50 0x55fe7a2a6060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f755c04bc40 tx=0x7f755c03a840 comp rx=0 tx=0).stop 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 reap_dead start 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756bb12640 1 -- 172.21.15.145:0/130616425 reap_dead start 2024-09-10T04:50:51.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 shutdown_connections 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 >> 172.21.15.145:0/130616425 conn(0x55fe7a29b050 msgr2=0x55fe7a299260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 shutdown_connections 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/130616425 wait complete. 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 msgr2=0x7f744403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 0x7f744403ec40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55fe7a275f50 tx=0x7f7554005ac0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 msgr2=0x55fe7a292590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f755c00c010 tx=0x7f755c018e20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 shutdown_connections 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f744403c780 0x7f744403ec40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 --2- 172.21.15.145:0/194011541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a292170 0x55fe7a292590 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 >> 172.21.15.145:0/194011541 conn(0x55fe7a286520 msgr2=0x55fe7a286900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 shutdown_connections 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.505+0000 7f756d820800 1 -- 172.21.15.145:0/194011541 wait complete. 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a27c460 msgr2=0x55fe7a27e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55fe7a27c460 0x55fe7a27e920 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a17afc0 msgr2=0x55fe7a27b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55fe7a17afc0 0x55fe7a27b670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fe7a281cf0 msgr2=0x55fe7a2840e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55fe7a281cf0 0x55fe7a2840e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f745003c920 msgr2=0x7f745003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f745003c920 0x7f745003ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7554057000 tx=0x7f7554052000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 msgr2=0x55fe7a274020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 --2- 172.21.15.145:0/4091770074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fe7a1794a0 0x55fe7a274020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f755c0012f0 tx=0x7f755c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756bb12640 1 -- 172.21.15.145:0/4091770074 reap_dead start 2024-09-10T04:50:51.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 shutdown_connections 2024-09-10T04:50:51.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 >> 172.21.15.145:0/4091770074 conn(0x55fe7a1751d0 msgr2=0x55fe7a26d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 shutdown_connections 2024-09-10T04:50:51.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.506+0000 7f756d820800 1 -- 172.21.15.145:0/4091770074 wait complete. 2024-09-10T04:50:51.521 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T04:50:28.016881Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:50:28.016869Z', 'tags': [], 'group_ids': []} 2024-09-10T04:50:51.531 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:51.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:51.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T04:50:51.532 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T04:50:51.576 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:50:51.576 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.575+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.575+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f36eb9800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56057cb42fc0 0x56057cb4bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f36eb9800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56057c9ece40 con 0x56057cb414a0 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f36eb9800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x56057c9b7680 con 0x56057cb42fc0 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f2c1a2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56057cb42fc0 0x56057cb4bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f349a3640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x56057cb414a0 0x56057cb418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:51966/0 (socket says 172.21.15.145:51966) 2024-09-10T04:50:51.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f349a3640 1 -- 172.21.15.145:0/2100444532 learned_addr learned my addr 172.21.15.145:0/2100444532 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:50:51.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f2c1a2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x56057cb42fc0 0x56057cb4bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38698/0 (socket says 172.21.15.145:38698) 2024-09-10T04:50:51.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/2100444532 >> v1:172.21.15.98:6789/0 conn(0x56057cb414a0 legacy=0x56057cb418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f2ffff640 1 -- 172.21.15.145:0/2100444532 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489741396 0 0) 0x56057c9ece40 con 0x56057cb414a0 2024-09-10T04:50:51.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.576+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/2100444532 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057c9d36b0 con 0x56057cb42fc0 2024-09-10T04:50:51.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.578+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/2100444532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb42fc0 0x56057cb4bae0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00a470 tx=0x7f3f1c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82f5cc33a2c4941 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.578+0000 7f3f2ffff640 1 -- 172.21.15.145:0/2100444532 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c053570 con 0x56057cb42fc0 2024-09-10T04:50:51.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.578+0000 7f3f2ffff640 1 -- 172.21.15.145:0/2100444532 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c058070 con 0x56057cb42fc0 2024-09-10T04:50:51.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.578+0000 7f3f2ffff640 1 -- 172.21.15.145:0/2100444532 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c053880 con 0x56057cb42fc0 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 -- 172.21.15.145:0/2100444532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb42fc0 msgr2=0x56057cb4bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/2100444532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb42fc0 0x56057cb4bae0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00a470 tx=0x7f3f1c045a20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 -- 172.21.15.145:0/2100444532 shutdown_connections 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/2100444532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb42fc0 0x56057cb4bae0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 -- 172.21.15.145:0/2100444532 >> 172.21.15.145:0/2100444532 conn(0x56057cb3d1f0 msgr2=0x56057cb3f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 -- 172.21.15.145:0/2100444532 shutdown_connections 2024-09-10T04:50:51.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.579+0000 7f3f36eb9800 1 -- 172.21.15.145:0/2100444532 wait complete. 2024-09-10T04:50:51.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.592+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f36eb9800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f36eb9800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56057c9dbdd0 con 0x56057cb414a0 2024-09-10T04:50:51.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38702/0 (socket says 172.21.15.145:38702) 2024-09-10T04:50:51.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f349a3640 1 -- 172.21.15.145:0/3862469584 learned_addr learned my addr 172.21.15.145:0/3862469584 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.593+0000 7f3f349a3640 1 -- 172.21.15.145:0/3862469584 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057c9f4e10 con 0x56057cb414a0 2024-09-10T04:50:51.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f349a3640 1 --2- 172.21.15.145:0/3862469584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001ea0 tx=0x7f3f2400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da961bddffb2d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3e22e0d640 1 -- 172.21.15.145:0/3862469584 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24008070 con 0x56057cb414a0 2024-09-10T04:50:51.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3e22e0d640 1 -- 172.21.15.145:0/3862469584 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2400d500 con 0x56057cb414a0 2024-09-10T04:50:51.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3e22e0d640 1 -- 172.21.15.145:0/3862469584 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2400d880 con 0x56057cb414a0 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3862469584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 msgr2=0x56057cc34660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3862469584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001ea0 tx=0x7f3f2400b6a0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3862469584 shutdown_connections 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3862469584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc34660 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3862469584 >> 172.21.15.145:0/3862469584 conn(0x56057cb3d1f0 msgr2=0x56057cc2ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3862469584 shutdown_connections 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.594+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3862469584 wait complete. 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f36eb9800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc3bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f36eb9800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56057cb4c2f0 con 0x56057cb414a0 2024-09-10T04:50:51.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc3bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc3bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38716/0 (socket says 172.21.15.145:38716) 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f349a3640 1 -- 172.21.15.145:0/997322910 learned_addr learned my addr 172.21.15.145:0/997322910 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.595+0000 7f3f349a3640 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057cc3c4e0 con 0x56057cb414a0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3f349a3640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc3bf80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3f240012f0 tx=0x7f3f24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3e2160a640 1 -- 172.21.15.145:0/997322910 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2400f9d0 con 0x56057cb414a0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3e2160a640 1 -- 172.21.15.145:0/997322910 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2400fb70 con 0x56057cb414a0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56057cc3c770 con 0x56057cb414a0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3e2160a640 1 -- 172.21.15.145:0/997322910 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2400fe50 con 0x56057cb414a0 2024-09-10T04:50:51.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.596+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057cc3d170 con 0x56057cb414a0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3e2160a640 1 -- 172.21.15.145:0/997322910 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f24017040 con 0x56057cb414a0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3e2160a640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e1c03c920 0x7f3e1c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3e2160a640 1 -- 172.21.15.145:0/997322910 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3f24015020 con 0x56057cb414a0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e1c03c920 0x7f3e1c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cb42fc0 0x56057cc435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc43b10 con 0x56057cb42fc0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3f351a4640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cb42fc0 0x56057cc435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.597+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e1c03c920 0x7f3e1c03ede0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c057000 tx=0x7f3f1c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f351a4640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cb42fc0 0x56057cc435d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f351a4640 1 -- 172.21.15.145:0/997322910 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cb42fc0 2024-09-10T04:50:51.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc443c0 0x56057cc46880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc46ff0 con 0x56057cc443c0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f349a3640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc443c0 0x56057cc46880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.598+0000 7f3f349a3640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc443c0 0x56057cc46880 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f349a3640 1 -- 172.21.15.145:0/997322910 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f2402d070 con 0x56057cc443c0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc488a0 con 0x56057cb42fc0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f351a4640 1 -- 172.21.15.145:0/997322910 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cb42fc0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc47ad0 con 0x56057cc443c0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f349a3640 1 -- 172.21.15.145:0/997322910 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f2402d070 con 0x56057cc443c0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56057cc49c50 0x56057cc4c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc4c580 con 0x56057cc49c50 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.599+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56057cc49c50 0x56057cc4c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.600+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56057cc49c50 0x56057cc4c040 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.600+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/997322910 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f1c051070 con 0x56057cc49c50 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.600+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.600+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f36eb9800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f36eb9800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56057ca39a00 con 0x56057cc5a0d0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38720/0 (socket says 172.21.15.145:38720) 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f349a3640 1 -- 172.21.15.145:0/974529958 learned_addr learned my addr 172.21.15.145:0/974529958 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f349a3640 1 -- 172.21.15.145:0/974529958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057cc5ab30 con 0x56057cc5a0d0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f349a3640 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c010 tx=0x7f3f24018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3e1a7fc640 1 -- 172.21.15.145:0/974529958 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2404b330 con 0x56057cc5a0d0 2024-09-10T04:50:51.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3e1a7fc640 1 -- 172.21.15.145:0/974529958 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2401a3c0 con 0x56057cc5a0d0 2024-09-10T04:50:51.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56057cc5b360 con 0x56057cc5a0d0 2024-09-10T04:50:51.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3e1a7fc640 1 -- 172.21.15.145:0/974529958 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24044910 con 0x56057cc5a0d0 2024-09-10T04:50:51.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.601+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057cc5b900 con 0x56057cc5a0d0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.602+0000 7f3e1a7fc640 1 -- 172.21.15.145:0/974529958 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f24044ab0 con 0x56057cc5a0d0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.602+0000 7f3e1a7fc640 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 0x7f3e0c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.602+0000 7f3e1a7fc640 1 -- 172.21.15.145:0/974529958 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3f2403c5e0 con 0x56057cc5a0d0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.602+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 0x7f3e0c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 0x7f3e0c03ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56057cc3deb0 tx=0x7f3f1c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f36eb9800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f36eb9800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56057cc34eb0 con 0x56057cc66bb0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38722/0 (socket says 172.21.15.145:38722) 2024-09-10T04:50:51.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f349a3640 1 -- 172.21.15.145:0/745711505 learned_addr learned my addr 172.21.15.145:0/745711505 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f349a3640 1 -- 172.21.15.145:0/745711505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057cc675a0 con 0x56057cc66bb0 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3f349a3640 1 --2- 172.21.15.145:0/745711505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f2401a6c0 tx=0x7f3f2401a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291d0320bafd365d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3e0bfff640 1 -- 172.21.15.145:0/745711505 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24026d50 con 0x56057cc66bb0 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3e0bfff640 1 -- 172.21.15.145:0/745711505 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2402fd50 con 0x56057cc66bb0 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.603+0000 7f3e0bfff640 1 -- 172.21.15.145:0/745711505 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2403fa10 con 0x56057cc66bb0 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- 172.21.15.145:0/745711505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 msgr2=0x56057cc66fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/745711505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f2401a6c0 tx=0x7f3f2401a8c0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- 172.21.15.145:0/745711505 shutdown_connections 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/745711505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc66fb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- 172.21.15.145:0/745711505 >> 172.21.15.145:0/745711505 conn(0x56057cc62fb0 msgr2=0x56057cc611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- 172.21.15.145:0/745711505 shutdown_connections 2024-09-10T04:50:51.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- 172.21.15.145:0/745711505 wait complete. 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 Processor -- start 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- start start 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.604+0000 7f3f36eb9800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56057cc67a10 con 0x56057cc66bb0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f349a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:38736/0 (socket says 172.21.15.145:38736) 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 learned_addr learned my addr 172.21.15.145:0/3149147770 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057cc6e520 con 0x56057cc66bb0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f349a3640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3f2404bc40 tx=0x7f3f2403a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3e0a7fc640 1 -- 172.21.15.145:0/3149147770 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2406c070 con 0x56057cc66bb0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3e0a7fc640 1 -- 172.21.15.145:0/3149147770 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2403fa10 con 0x56057cc66bb0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56057cc6e520 con 0x56057cc66bb0 2024-09-10T04:50:51.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3e0a7fc640 1 -- 172.21.15.145:0/3149147770 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24026560 con 0x56057cc66bb0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.605+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057cc6e520 con 0x56057cc66bb0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.606+0000 7f3e0a7fc640 1 -- 172.21.15.145:0/3149147770 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f2406f070 con 0x56057cc66bb0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.606+0000 7f3e0a7fc640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0003c780 0x7f3e0003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.606+0000 7f3e0a7fc640 1 -- 172.21.15.145:0/3149147770 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3f24072da0 con 0x56057cc66bb0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.606+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0003c780 0x7f3e0003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0003c780 0x7f3e0003ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c000c00 tx=0x7f3f1c053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cc79300 0x56057cc7b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc7bf10 con 0x56057cc79300 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f351a4640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cc79300 0x56057cc7b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f351a4640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cc79300 0x56057cc7b7c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 20 realm 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.607+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc78630 con 0x56057cc79300 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc7c9a0 con 0x56057cc79300 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc7d780 0x56057cc7fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc80200 con 0x56057cc7d780 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.608+0000 7f3f349a3640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc7d780 0x56057cc7fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f349a3640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc7d780 0x56057cc7fb70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc80a50 con 0x56057cc79300 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 20 searching for the correct realm 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56057cc827c0 0x56057cc84bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56057cc827c0 0x56057cc84bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.609+0000 7f3f2c1a2640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56057cc827c0 0x56057cc84bb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f349a3640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3f24071060 0x7f3f2403c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f351a4640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3f24071060 0x7f3f2403c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.610+0000 7f3f351a4640 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3f24071060 0x7f3f2403c7e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f3000a4d0 con 0x7f3f24071060 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.611+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3000a4d0 con 0x56057cc79300 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.612+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.613+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.614+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.615+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc79300 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x7f3f24071060 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f30030040 con 0x7f3f24071060 2024-09-10T04:50:51.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.616+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc827c0 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.617+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85280 con 0x56057cc7d780 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc81400 con 0x56057cc79300 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f30030040 con 0x56057cc79300 2024-09-10T04:50:51.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc81ca0 con 0x56057cc7d780 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.618+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc81040 con 0x7f3f24071060 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 zone default found 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 4 Realm: () 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:50:51.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 zonegroup default 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc85790 con 0x7f3f24071060 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc875f0 con 0x56057cc827c0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc87ad0 con 0x56057cc827c0 2024-09-10T04:50:51.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 started sync module instance, tier type = 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.619+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc86a60 con 0x56057cc7d780 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.621+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.621+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581568335440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc883e0 con 0x56057cc7d780 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.621+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc88c30 con 0x56057cc79300 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.622+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581568335440] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.622+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.622+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581568339760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc88c70 con 0x56057cc79300 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.622+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc89780 con 0x56057cc7d780 2024-09-10T04:50:51.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.623+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581568339760] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.623+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.623+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581568344624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc89740 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.623+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8a210 con 0x7f3f24071060 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.624+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.624+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581568347360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8a1d0 con 0x7f3f24071060 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.624+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8b1d0 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.624+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581568344624] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.625+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581568347360] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.625+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.625+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581568349696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8b1d0 con 0x56057cc7d780 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.625+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8ba70 con 0x56057cc827c0 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.626+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.626+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581568349696] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.626+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581568353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8b1d0 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.626+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8ad40 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.627+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581568353728] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.627+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.627+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581568355856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8c940 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.627+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8d300 con 0x7f3f24071060 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581568355856] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581568358000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8d300 con 0x7f3f24071060 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=0 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=1 2024-09-10T04:50:51.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=2 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=3 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=4 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=5 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.629+0000 7f3f36eb9800 20 add_watcher() i=6 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581568358000] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f36eb9800 20 add_watcher() i=7 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f36eb9800 2 all 8 watchers are set, enabling cache 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057cc90760 con 0x56057cc79300 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.630+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581568360480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8dc20 con 0x56057cc79300 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.631+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581568360480] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.631+0000 7f3deafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.631+0000 7f3f36eb9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.631+0000 7f3f36eb9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.631+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc98f70 con 0x56057cc7d780 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.632+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.633+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc98fd0 con 0x7f3f24071060 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.633+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.633+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc99640 con 0x56057cc827c0 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.635+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.635+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc99a60 con 0x56057cc79300 2024-09-10T04:50:51.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.635+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'198 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.636+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc99fd0 con 0x56057cc7d780 2024-09-10T04:50:51.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.636+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.636+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc99fd0 con 0x56057cc827c0 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.638+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.638+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a540 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.639+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.639+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a540 con 0x56057cc79300 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.640+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.640+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a9f0 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.641+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.641+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a9f0 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.642+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.642+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a9f0 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.643+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.643+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc9a9f0 con 0x56057cc827c0 2024-09-10T04:50:51.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.644+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.644+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc96ee0 con 0x56057cc7d780 2024-09-10T04:50:51.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.645+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.645+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc96ee0 con 0x56057cc79300 2024-09-10T04:50:51.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.646+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.646+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc79300 2024-09-10T04:50:51.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.647+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'199 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.647+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.648+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.648+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.649+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.649+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc827c0 2024-09-10T04:50:51.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.650+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.650+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.651+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.651+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc79300 2024-09-10T04:50:51.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.652+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'200 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.652+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.653+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.654+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.654+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.655+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc827c0 2024-09-10T04:50:51.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.655+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.655+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.657+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.657+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc827c0 2024-09-10T04:50:51.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.658+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.658+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc827c0 2024-09-10T04:50:51.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.659+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.659+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc827c0 2024-09-10T04:50:51.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.660+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.660+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.661+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.661+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc79300 2024-09-10T04:50:51.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.662+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.662+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc97390 con 0x56057cc7d780 2024-09-10T04:50:51.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.663+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.663+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc96760 con 0x56057cc79300 2024-09-10T04:50:51.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.664+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.664+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc96760 con 0x7f3f24071060 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3de9fe3640 20 reqs_thread_entry: start 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f36eb9800 20 init_complete bucket index max shards: 11 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f36eb9800 20 Filter name: none 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3d5b7fe640 20 reqs_thread_entry: start 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f36eb9800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f36eb9800 20 rados->read ofs=0 len=0 2024-09-10T04:50:51.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.665+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057ccc60d0 con 0x56057cc79300 2024-09-10T04:50:51.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f36eb9800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f36eb9800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f36eb9800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f36eb9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56057ccc8590 con 0x7f3f24071060 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.666+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.667+0000 7f3deafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:50:51.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.667+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581568360480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc768a0 con 0x56057cc79300 2024-09-10T04:50:51.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.668+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94581568360480] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.668+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581568335440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8cff0 con 0x56057cc7d780 2024-09-10T04:50:51.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.669+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94581568335440] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.669+0000 7f3f36eb9800 20 remove_watcher() i=0 2024-09-10T04:50:51.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.669+0000 7f3f36eb9800 2 removed watcher, disabling cache 2024-09-10T04:50:51.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.669+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581568339760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc86e50 con 0x56057cc79300 2024-09-10T04:50:51.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.670+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94581568339760] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x56057cc79300 2024-09-10T04:50:51.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.670+0000 7f3f36eb9800 20 remove_watcher() i=1 2024-09-10T04:50:51.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.670+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581568344624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc87f30 con 0x56057cc7d780 2024-09-10T04:50:51.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.671+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94581568344624] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.671+0000 7f3f36eb9800 20 remove_watcher() i=2 2024-09-10T04:50:51.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.671+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581568347360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc87f30 con 0x7f3f24071060 2024-09-10T04:50:51.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.672+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94581568347360] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.672+0000 7f3f36eb9800 20 remove_watcher() i=3 2024-09-10T04:50:51.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.672+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581568349696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc87f30 con 0x56057cc7d780 2024-09-10T04:50:51.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.674+0000 7f3f349a3640 1 -- 172.21.15.145:0/3149147770 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94581568349696] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2406e030 con 0x56057cc7d780 2024-09-10T04:50:51.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.674+0000 7f3f36eb9800 20 remove_watcher() i=4 2024-09-10T04:50:51.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.674+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581568353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8a600 con 0x56057cc827c0 2024-09-10T04:50:51.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.675+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94581568353728] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.675+0000 7f3f36eb9800 20 remove_watcher() i=5 2024-09-10T04:50:51.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.675+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581568355856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8a600 con 0x56057cc827c0 2024-09-10T04:50:51.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.676+0000 7f3f2c1a2640 1 -- 172.21.15.145:0/3149147770 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94581568355856] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1c07c040 con 0x56057cc827c0 2024-09-10T04:50:51.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.676+0000 7f3f36eb9800 20 remove_watcher() i=6 2024-09-10T04:50:51.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.676+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581568358000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56057cc8be10 con 0x7f3f24071060 2024-09-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94581568358000] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f30041040 con 0x7f3f24071060 2024-09-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 20 remove_watcher() i=7 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc7d780 msgr2=0x56057cc7fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc7d780 0x56057cc7fb70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cc79300 msgr2=0x56057cc7b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cc79300 0x56057cc7b7c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3f24071060 msgr2=0x7f3f2403c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3f24071060 0x7f3f2403c7e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56057cc827c0 msgr2=0x56057cc84bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x56057cc827c0 0x56057cc84bb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0003c780 msgr2=0x7f3e0003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0003c780 0x7f3e0003ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c000c00 tx=0x7f3f1c053000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 msgr2=0x56057cc6dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f351a4640 1 -- 172.21.15.145:0/3149147770 reap_dead start 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3f2404bc40 tx=0x7f3f2403a840 comp rx=0 tx=0).stop 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 shutdown_connections 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/3149147770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc66bb0 0x56057cc6dfc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 >> 172.21.15.145:0/3149147770 conn(0x56057cc62fb0 msgr2=0x56057cc611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 shutdown_connections 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/3149147770 wait complete. 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 msgr2=0x7f3e0c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 0x7f3e0c03ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56057cc3deb0 tx=0x7f3f1c005a00 comp rx=0 tx=0).stop 2024-09-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 msgr2=0x56057cc5a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c010 tx=0x7f3f24018e20 comp rx=0 tx=0).stop 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 shutdown_connections 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e0c03c780 0x7f3e0c03ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/974529958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cc5a0d0 0x56057cc5a4f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.677+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 >> 172.21.15.145:0/974529958 conn(0x56057cc4e480 msgr2=0x56057cc4e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 shutdown_connections 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/974529958 wait complete. 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc443c0 msgr2=0x56057cc46880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x56057cc443c0 0x56057cc46880 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cb42fc0 msgr2=0x56057cc435d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x56057cb42fc0 0x56057cc435d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56057cc49c50 msgr2=0x56057cc4c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x56057cc49c50 0x56057cc4c040 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e1c03c920 msgr2=0x7f3e1c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3e1c03c920 0x7f3e1c03ede0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c057000 tx=0x7f3f1c052000 comp rx=0 tx=0).stop 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 msgr2=0x56057cc3bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 --2- 172.21.15.145:0/997322910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56057cb414a0 0x56057cc3bf80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3f240012f0 tx=0x7f3f24000ed0 comp rx=0 tx=0).stop 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f351a4640 1 -- 172.21.15.145:0/997322910 reap_dead start 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 shutdown_connections 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 >> 172.21.15.145:0/997322910 conn(0x56057cb3d1f0 msgr2=0x56057cc35940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 shutdown_connections 2024-09-10T04:50:51.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:50:51.678+0000 7f3f36eb9800 1 -- 172.21.15.145:0/997322910 wait complete. 2024-09-10T04:50:51.688 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T04:50:51.707 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:50:51.712 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T04:51:26.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-10T04:51:26.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-10T04:51:26.713 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-10T04:51:26.766 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:26.767 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:26.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.766+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.766+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.766+0000 7fe483d40800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55aabf9c0670 0x55aabf9c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.766+0000 7fe483d40800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aabf869e40 con 0x55aabf9c3000 2024-09-10T04:51:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.766+0000 7fe483d40800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55aabf834680 con 0x55aabf9c0670 2024-09-10T04:51:26.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47faed640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55aabf9c0670 0x55aabf9c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47faed640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55aabf9c0670 0x55aabf9c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37408/0 (socket says 172.21.15.145:37408) 2024-09-10T04:51:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47f2ec640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55aabf9c3000 0x55aabf9c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:32976/0 (socket says 172.21.15.145:32976) 2024-09-10T04:51:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47faed640 1 -- 172.21.15.145:0/3799059005 learned_addr learned my addr 172.21.15.145:0/3799059005 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47faed640 1 -- 172.21.15.145:0/3799059005 >> v1:172.21.15.98:6789/0 conn(0x55aabf9c3000 legacy=0x55aabf9c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.767+0000 7fe47faed640 1 -- 172.21.15.145:0/3799059005 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabf8506b0 con 0x55aabf9c0670 2024-09-10T04:51:26.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.769+0000 7fe47faed640 1 --2- 172.21.15.145:0/3799059005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabf9c2a60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe47000a520 tx=0x7fe470045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6897cb53e920775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.769+0000 7fe47eaeb640 1 -- 172.21.15.145:0/3799059005 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe470055070 con 0x55aabf9c0670 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.769+0000 7fe47eaeb640 1 -- 172.21.15.145:0/3799059005 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4700515b0 con 0x55aabf9c0670 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.769+0000 7fe47eaeb640 1 -- 172.21.15.145:0/3799059005 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4700518d0 con 0x55aabf9c0670 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 -- 172.21.15.145:0/3799059005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 msgr2=0x55aabf9c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 --2- 172.21.15.145:0/3799059005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabf9c2a60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe47000a520 tx=0x7fe470045ba0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 -- 172.21.15.145:0/3799059005 shutdown_connections 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 --2- 172.21.15.145:0/3799059005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabf9c2a60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 -- 172.21.15.145:0/3799059005 >> 172.21.15.145:0/3799059005 conn(0x55aabf9ba1b0 msgr2=0x55aabf9bc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 -- 172.21.15.145:0/3799059005 shutdown_connections 2024-09-10T04:51:26.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.770+0000 7fe483d40800 1 -- 172.21.15.145:0/3799059005 wait complete. 2024-09-10T04:51:26.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe483d40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe483d40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aabf858dd0 con 0x55aabf9c0670 2024-09-10T04:51:26.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37410/0 (socket says 172.21.15.145:37410) 2024-09-10T04:51:26.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.786+0000 7fe47faed640 1 -- 172.21.15.145:0/2146961182 learned_addr learned my addr 172.21.15.145:0/2146961182 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.787+0000 7fe47faed640 1 -- 172.21.15.145:0/2146961182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabf871e10 con 0x55aabf9c0670 2024-09-10T04:51:26.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.787+0000 7fe47faed640 1 --2- 172.21.15.145:0/2146961182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4700460d0 tx=0x7fe470051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f748a623a80c9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.787+0000 7fe36de0b640 1 -- 172.21.15.145:0/2146961182 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4700519d0 con 0x55aabf9c0670 2024-09-10T04:51:26.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.787+0000 7fe36de0b640 1 -- 172.21.15.145:0/2146961182 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470051b70 con 0x55aabf9c0670 2024-09-10T04:51:26.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.787+0000 7fe36de0b640 1 -- 172.21.15.145:0/2146961182 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe470051e50 con 0x55aabf9c0670 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- 172.21.15.145:0/2146961182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 msgr2=0x55aabfaaf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 --2- 172.21.15.145:0/2146961182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4700460d0 tx=0x7fe470051000 comp rx=0 tx=0).stop 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- 172.21.15.145:0/2146961182 shutdown_connections 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 --2- 172.21.15.145:0/2146961182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfaaf6e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- 172.21.15.145:0/2146961182 >> 172.21.15.145:0/2146961182 conn(0x55aabf9ba1b0 msgr2=0x55aabfaab060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- 172.21.15.145:0/2146961182 shutdown_connections 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- 172.21.15.145:0/2146961182 wait complete. 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfab6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.788+0000 7fe483d40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aabf9c7020 con 0x55aabf9c0670 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfab6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfab6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37426/0 (socket says 172.21.15.145:37426) 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe47faed640 1 -- 172.21.15.145:0/2382173873 learned_addr learned my addr 172.21.15.145:0/2382173873 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe47faed640 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabfab73b0 con 0x55aabf9c0670 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe47faed640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfab6e50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe4700460d0 tx=0x7fe470002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe367fff640 1 -- 172.21.15.145:0/2382173873 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe470073020 con 0x55aabf9c0670 2024-09-10T04:51:26.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe367fff640 1 -- 172.21.15.145:0/2382173873 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47006f580 con 0x55aabf9c0670 2024-09-10T04:51:26.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aabfab7640 con 0x55aabf9c0670 2024-09-10T04:51:26.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.789+0000 7fe367fff640 1 -- 172.21.15.145:0/2382173873 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe47006f8a0 con 0x55aabf9c0670 2024-09-10T04:51:26.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.790+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aabfab8250 con 0x55aabf9c0670 2024-09-10T04:51:26.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.790+0000 7fe367fff640 1 -- 172.21.15.145:0/2382173873 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe470076020 con 0x55aabf9c0670 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe367fff640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe36803c730 0x7fe36803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe367fff640 1 -- 172.21.15.145:0/2382173873 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe47006b040 con 0x55aabf9c0670 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe36803c730 0x7fe36803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabf9c3000 0x55aabfabe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfabe9e0 con 0x55aabf9c3000 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe4802ee640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabf9c3000 0x55aabfabe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe36803c730 0x7fe36803ebf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe474001e80 tx=0x7fe4740013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.791+0000 7fe4802ee640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabf9c3000 0x55aabfabe4a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.792+0000 7fe4802ee640 1 -- 172.21.15.145:0/2382173873 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabf9c3000 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.792+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfabf2e0 0x55aabfac1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.792+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfac1ee0 con 0x55aabfabf2e0 2024-09-10T04:51:26.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.792+0000 7fe47faed640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfabf2e0 0x55aabfac1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.792+0000 7fe47faed640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfabf2e0 0x55aabfac1770 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe47faed640 1 -- 172.21.15.145:0/2382173873 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe470057030 con 0x55aabfabf2e0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfac3790 con 0x55aabf9c3000 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe4802ee640 1 -- 172.21.15.145:0/2382173873 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabf9c3000 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfac29c0 con 0x55aabfabf2e0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe47faed640 1 -- 172.21.15.145:0/2382173873 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe470057030 con 0x55aabfabf2e0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55aabfac4b40 0x55aabfac6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.793+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfac7470 con 0x55aabfac4b40 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.794+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55aabfac4b40 0x55aabfac6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.794+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55aabfac4b40 0x55aabfac6f30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.794+0000 7fe47f2ec640 1 -- 172.21.15.145:0/2382173873 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe47400bda0 con 0x55aabfac4b40 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.794+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe483d40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe483d40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aabf8b6a00 con 0x55aabfad5020 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37440/0 (socket says 172.21.15.145:37440) 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe47faed640 1 -- 172.21.15.145:0/642362249 learned_addr learned my addr 172.21.15.145:0/642362249 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe47faed640 1 -- 172.21.15.145:0/642362249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabfad5a80 con 0x55aabfad5020 2024-09-10T04:51:26.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.795+0000 7fe47faed640 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe470095f60 tx=0x7fe47007cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe3657fa640 1 -- 172.21.15.145:0/642362249 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe47008f110 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe3657fa640 1 -- 172.21.15.145:0/642362249 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47008f2b0 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe3657fa640 1 -- 172.21.15.145:0/642362249 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe470050900 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aabfad62b0 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aabfad6850 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.796+0000 7fe3657fa640 1 -- 172.21.15.145:0/642362249 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe470058070 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe3657fa640 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 0x7fe35803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe3657fa640 1 -- 172.21.15.145:0/642362249 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe470062070 con 0x55aabfad5020 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 0x7fe35803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 0x7fe35803eba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55aabfac2d60 tx=0x7fe47400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe483d40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.797+0000 7fe483d40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aabfaafe70 con 0x55aabf9bf720 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37444/0 (socket says 172.21.15.145:37444) 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe47faed640 1 -- 172.21.15.145:0/3458222876 learned_addr learned my addr 172.21.15.145:0/3458222876 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe47faed640 1 -- 172.21.15.145:0/3458222876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabf9c0060 con 0x55aabf9bf720 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe47faed640 1 --2- 172.21.15.145:0/3458222876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe47006ff70 tx=0x7fe47008c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206bc5f28572f427 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe35effd640 1 -- 172.21.15.145:0/3458222876 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4700af020 con 0x55aabf9bf720 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe35effd640 1 -- 172.21.15.145:0/3458222876 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47008cdb0 con 0x55aabf9bf720 2024-09-10T04:51:26.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.798+0000 7fe35effd640 1 -- 172.21.15.145:0/3458222876 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe470077950 con 0x55aabf9bf720 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- 172.21.15.145:0/3458222876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 msgr2=0x55aabf9bfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 --2- 172.21.15.145:0/3458222876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe47006ff70 tx=0x7fe47008c880 comp rx=0 tx=0).stop 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- 172.21.15.145:0/3458222876 shutdown_connections 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 --2- 172.21.15.145:0/3458222876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabf9bfb20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- 172.21.15.145:0/3458222876 >> 172.21.15.145:0/3458222876 conn(0x55aabfaddd60 msgr2=0x55aabfadbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- 172.21.15.145:0/3458222876 shutdown_connections 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- 172.21.15.145:0/3458222876 wait complete. 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 Processor -- start 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- start start 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.799+0000 7fe483d40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aabf9be460 con 0x55aabf9bf720 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe47faed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37458/0 (socket says 172.21.15.145:37458) 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 learned_addr learned my addr 172.21.15.145:0/1999315432 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabfaeb570 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe47faed640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe47006faa0 tx=0x7fe4700a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe35d7fa640 1 -- 172.21.15.145:0/1999315432 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4700c3070 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe35d7fa640 1 -- 172.21.15.145:0/1999315432 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47006d350 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aabfaeb570 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe35d7fa640 1 -- 172.21.15.145:0/1999315432 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe47006d6e0 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.800+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aabfaeb570 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.801+0000 7fe35d7fa640 1 -- 172.21.15.145:0/1999315432 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4700c6070 con 0x55aabf9bf720 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.801+0000 7fe35d7fa640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe34803c780 0x7fe34803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe35d7fa640 1 -- 172.21.15.145:0/1999315432 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe4700bb050 con 0x55aabf9bf720 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe34803c780 0x7fe34803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabfaf63e0 0x55aabfaf88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfaf8ff0 con 0x55aabfaf63e0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe4802ee640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabfaf63e0 0x55aabfaf88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe34803c780 0x7fe34803ec40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe47400ffd0 tx=0x7fe474010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.802+0000 7fe4802ee640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabfaf63e0 0x55aabfaf88a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 realm 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfaf5710 con 0x55aabfaf63e0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfaf9a80 con 0x55aabfaf63e0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfafa860 0x55aabfafcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfafd280 con 0x55aabfafa860 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.803+0000 7fe47faed640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfafa860 0x55aabfafcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe47faed640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfafa860 0x55aabfafcc50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfafdb20 con 0x55aabfaf63e0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 20 searching for the correct realm 2024-09-10T04:51:26.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55aabfaff890 0x55aabfb01cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.804+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55aabfaff890 0x55aabfb01cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47f2ec640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55aabfaff890 0x55aabfb01cc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47faed640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe4700c8060 0x7fe4700ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.805+0000 7fe4802ee640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe4700c8060 0x7fe4700ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.806+0000 7fe4802ee640 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe4700c8060 0x7fe4700ae170 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.806+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe47800a4d0 con 0x7fe4700c8060 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.806+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.806+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.806+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.807+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47800a4d0 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.808+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.809+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.810+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.811+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaf63e0 2024-09-10T04:51:26.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.812+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x7fe4700c8060 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe478030040 con 0x7fe4700c8060 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfaff890 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.813+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02390 con 0x55aabfafa860 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfafe4a0 con 0x55aabfaf63e0 2024-09-10T04:51:26.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe478030040 con 0x55aabfaf63e0 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.814+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfafe920 con 0x55aabfafa860 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfafedc0 con 0x7fe4700c8060 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 zone default found 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 4 Realm: () 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:26.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 zonegroup default 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb02860 con 0x7fe4700c8060 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb043b0 con 0x55aabfaff890 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.815+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb048e0 con 0x55aabfaff890 2024-09-10T04:51:26.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 20 started sync module instance, tier type = 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.816+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb036f0 con 0x55aabfafa860 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.817+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.817+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94191848798944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb03350 con 0x55aabfafa860 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.817+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb05810 con 0x55aabfaf63e0 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.818+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.818+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94191848805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb060b0 con 0x55aabfaf63e0 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.818+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94191848798944] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.818+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb04d60 con 0x55aabfafa860 2024-09-10T04:51:26.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.819+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94191848805728] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.820+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.820+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94191848807424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb06020 con 0x55aabfafa860 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.820+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb07140 con 0x7fe4700c8060 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.821+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94191848807424] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.821+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.821+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94191848810096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb07140 con 0x7fe4700c8060 2024-09-10T04:51:26.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.821+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb07b00 con 0x55aabfafa860 2024-09-10T04:51:26.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.822+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94191848810096] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.822+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.822+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94191848814640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb07140 con 0x55aabfafa860 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.822+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb08510 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.823+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.823+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94191848816736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb08d60 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.823+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb09800 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.823+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94191848814640] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.826+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94191848816736] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.826+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.826+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94191848821488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb09c20 con 0x55aabfaff890 2024-09-10T04:51:26.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.826+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb0a4b0 con 0x7fe4700c8060 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94191848821488] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94191848811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb0a0d0 con 0x7fe4700c8060 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=0 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=1 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=2 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=3 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=4 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=5 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.827+0000 7fe483d40800 20 add_watcher() i=6 2024-09-10T04:51:26.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94191848811664] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe483d40800 20 add_watcher() i=7 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe483d40800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb0d990 con 0x55aabfaf63e0 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.829+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94191848824304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb0aeb0 con 0x55aabfaf63e0 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.830+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94191848824304] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.830+0000 7fe3367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.830+0000 7fe483d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.830+0000 7fe483d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.830+0000 7fe483d40800 5 note: GC not initialized 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe3357e2640 20 reqs_thread_entry: start 2024-09-10T04:51:26.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe483d40800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe483d40800 20 Filter name: none 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe32e7fc640 20 reqs_thread_entry: start 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40ef0 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.831+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40ef0 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaff890 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfafa860 2024-09-10T04:51:26.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.832+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaf63e0 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaf63e0 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.833+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40eb0 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x7fe4700c8060 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.834+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x7fe4700c8060 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.835+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.836+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x7fe4700c8060 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.837+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.838+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaff890 2024-09-10T04:51:26.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.839+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfafa860 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.840+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.840+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb40900 con 0x55aabfaf63e0 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.840+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.841+0000 7fe3367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:26.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.841+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94191848824304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb41aa0 con 0x55aabfaf63e0 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.842+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94191848824304] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.842+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94191848798944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb09dc0 con 0x55aabfafa860 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.843+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94191848798944] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.843+0000 7fe483d40800 20 remove_watcher() i=0 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.843+0000 7fe483d40800 2 removed watcher, disabling cache 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.843+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94191848805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb03ae0 con 0x55aabfaf63e0 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.844+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94191848805728] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x55aabfaf63e0 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.844+0000 7fe483d40800 20 remove_watcher() i=1 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.844+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94191848807424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb03ae0 con 0x55aabfafa860 2024-09-10T04:51:26.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.846+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94191848807424] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.846+0000 7fe483d40800 20 remove_watcher() i=2 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.846+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94191848810096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb03ae0 con 0x7fe4700c8060 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.847+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94191848810096] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.847+0000 7fe483d40800 20 remove_watcher() i=3 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.847+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94191848814640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb06670 con 0x55aabfafa860 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.848+0000 7fe47faed640 1 -- 172.21.15.145:0/1999315432 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94191848814640] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4700c5030 con 0x55aabfafa860 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.848+0000 7fe483d40800 20 remove_watcher() i=4 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.848+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94191848816736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb03ae0 con 0x55aabfaff890 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.849+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94191848816736] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.849+0000 7fe483d40800 20 remove_watcher() i=5 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.849+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94191848821488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb07830 con 0x55aabfaff890 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.850+0000 7fe47f2ec640 1 -- 172.21.15.145:0/1999315432 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94191848821488] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe474037040 con 0x55aabfaff890 2024-09-10T04:51:26.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.850+0000 7fe483d40800 20 remove_watcher() i=6 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.850+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94191848811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aabfb06670 con 0x7fe4700c8060 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94191848811664] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe478041040 con 0x7fe4700c8060 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 20 remove_watcher() i=7 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfafa860 msgr2=0x55aabfafcc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfafa860 0x55aabfafcc50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabfaf63e0 msgr2=0x55aabfaf88a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabfaf63e0 0x55aabfaf88a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe4700c8060 msgr2=0x7fe4700ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe4700c8060 0x7fe4700ae170 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55aabfaff890 msgr2=0x55aabfb01cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55aabfaff890 0x55aabfb01cc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe34803c780 msgr2=0x7fe34803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe34803c780 0x7fe34803ec40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe47400ffd0 tx=0x7fe474010000 comp rx=0 tx=0).stop 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 msgr2=0x55aabfaeb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe4802ee640 1 -- 172.21.15.145:0/1999315432 reap_dead start 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe47006faa0 tx=0x7fe4700a9000 comp rx=0 tx=0).stop 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 shutdown_connections 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/1999315432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9bf720 0x55aabfaeb010 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 >> 172.21.15.145:0/1999315432 conn(0x55aabfaddd60 msgr2=0x55aabfadbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 shutdown_connections 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/1999315432 wait complete. 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 msgr2=0x7fe35803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 0x7fe35803eba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55aabfac2d60 tx=0x7fe47400f000 comp rx=0 tx=0).stop 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 msgr2=0x55aabfad5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe470095f60 tx=0x7fe47007cf20 comp rx=0 tx=0).stop 2024-09-10T04:51:26.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.851+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 shutdown_connections 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe35803c6e0 0x7fe35803eba0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/642362249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabfad5020 0x55aabfad5440 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 >> 172.21.15.145:0/642362249 conn(0x55aabfac93d0 msgr2=0x55aabfac97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 shutdown_connections 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/642362249 wait complete. 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfabf2e0 msgr2=0x55aabfac1770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55aabfabf2e0 0x55aabfac1770 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabf9c3000 msgr2=0x55aabfabe4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55aabf9c3000 0x55aabfabe4a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55aabfac4b40 msgr2=0x55aabfac6f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55aabfac4b40 0x55aabfac6f30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe36803c730 msgr2=0x7fe36803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe36803c730 0x7fe36803ebf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe474001e80 tx=0x7fe4740013e0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 msgr2=0x55aabfab6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 --2- 172.21.15.145:0/2382173873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aabf9c0670 0x55aabfab6e50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe4700460d0 tx=0x7fe470002fb0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe4802ee640 1 -- 172.21.15.145:0/2382173873 reap_dead start 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 shutdown_connections 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 >> 172.21.15.145:0/2382173873 conn(0x55aabf9ba1b0 msgr2=0x55aabfaa9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 shutdown_connections 2024-09-10T04:51:26.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.852+0000 7fe483d40800 1 -- 172.21.15.145:0/2382173873 wait complete. 2024-09-10T04:51:26.862 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:26.862 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:26.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T04:51:26.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T04:51:26.863 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T04:51:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:26.905 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ad4b26800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5591e5d181e0 0x5591e5d1a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ad4b26800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591e5bbde40 con 0x5591e5d14670 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ad4b26800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5591e5b88680 con 0x5591e5d181e0 2024-09-10T04:51:26.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ac7fd8640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5591e5d181e0 0x5591e5d1a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ac7fd8640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5591e5d181e0 0x5591e5d1a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37466/0 (socket says 172.21.15.145:37466) 2024-09-10T04:51:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/295221773 learned_addr learned my addr 172.21.15.145:0/295221773 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/295221773 >> v1:172.21.15.98:6789/0 conn(0x5591e5d14670 legacy=0x5591e5d16a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.905+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/295221773 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5ba46b0 con 0x5591e5d181e0 2024-09-10T04:51:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.907+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/295221773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d1a6a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800a520 tx=0x7f1ab8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c11a5ef050498b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.907+0000 7f1acffd8640 1 -- 172.21.15.145:0/295221773 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8055070 con 0x5591e5d181e0 2024-09-10T04:51:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.907+0000 7f1acffd8640 1 -- 172.21.15.145:0/295221773 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab80515b0 con 0x5591e5d181e0 2024-09-10T04:51:26.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.907+0000 7f1acffd8640 1 -- 172.21.15.145:0/295221773 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab80518d0 con 0x5591e5d181e0 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 -- 172.21.15.145:0/295221773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 msgr2=0x5591e5d1a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/295221773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d1a6a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800a520 tx=0x7f1ab8045ba0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 -- 172.21.15.145:0/295221773 shutdown_connections 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/295221773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d1a6a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 -- 172.21.15.145:0/295221773 >> 172.21.15.145:0/295221773 conn(0x5591e5d0e1b0 msgr2=0x5591e5d10610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 -- 172.21.15.145:0/295221773 shutdown_connections 2024-09-10T04:51:26.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.908+0000 7f1ad4b26800 1 -- 172.21.15.145:0/295221773 wait complete. 2024-09-10T04:51:26.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad4b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad4b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591e5bacdd0 con 0x5591e5d14670 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37476/0 (socket says 172.21.15.145:37476) 2024-09-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.922+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2852243665 learned_addr learned my addr 172.21.15.145:0/2852243665 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.923+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2852243665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5bc5e10 con 0x5591e5d14670 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.923+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/2852243665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0001da0 tx=0x7f1ac000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15cc21f1c28acab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.923+0000 7f19be60c640 1 -- 172.21.15.145:0/2852243665 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac000f400 con 0x5591e5d14670 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.923+0000 7f19be60c640 1 -- 172.21.15.145:0/2852243665 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac000f5a0 con 0x5591e5d14670 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.923+0000 7f19be60c640 1 -- 172.21.15.145:0/2852243665 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac000f8c0 con 0x5591e5d14670 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2852243665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 msgr2=0x5591e5e03660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2852243665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0001da0 tx=0x7f1ac000b5b0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2852243665 shutdown_connections 2024-09-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2852243665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d14670 0x5591e5e03660 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2852243665 >> 172.21.15.145:0/2852243665 conn(0x5591e5d0e1b0 msgr2=0x5591e5dfefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2852243665 shutdown_connections 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2852243665 wait complete. 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d13d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.924+0000 7f1ad4b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591e5d1b020 con 0x5591e5d181e0 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d13d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37478/0 (socket says 172.21.15.145:37478) 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2441662250 learned_addr learned my addr 172.21.15.145:0/2441662250 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5d142f0 con 0x5591e5d181e0 2024-09-10T04:51:26.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d13d90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x5591e5e045f0 tx=0x7f1ac0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f19bce09640 1 -- 172.21.15.145:0/2441662250 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac001a690 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f19bce09640 1 -- 172.21.15.145:0/2441662250 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac001a870 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e5d126a0 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f19bce09640 1 -- 172.21.15.145:0/2441662250 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac001ab90 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.925+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e5d12cc0 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.926+0000 7f19bce09640 1 -- 172.21.15.145:0/2441662250 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ac0017070 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.926+0000 7f19bce09640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19b803c730 0x7f19b803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.926+0000 7f19bce09640 1 -- 172.21.15.145:0/2441662250 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f1ac0015020 con 0x5591e5d181e0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19b803c730 0x7f19b803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e12750 0x5591e5e14b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e15080 con 0x5591e5e12750 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e12750 0x5591e5e14b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19b803c730 0x7f19b803ebf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8057000 tx=0x7f1ab8052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e12750 0x5591e5e14b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad0fda640 1 -- 172.21.15.145:0/2441662250 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e12750 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e15e10 0x5591e5e18200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.927+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e18840 con 0x5591e5e15e10 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.928+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e15e10 0x5591e5e18200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.928+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e15e10 0x5591e5e18200 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.928+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2441662250 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ac002e070 con 0x5591e5e15e10 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.928+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e1a0f0 con 0x5591e5e12750 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ad0fda640 1 -- 172.21.15.145:0/2441662250 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e12750 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e19320 con 0x5591e5e15e10 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ad07d9640 1 -- 172.21.15.145:0/2441662250 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ac002e070 con 0x5591e5e15e10 2024-09-10T04:51:26.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5591e5e1b4a0 0x5591e5e1d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e1ddd0 con 0x5591e5e1b4a0 2024-09-10T04:51:26.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5591e5e1b4a0 0x5591e5e1d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.929+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5591e5e1b4a0 0x5591e5e1d890 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/2441662250 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e1b4a0 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad4b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad4b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591e5c0aa00 con 0x5591e5e2b920 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37482/0 (socket says 172.21.15.145:37482) 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.930+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1925671387 learned_addr learned my addr 172.21.15.145:0/1925671387 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1925671387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5e2c380 con 0x5591e5e2b920 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0051f80 tx=0x7f1ac000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f19b5ffb640 1 -- 172.21.15.145:0/1925671387 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac004ad90 con 0x5591e5e2b920 2024-09-10T04:51:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f19b5ffb640 1 -- 172.21.15.145:0/1925671387 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac004af30 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e5e2cbb0 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f19b5ffb640 1 -- 172.21.15.145:0/1925671387 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac004b210 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.931+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e5e2cbb0 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.932+0000 7f19b5ffb640 1 -- 172.21.15.145:0/1925671387 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ac000e070 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.932+0000 7f19b5ffb640 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 0x7f19a803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.932+0000 7f19b5ffb640 1 -- 172.21.15.145:0/1925671387 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f1ac0047040 con 0x5591e5e2b920 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.932+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 0x7f19a803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.932+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 0x7f19a803ec40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5591e5d13110 tx=0x7f1ab8005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad4b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad4b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591e5e03eb0 con 0x5591e5e38080 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37498/0 (socket says 172.21.15.145:37498) 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad07d9640 1 -- 172.21.15.145:0/3906373197 learned_addr learned my addr 172.21.15.145:0/3906373197 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad07d9640 1 -- 172.21.15.145:0/3906373197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5e38a70 con 0x5591e5e38080 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/3906373197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0017430 tx=0x7f1ac00278b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a025c7f2a03f950f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f19af7fe640 1 -- 172.21.15.145:0/3906373197 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0064070 con 0x5591e5e38080 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f19af7fe640 1 -- 172.21.15.145:0/3906373197 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac0027e40 con 0x5591e5e38080 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.933+0000 7f19af7fe640 1 -- 172.21.15.145:0/3906373197 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0053a50 con 0x5591e5e38080 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- 172.21.15.145:0/3906373197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 msgr2=0x5591e5e38480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/3906373197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0017430 tx=0x7f1ac00278b0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- 172.21.15.145:0/3906373197 shutdown_connections 2024-09-10T04:51:26.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/3906373197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e38480 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- 172.21.15.145:0/3906373197 >> 172.21.15.145:0/3906373197 conn(0x5591e5e34480 msgr2=0x5591e5e326c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- 172.21.15.145:0/3906373197 shutdown_connections 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- 172.21.15.145:0/3906373197 wait complete. 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 Processor -- start 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- start start 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.934+0000 7f1ad4b26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5591e5e38ee0 con 0x5591e5e38080 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad07d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37510/0 (socket says 172.21.15.145:37510) 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 learned_addr learned my addr 172.21.15.145:0/1812454193 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e5e3fa10 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1ac001ad90 tx=0x7f1ac0022ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f19adffb640 1 -- 172.21.15.145:0/1812454193 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac006e070 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f19adffb640 1 -- 172.21.15.145:0/1812454193 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac0053a50 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e5e3fa10 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f19adffb640 1 -- 172.21.15.145:0/1812454193 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0064040 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.935+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e5e3ff00 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.936+0000 7f19adffb640 1 -- 172.21.15.145:0/1812454193 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ac0071070 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f19adffb640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a003c690 0x7f19a003eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f19adffb640 1 -- 172.21.15.145:0/1812454193 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f1ac0074db0 con 0x5591e5e38080 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a003c690 0x7f19a003eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e4a8d0 0x5591e5e4cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e4d4b0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e4a8d0 0x5591e5e4cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a003c690 0x7f19a003eb50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8045be0 tx=0x7f1ab806d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.937+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e4a8d0 0x5591e5e4cd60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 realm 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e49d10 con 0x5591e5e4a8d0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e4df90 con 0x5591e5e4a8d0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e4eb50 0x5591e5e51010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e51780 con 0x5591e5e4eb50 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.938+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e4eb50 0x5591e5e51010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e4eb50 0x5591e5e51010 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e52020 con 0x5591e5e4a8d0 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 20 searching for the correct realm 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5591e5e53d90 0x5591e5e561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.939+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5591e5e53d90 0x5591e5e561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ac7fd8640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5591e5e53d90 0x5591e5e561c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ad07d9640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f1ac0073070 0x7f1ac005f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:26.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.940+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f1ac0073070 0x7f1ac005f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:26.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f1ac0073070 0x7f1ac005f400 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ac800a4d0 con 0x7f1ac0073070 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.941+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.942+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac800a4d0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.943+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.944+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.945+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4a8d0 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.946+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x7f1ac0073070 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac8030040 con 0x7f1ac0073070 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e53d90 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.947+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56890 con 0x5591e5e4eb50 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e529a0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ac8030040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.948+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e52e20 con 0x5591e5e4eb50 2024-09-10T04:51:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e532c0 con 0x7f1ac0073070 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 zone default found 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 4 Realm: () 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 zonegroup default 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e56d60 con 0x7f1ac0073070 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e588b0 con 0x5591e5e53d90 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.949+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e58d70 con 0x5591e5e53d90 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.950+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.950+0000 7f1ad4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.950+0000 7f1ad4b26800 20 started sync module instance, tier type = 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.950+0000 7f1ad4b26800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.950+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e57bf0 con 0x5591e5e4eb50 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.951+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.951+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94085115641824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e59680 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.951+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e59ed0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.952+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94085115641824] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.952+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.952+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94085115646416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e59f70 con 0x5591e5e4a8d0 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.952+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5aa90 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.953+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94085115646416] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.953+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.953+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94085115651424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5aa50 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.953+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5b4f0 con 0x7f1ac0073070 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.954+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94085115651424] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.955+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.955+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94085115654176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5b4f0 con 0x7f1ac0073070 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.955+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5bf30 con 0x5591e5e4eb50 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.956+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94085115654176] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.956+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.956+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94085115648544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5bf30 con 0x5591e5e4eb50 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.956+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5c940 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.957+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.957+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94085115648544] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.957+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94085115659408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5d1e0 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.957+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5d7d0 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.958+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94085115659408] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.958+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.958+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94085115661616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5e070 con 0x5591e5e53d90 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.958+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5e940 con 0x7f1ac0073070 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94085115661616] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94085115667472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5ed30 con 0x7f1ac0073070 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=0 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=1 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=2 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=3 2024-09-10T04:51:26.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=4 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=5 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.959+0000 7f1ad4b26800 20 add_watcher() i=6 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.960+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94085115667472] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.960+0000 7f1ad4b26800 20 add_watcher() i=7 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.960+0000 7f1ad4b26800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.960+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e62210 con 0x5591e5e4a8d0 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.961+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.961+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94085115669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e5f680 con 0x5591e5e4a8d0 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94085115669728] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f19867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad4b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:26.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad4b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad4b26800 5 note: GC not initialized 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f19857e2640 20 reqs_thread_entry: start 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad4b26800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f1ad4b26800 20 Filter name: none 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.962+0000 7f18f6ffd640 20 reqs_thread_entry: start 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e95820 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e95820 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.963+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4eb50 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.964+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.965+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97340 con 0x5591e5e4a8d0 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97340 con 0x7f1ac0073070 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e972c0 con 0x5591e5e53d90 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e972c0 con 0x7f1ac0073070 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.966+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e972c0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e972c0 con 0x5591e5e53d90 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97250 con 0x5591e5e4a8d0 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97250 con 0x5591e5e4eb50 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.967+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97250 con 0x5591e5e4eb50 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e53d90 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x7f1ac0073070 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e53d90 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4a8d0 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.968+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4eb50 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.969+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4a8d0 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e53d90 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e53d90 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.970+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.971+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.971+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e97200 con 0x5591e5e4a8d0 2024-09-10T04:51:26.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.971+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.972+0000 7f19867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.972+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94085115669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.973+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94085115669728] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.973+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94085115641824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4eb50 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.974+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94085115641824] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.974+0000 7f1ad4b26800 20 remove_watcher() i=0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.974+0000 7f1ad4b26800 2 removed watcher, disabling cache 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.974+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94085115646416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4a8d0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.975+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94085115646416] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x5591e5e4a8d0 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.975+0000 7f1ad4b26800 20 remove_watcher() i=1 2024-09-10T04:51:26.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.975+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94085115651424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4eb50 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.976+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94085115651424] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.976+0000 7f1ad4b26800 20 remove_watcher() i=2 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.976+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94085115654176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x7f1ac0073070 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.977+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94085115654176] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.977+0000 7f1ad4b26800 20 remove_watcher() i=3 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.977+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94085115648544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e4eb50 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.978+0000 7f1ad07d9640 1 -- 172.21.15.145:0/1812454193 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94085115648544] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac0070030 con 0x5591e5e4eb50 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.978+0000 7f1ad4b26800 20 remove_watcher() i=4 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.978+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94085115659408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.979+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94085115659408] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.979+0000 7f1ad4b26800 20 remove_watcher() i=5 2024-09-10T04:51:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.979+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94085115661616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x5591e5e53d90 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.980+0000 7f1ac7fd8640 1 -- 172.21.15.145:0/1812454193 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94085115661616] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ab8057030 con 0x5591e5e53d90 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.980+0000 7f1ad4b26800 20 remove_watcher() i=6 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.980+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94085115667472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e5e957e0 con 0x7f1ac0073070 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94085115667472] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ac8041040 con 0x7f1ac0073070 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 20 remove_watcher() i=7 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e4eb50 msgr2=0x5591e5e51010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e4eb50 0x5591e5e51010 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e4a8d0 msgr2=0x5591e5e4cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e4a8d0 0x5591e5e4cd60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f1ac0073070 msgr2=0x7f1ac005f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f1ac0073070 0x7f1ac005f400 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5591e5e53d90 msgr2=0x5591e5e561c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5591e5e53d90 0x5591e5e561c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a003c690 msgr2=0x7f19a003eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a003c690 0x7f19a003eb50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8045be0 tx=0x7f1ab806d040 comp rx=0 tx=0).stop 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 msgr2=0x5591e5e3f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1ac001ad90 tx=0x7f1ac0022ef0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad0fda640 1 -- 172.21.15.145:0/1812454193 reap_dead start 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 shutdown_connections 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1812454193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e38080 0x5591e5e3f4b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 >> 172.21.15.145:0/1812454193 conn(0x5591e5e34480 msgr2=0x5591e5e32690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 shutdown_connections 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.981+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1812454193 wait complete. 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 msgr2=0x7f19a803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 0x7f19a803ec40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5591e5d13110 tx=0x7f1ab8005ac0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 msgr2=0x5591e5e2bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0051f80 tx=0x7f1ac000ef20 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 shutdown_connections 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19a803c780 0x7f19a803ec40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/1925671387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5e2b920 0x5591e5e2bd40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 >> 172.21.15.145:0/1925671387 conn(0x5591e5e1fcd0 msgr2=0x5591e5e200b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 shutdown_connections 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/1925671387 wait complete. 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e15e10 msgr2=0x5591e5e18200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5591e5e15e10 0x5591e5e18200 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e12750 msgr2=0x5591e5e14b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5591e5e12750 0x5591e5e14b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5591e5e1b4a0 msgr2=0x5591e5e1d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5591e5e1b4a0 0x5591e5e1d890 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19b803c730 msgr2=0x7f19b803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f19b803c730 0x7f19b803ebf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8057000 tx=0x7f1ab8052000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 msgr2=0x5591e5d13d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 --2- 172.21.15.145:0/2441662250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5591e5d181e0 0x5591e5d13d90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x5591e5e045f0 tx=0x7f1ac0000ed0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad0fda640 1 -- 172.21.15.145:0/2441662250 reap_dead start 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 shutdown_connections 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 >> 172.21.15.145:0/2441662250 conn(0x5591e5d0e1b0 msgr2=0x5591e5e049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 shutdown_connections 2024-09-10T04:51:27.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:26.982+0000 7f1ad4b26800 1 -- 172.21.15.145:0/2441662250 wait complete. 2024-09-10T04:51:27.003 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.004 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.004 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T04:51:27.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T04:51:27.004 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T04:51:27.088 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.089 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f840cf42800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ce42eacdf0 0x55ce42eadaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f840cf42800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce42d57e40 con 0x55ce42eae030 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f840cf42800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55ce42d22680 con 0x55ce42eacdf0 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f8408ced640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ce42eacdf0 0x55ce42eadaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f84084ec640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55ce42eae030 0x55ce42eb2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:32994/0 (socket says 172.21.15.145:32994) 2024-09-10T04:51:27.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.088+0000 7f84084ec640 1 -- 172.21.15.145:0/1982654894 learned_addr learned my addr 172.21.15.145:0/1982654894 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:27.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.089+0000 7f8408ced640 1 -- 172.21.15.145:0/1982654894 >> v1:172.21.15.98:6789/0 conn(0x55ce42eae030 legacy=0x55ce42eb2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.089+0000 7f8408ced640 1 -- 172.21.15.145:0/1982654894 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42d3e6b0 con 0x55ce42eacdf0 2024-09-10T04:51:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.090+0000 7f8408ced640 1 --2- 172.21.15.145:0/1982654894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eadaf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8400005fd0 tx=0x7f8400045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9fe25f5712235f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f8407ceb640 1 -- 172.21.15.145:0/1982654894 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8400058530 con 0x55ce42eacdf0 2024-09-10T04:51:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f8407ceb640 1 -- 172.21.15.145:0/1982654894 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84000586d0 con 0x55ce42eacdf0 2024-09-10T04:51:27.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f8407ceb640 1 -- 172.21.15.145:0/1982654894 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000589d0 con 0x55ce42eacdf0 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 -- 172.21.15.145:0/1982654894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 msgr2=0x55ce42eadaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 --2- 172.21.15.145:0/1982654894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eadaf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8400005fd0 tx=0x7f8400045c30 comp rx=0 tx=0).stop 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 -- 172.21.15.145:0/1982654894 shutdown_connections 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 --2- 172.21.15.145:0/1982654894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eadaf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 -- 172.21.15.145:0/1982654894 >> 172.21.15.145:0/1982654894 conn(0x55ce42ea81c0 msgr2=0x55ce42eaa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 -- 172.21.15.145:0/1982654894 shutdown_connections 2024-09-10T04:51:27.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.091+0000 7f840cf42800 1 -- 172.21.15.145:0/1982654894 wait complete. 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.105+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.105+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.105+0000 7f840cf42800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.105+0000 7f840cf42800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce42d46dd0 con 0x55ce42eacdf0 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.105+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37522/0 (socket says 172.21.15.145:37522) 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f8408ced640 1 -- 172.21.15.145:0/1488618913 learned_addr learned my addr 172.21.15.145:0/1488618913 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f8408ced640 1 -- 172.21.15.145:0/1488618913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42d5fe10 con 0x55ce42eacdf0 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f8408ced640 1 --2- 172.21.15.145:0/1488618913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8400025a60 tx=0x7f8400051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e370a30fe203cc69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f82f6e0d640 1 -- 172.21.15.145:0/1488618913 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000589b0 con 0x55ce42eacdf0 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f82f6e0d640 1 -- 172.21.15.145:0/1488618913 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400068070 con 0x55ce42eacdf0 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.106+0000 7f82f6e0d640 1 -- 172.21.15.145:0/1488618913 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8400058c80 con 0x55ce42eacdf0 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- 172.21.15.145:0/1488618913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 msgr2=0x55ce42eb5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 --2- 172.21.15.145:0/1488618913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8400025a60 tx=0x7f8400051000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- 172.21.15.145:0/1488618913 shutdown_connections 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 --2- 172.21.15.145:0/1488618913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42eb5e70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- 172.21.15.145:0/1488618913 >> 172.21.15.145:0/1488618913 conn(0x55ce42ea81c0 msgr2=0x55ce42f98ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- 172.21.15.145:0/1488618913 shutdown_connections 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- 172.21.15.145:0/1488618913 wait complete. 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42fa7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.107+0000 7f840cf42800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce42eae6a0 con 0x55ce42eacdf0 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42fa7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42fa7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37526/0 (socket says 172.21.15.145:37526) 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f8408ced640 1 -- 172.21.15.145:0/3244512588 learned_addr learned my addr 172.21.15.145:0/3244512588 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f8408ced640 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42fa75b0 con 0x55ce42eacdf0 2024-09-10T04:51:27.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f8408ced640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42fa7050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8400065040 tx=0x7f8400003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f82f560a640 1 -- 172.21.15.145:0/3244512588 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000636b0 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f82f560a640 1 -- 172.21.15.145:0/3244512588 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400063850 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce42fa7840 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.108+0000 7f82f560a640 1 -- 172.21.15.145:0/3244512588 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8400063b50 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.109+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce42fa8240 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.109+0000 7f82f560a640 1 -- 172.21.15.145:0/3244512588 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8400075020 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.109+0000 7f82f560a640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82f003c730 0x7f82f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f82f560a640 1 -- 172.21.15.145:0/3244512588 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f8400098190 con 0x55ce42eacdf0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f84084ec640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82f003c730 0x7f82f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42eae030 0x55ce42fae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42faebe0 con 0x55ce42eae030 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f84094ee640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42eae030 0x55ce42fae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f84084ec640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82f003c730 0x7f82f003ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f0001d70 tx=0x7f83f00012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f84094ee640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42eae030 0x55ce42fae6a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f84094ee640 1 -- 172.21.15.145:0/3244512588 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42eae030 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42faf490 0x55ce42fb1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.110+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fb20a0 con 0x55ce42faf490 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.111+0000 7f8408ced640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42faf490 0x55ce42fb1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.111+0000 7f8408ced640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42faf490 0x55ce42fb1930 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.111+0000 7f8408ced640 1 -- 172.21.15.145:0/3244512588 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8400063cf0 con 0x55ce42faf490 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.111+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fb3950 con 0x55ce42eae030 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f84094ee640 1 -- 172.21.15.145:0/3244512588 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42eae030 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fb2b80 con 0x55ce42faf490 2024-09-10T04:51:27.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f8408ced640 1 -- 172.21.15.145:0/3244512588 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8400063cf0 con 0x55ce42faf490 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ce42fb4d00 0x55ce42fb70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fb7630 con 0x55ce42fb4d00 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f84084ec640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ce42fb4d00 0x55ce42fb70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.112+0000 7f84084ec640 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ce42fb4d00 0x55ce42fb70f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f84084ec640 1 -- 172.21.15.145:0/3244512588 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fb4d00 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f840cf42800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f840cf42800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce42da4a00 con 0x55ce42fc51b0 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37528/0 (socket says 172.21.15.145:37528) 2024-09-10T04:51:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.113+0000 7f8408ced640 1 -- 172.21.15.145:0/2383540538 learned_addr learned my addr 172.21.15.145:0/2383540538 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f8408ced640 1 -- 172.21.15.145:0/2383540538 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42fc5c10 con 0x55ce42fc51b0 2024-09-10T04:51:27.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f8408ced640 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f84000963a0 tx=0x7f840006bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f82ee7fc640 1 -- 172.21.15.145:0/2383540538 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840006d610 con 0x55ce42fc51b0 2024-09-10T04:51:27.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f82ee7fc640 1 -- 172.21.15.145:0/2383540538 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840006d7b0 con 0x55ce42fc51b0 2024-09-10T04:51:27.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce42fc6440 con 0x55ce42fc51b0 2024-09-10T04:51:27.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f82ee7fc640 1 -- 172.21.15.145:0/2383540538 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000967d0 con 0x55ce42fc51b0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.114+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce42fc6440 con 0x55ce42fc51b0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f82ee7fc640 1 -- 172.21.15.145:0/2383540538 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8400096970 con 0x55ce42fc51b0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f82ee7fc640 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 0x7f82e003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f82ee7fc640 1 -- 172.21.15.145:0/2383540538 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f840006e070 con 0x55ce42fc51b0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f84084ec640 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 0x7f82e003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.115+0000 7f84084ec640 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 0x7f82e003ebf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f83f000bf40 tx=0x7f83f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f840cf42800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f840cf42800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce42eb4710 con 0x55ce42fd18b0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37532/0 (socket says 172.21.15.145:37532) 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f8408ced640 1 -- 172.21.15.145:0/1913784995 learned_addr learned my addr 172.21.15.145:0/1913784995 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f8408ced640 1 -- 172.21.15.145:0/1913784995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42fd2280 con 0x55ce42fd18b0 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f8408ced640 1 --2- 172.21.15.145:0/1913784995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8400080500 tx=0x7f840008b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ede66251a90923 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f82dffff640 1 -- 172.21.15.145:0/1913784995 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840006ce40 con 0x55ce42fd18b0 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f82dffff640 1 -- 172.21.15.145:0/1913784995 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400096c60 con 0x55ce42fd18b0 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.116+0000 7f82dffff640 1 -- 172.21.15.145:0/1913784995 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840008c3f0 con 0x55ce42fd18b0 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- 172.21.15.145:0/1913784995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 msgr2=0x55ce42fd1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 --2- 172.21.15.145:0/1913784995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8400080500 tx=0x7f840008b380 comp rx=0 tx=0).stop 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- 172.21.15.145:0/1913784995 shutdown_connections 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 --2- 172.21.15.145:0/1913784995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd1c90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- 172.21.15.145:0/1913784995 >> 172.21.15.145:0/1913784995 conn(0x55ce42fcdcb0 msgr2=0x55ce42fcbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- 172.21.15.145:0/1913784995 shutdown_connections 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- 172.21.15.145:0/1913784995 wait complete. 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 Processor -- start 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- start start 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f840cf42800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce42fd2710 con 0x55ce42fd18b0 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f8408ced640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37546/0 (socket says 172.21.15.145:37546) 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.117+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 learned_addr learned my addr 172.21.15.145:0/3248558683 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42fd9230 con 0x55ce42fd18b0 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f8408ced640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8400068ff0 tx=0x7f8400068f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f82de7fc640 1 -- 172.21.15.145:0/3248558683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000ba070 con 0x55ce42fd18b0 2024-09-10T04:51:27.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f82de7fc640 1 -- 172.21.15.145:0/3248558683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840008d070 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce42fd9230 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f82de7fc640 1 -- 172.21.15.145:0/3248558683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840008d390 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.118+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce42fd97d0 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f82de7fc640 1 -- 172.21.15.145:0/3248558683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84000c5060 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f82de7fc640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82d403c730 0x7f82d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f82de7fc640 1 -- 172.21.15.145:0/3248558683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f84000c8d60 con 0x55ce42fd18b0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f84084ec640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82d403c730 0x7f82d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42fe42a0 0x55ce42fe6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.119+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fe6eb0 con 0x55ce42fe42a0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84094ee640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42fe42a0 0x55ce42fe6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84084ec640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82d403c730 0x7f82d403ebf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c010 tx=0x7f83f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84094ee640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42fe42a0 0x55ce42fe6760 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 realm 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fe35d0 con 0x55ce42fe42a0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fe7940 con 0x55ce42fe42a0 2024-09-10T04:51:27.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.120+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42fe8720 0x55ce42feab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb140 con 0x55ce42fe8720 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f8408ced640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42fe8720 0x55ce42feab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f8408ced640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42fe8720 0x55ce42feab10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.121+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f840cf42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f840cf42800 20 searching for the correct realm 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ce42fed750 0x55ce42fefb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff0210 con 0x55ce42fed750 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f84084ec640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ce42fed750 0x55ce42fefb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f84084ec640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ce42fed750 0x55ce42fefb40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.122+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff0210 con 0x55ce42fe8720 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f8408ced640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f84000be020 0x7f84000830d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff0210 con 0x7f84000be020 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f84000be020 0x7f84000830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f84000be020 0x7f84000830d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83f80083e0 con 0x7f84000be020 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80083e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.123+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.124+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.125+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.126+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.127+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe42a0 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.128+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fed750 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.129+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feb9e0 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fec230 con 0x55ce42fe42a0 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.130+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fec620 con 0x55ce42fe8720 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42feca40 con 0x7f84000be020 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 zone default found 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 4 Realm: () 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 zonegroup default 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42fece70 con 0x7f84000be020 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff2080 con 0x55ce42fed750 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.131+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff2420 con 0x55ce42fed750 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.132+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.132+0000 7f840cf42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.132+0000 7f840cf42800 20 started sync module instance, tier type = 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.132+0000 7f840cf42800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.132+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff1520 con 0x55ce42fe8720 2024-09-10T04:51:27.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.133+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.133+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344375638336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff2d00 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.133+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3550 con 0x55ce42fe42a0 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.134+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344375638336] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.134+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.134+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344375642192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3280 con 0x55ce42fe42a0 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.134+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3d80 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.135+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344375642192] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.135+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.135+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344375646320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3d40 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.135+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff4810 con 0x7f84000be020 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.136+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344375646320] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.136+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.136+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344375643344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff4810 con 0x7f84000be020 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.136+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff5250 con 0x55ce42fe8720 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.137+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344375643344] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.137+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.138+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344375649040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff5250 con 0x55ce42fe8720 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.138+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff5c10 con 0x55ce42fed750 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.138+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344375649040] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.139+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.139+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344375651744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff51c0 con 0x55ce42fed750 2024-09-10T04:51:27.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.139+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff6ad0 con 0x55ce42fed750 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.140+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344375651744] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.140+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.140+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344375656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff7320 con 0x55ce42fed750 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.140+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff7bf0 con 0x7f84000be020 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344375656448] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344375662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff7fe0 con 0x7f84000be020 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=0 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=1 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=2 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=3 2024-09-10T04:51:27.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=4 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=5 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.141+0000 7f840cf42800 20 add_watcher() i=6 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344375662272] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f840cf42800 20 add_watcher() i=7 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f840cf42800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ffb440 con 0x55ce42fe42a0 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.142+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344375660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff8960 con 0x55ce42fe42a0 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344375660144] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f82befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f840cf42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f840cf42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f840cf42800 5 note: GC not initialized 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f82bdfe3640 20 reqs_thread_entry: start 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f840cf42800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.144+0000 7f840cf42800 20 Filter name: none 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f822f7fe640 20 reqs_thread_entry: start 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f840cf42800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce4302e070 con 0x55ce42fe42a0 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f840cf42800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce4302f490 con 0x55ce42fed750 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.145+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.146+0000 7f82befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.146+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344375660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce4302d990 con 0x55ce42fe42a0 2024-09-10T04:51:27.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.147+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94344375660144] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.147+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344375638336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff6e70 con 0x55ce42fe8720 2024-09-10T04:51:27.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.148+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94344375638336] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.148+0000 7f840cf42800 20 remove_watcher() i=0 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.148+0000 7f840cf42800 2 removed watcher, disabling cache 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.148+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344375642192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff1940 con 0x55ce42fe42a0 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.149+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94344375642192] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x55ce42fe42a0 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.149+0000 7f840cf42800 20 remove_watcher() i=1 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.149+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344375646320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff1940 con 0x55ce42fe8720 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.150+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94344375646320] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.150+0000 7f840cf42800 20 remove_watcher() i=2 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.150+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344375643344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3870 con 0x7f84000be020 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.151+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94344375643344] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.151+0000 7f840cf42800 20 remove_watcher() i=3 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.151+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344375649040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff1940 con 0x55ce42fe8720 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.153+0000 7f8408ced640 1 -- 172.21.15.145:0/3248558683 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94344375649040] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840009e020 con 0x55ce42fe8720 2024-09-10T04:51:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.153+0000 7f840cf42800 20 remove_watcher() i=4 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.153+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344375651744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff3870 con 0x55ce42fed750 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.154+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94344375651744] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.154+0000 7f840cf42800 20 remove_watcher() i=5 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.154+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344375656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff1940 con 0x55ce42fed750 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.155+0000 7f84084ec640 1 -- 172.21.15.145:0/3248558683 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94344375656448] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f0009050 con 0x55ce42fed750 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.155+0000 7f840cf42800 20 remove_watcher() i=6 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.155+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344375662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce42ff4da0 con 0x7f84000be020 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94344375662272] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f8025040 con 0x7f84000be020 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 20 remove_watcher() i=7 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42fe8720 msgr2=0x55ce42feab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42fe8720 0x55ce42feab10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42fe42a0 msgr2=0x55ce42fe6760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42fe42a0 0x55ce42fe6760 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f84000be020 msgr2=0x7f84000830d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f84000be020 0x7f84000830d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ce42fed750 msgr2=0x55ce42fefb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55ce42fed750 0x55ce42fefb40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82d403c730 msgr2=0x7f82d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82d403c730 0x7f82d403ebf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c010 tx=0x7f83f0010000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 msgr2=0x55ce42fd8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8400068ff0 tx=0x7f8400068f40 comp rx=0 tx=0).stop 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f84094ee640 1 -- 172.21.15.145:0/3248558683 reap_dead start 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 shutdown_connections 2024-09-10T04:51:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 --2- 172.21.15.145:0/3248558683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fd18b0 0x55ce42fd8cd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 >> 172.21.15.145:0/3248558683 conn(0x55ce42fcdcb0 msgr2=0x55ce42fcbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 shutdown_connections 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.156+0000 7f840cf42800 1 -- 172.21.15.145:0/3248558683 wait complete. 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 msgr2=0x7f82e003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 0x7f82e003ebf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f83f000bf40 tx=0x7f83f000f000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 msgr2=0x55ce42fc55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f84000963a0 tx=0x7f840006bdd0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 shutdown_connections 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82e003c730 0x7f82e003ebf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/2383540538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42fc51b0 0x55ce42fc55d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 >> 172.21.15.145:0/2383540538 conn(0x55ce42fb9560 msgr2=0x55ce42fb9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 shutdown_connections 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/2383540538 wait complete. 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42faf490 msgr2=0x55ce42fb1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ce42faf490 0x55ce42fb1930 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42eae030 msgr2=0x55ce42fae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ce42eae030 0x55ce42fae6a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ce42fb4d00 msgr2=0x55ce42fb70f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55ce42fb4d00 0x55ce42fb70f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82f003c730 msgr2=0x7f82f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82f003c730 0x7f82f003ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f0001d70 tx=0x7f83f00012d0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 msgr2=0x55ce42fa7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 --2- 172.21.15.145:0/3244512588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce42eacdf0 0x55ce42fa7050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8400065040 tx=0x7f8400003330 comp rx=0 tx=0).stop 2024-09-10T04:51:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f84094ee640 1 -- 172.21.15.145:0/3244512588 reap_dead start 2024-09-10T04:51:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 shutdown_connections 2024-09-10T04:51:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 >> 172.21.15.145:0/3244512588 conn(0x55ce42ea81c0 msgr2=0x55ce42f98b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 shutdown_connections 2024-09-10T04:51:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.157+0000 7f840cf42800 1 -- 172.21.15.145:0/3244512588 wait complete. 2024-09-10T04:51:27.172 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.172 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T04:51:27.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T04:51:27.173 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-10T04:51:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29bdb30800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a8458c4ff0 0x55a8458cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29bdb30800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a84576ee40 con 0x55a8458c34d0 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29bdb30800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a845739680 con 0x55a8458c4ff0 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29b3fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a8458c4ff0 0x55a8458cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29b98b0640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55a8458c34d0 0x55a8458c38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33002/0 (socket says 172.21.15.145:33002) 2024-09-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29b98b0640 1 -- 172.21.15.145:0/2026247791 learned_addr learned my addr 172.21.15.145:0/2026247791 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.219+0000 7f29b3fff640 1 -- 172.21.15.145:0/2026247791 >> v1:172.21.15.98:6789/0 conn(0x55a8458c34d0 legacy=0x55a8458c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.220+0000 7f29b3fff640 1 -- 172.21.15.145:0/2026247791 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8457556b0 con 0x55a8458c4ff0 2024-09-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.221+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2026247791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c4ff0 0x55a8458cdb10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29a400a470 tx=0x7f29a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5db058245247904 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.221+0000 7f29b90af640 1 -- 172.21.15.145:0/2026247791 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a4053570 con 0x55a8458c4ff0 2024-09-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.221+0000 7f29b90af640 1 -- 172.21.15.145:0/2026247791 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a4058070 con 0x55a8458c4ff0 2024-09-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.221+0000 7f29b90af640 1 -- 172.21.15.145:0/2026247791 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a4053880 con 0x55a8458c4ff0 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 -- 172.21.15.145:0/2026247791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c4ff0 msgr2=0x55a8458cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2026247791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c4ff0 0x55a8458cdb10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29a400a470 tx=0x7f29a4045a20 comp rx=0 tx=0).stop 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 -- 172.21.15.145:0/2026247791 shutdown_connections 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2026247791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c4ff0 0x55a8458cdb10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 -- 172.21.15.145:0/2026247791 >> 172.21.15.145:0/2026247791 conn(0x55a8458bf200 msgr2=0x55a8458c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 -- 172.21.15.145:0/2026247791 shutdown_connections 2024-09-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.222+0000 7f29bdb30800 1 -- 172.21.15.145:0/2026247791 wait complete. 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29bdb30800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29bdb30800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a84575ddd0 con 0x55a8458c34d0 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37568/0 (socket says 172.21.15.145:37568) 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29b98b0640 1 -- 172.21.15.145:0/2846014402 learned_addr learned my addr 172.21.15.145:0/2846014402 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.236+0000 7f29b98b0640 1 -- 172.21.15.145:0/2846014402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a845776e10 con 0x55a8458c34d0 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2846014402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f29ac001e40 tx=0x7f29ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cbdfb60e6b1c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f28a7e07640 1 -- 172.21.15.145:0/2846014402 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac012020 con 0x55a8458c34d0 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f28a7e07640 1 -- 172.21.15.145:0/2846014402 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac00e5a0 con 0x55a8458c34d0 2024-09-10T04:51:27.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f28a7e07640 1 -- 172.21.15.145:0/2846014402 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac00e8a0 con 0x55a8458c34d0 2024-09-10T04:51:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f29bdb30800 1 -- 172.21.15.145:0/2846014402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 msgr2=0x55a8459b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2846014402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f29ac001e40 tx=0x7f29ac001e70 comp rx=0 tx=0).stop 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.237+0000 7f29bdb30800 1 -- 172.21.15.145:0/2846014402 shutdown_connections 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2846014402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459b6890 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 -- 172.21.15.145:0/2846014402 >> 172.21.15.145:0/2846014402 conn(0x55a8458bf200 msgr2=0x55a8459b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 -- 172.21.15.145:0/2846014402 shutdown_connections 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 -- 172.21.15.145:0/2846014402 wait complete. 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29bdb30800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8458ce350 con 0x55a8458c34d0 2024-09-10T04:51:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459be1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37584/0 (socket says 172.21.15.145:37584) 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29b98b0640 1 -- 172.21.15.145:0/1944927760 learned_addr learned my addr 172.21.15.145:0/1944927760 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.238+0000 7f29b98b0640 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8459be740 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f29b98b0640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459be1e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0012b0 tx=0x7f29ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f28a6604640 1 -- 172.21.15.145:0/1944927760 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac012030 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f28a6604640 1 -- 172.21.15.145:0/1944927760 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac01a750 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8459be9d0 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f28a6604640 1 -- 172.21.15.145:0/1944927760 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac01aa70 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.239+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8459bf3d0 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f28a6604640 1 -- 172.21.15.145:0/1944927760 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f29ac015020 con 0x55a8458c34d0 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f28a6604640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f28a003c730 0x7f28a003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f28a6604640 1 -- 172.21.15.145:0/1944927760 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f29ac020030 con 0x55a8458c34d0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f29b3fff640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f28a003c730 0x7f28a003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8458c4ff0 0x55a8459c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459bffb0 con 0x55a8458c4ff0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.240+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8458c4ff0 0x55a8459c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29b3fff640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f28a003c730 0x7f28a003ebf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29a4057000 tx=0x7f29a4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8458c4ff0 0x55a8459c5830 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29ba0b1640 1 -- 172.21.15.145:0/1944927760 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8458c4ff0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459c67a0 0x55a8459c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459c91d0 con 0x55a8459c67a0 2024-09-10T04:51:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.241+0000 7f29b98b0640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459c67a0 0x55a8459c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29b98b0640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459c67a0 0x55a8459c8b90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29b98b0640 1 -- 172.21.15.145:0/1944927760 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29ac018ce0 con 0x55a8459c67a0 2024-09-10T04:51:27.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459caa80 con 0x55a8458c4ff0 2024-09-10T04:51:27.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29ba0b1640 1 -- 172.21.15.145:0/1944927760 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8458c4ff0 2024-09-10T04:51:27.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459c9cb0 con 0x55a8459c67a0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29b98b0640 1 -- 172.21.15.145:0/1944927760 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29ac018ce0 con 0x55a8459c67a0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a8459cbe30 0x55a8459ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.242+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459ce760 con 0x55a8459cbe30 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.243+0000 7f29b3fff640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a8459cbe30 0x55a8459ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.243+0000 7f29b3fff640 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a8459cbe30 0x55a8459ce220 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.243+0000 7f29b3fff640 1 -- 172.21.15.145:0/1944927760 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29a4051070 con 0x55a8459cbe30 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.243+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.243+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29bdb30800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29bdb30800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8457bba00 con 0x55a8459dc2b0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37586/0 (socket says 172.21.15.145:37586) 2024-09-10T04:51:27.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29b98b0640 1 -- 172.21.15.145:0/2592511689 learned_addr learned my addr 172.21.15.145:0/2592511689 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29b98b0640 1 -- 172.21.15.145:0/2592511689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8459dcd10 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f29ac018f90 tx=0x7f29ac04b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f289f7fe640 1 -- 172.21.15.145:0/2592511689 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac016910 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f289f7fe640 1 -- 172.21.15.145:0/2592511689 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac016ad0 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8459dd540 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f289f7fe640 1 -- 172.21.15.145:0/2592511689 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac016df0 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.244+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8459ddae0 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.245+0000 7f289f7fe640 1 -- 172.21.15.145:0/2592511689 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f29ac03d060 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.245+0000 7f289f7fe640 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 0x7f289403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.245+0000 7f289f7fe640 1 -- 172.21.15.145:0/2592511689 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f29ac037dd0 con 0x55a8459dc2b0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.245+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 0x7f289403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 0x7f289403ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55a8459bf7d0 tx=0x7f29a4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29bdb30800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29bdb30800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8459b70e0 con 0x55a8459e8b30 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37594/0 (socket says 172.21.15.145:37594) 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b98b0640 1 -- 172.21.15.145:0/1036719784 learned_addr learned my addr 172.21.15.145:0/1036719784 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b98b0640 1 -- 172.21.15.145:0/1036719784 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8459e9520 con 0x55a8459e8b30 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.246+0000 7f29b98b0640 1 --2- 172.21.15.145:0/1036719784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a6a0 tx=0x7f29ac035490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29151a84acac253d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f289d7fa640 1 -- 172.21.15.145:0/1036719784 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac067070 con 0x55a8459e8b30 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f289d7fa640 1 -- 172.21.15.145:0/1036719784 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac035590 con 0x55a8459e8b30 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f289d7fa640 1 -- 172.21.15.145:0/1036719784 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac05e040 con 0x55a8459e8b30 2024-09-10T04:51:27.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- 172.21.15.145:0/1036719784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 msgr2=0x55a8459e8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1036719784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a6a0 tx=0x7f29ac035490 comp rx=0 tx=0).stop 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- 172.21.15.145:0/1036719784 shutdown_connections 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1036719784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459e8f30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- 172.21.15.145:0/1036719784 >> 172.21.15.145:0/1036719784 conn(0x55a8459e4f30 msgr2=0x55a8459e3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- 172.21.15.145:0/1036719784 shutdown_connections 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- 172.21.15.145:0/1036719784 wait complete. 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 Processor -- start 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 -- start start 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.247+0000 7f29bdb30800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29bdb30800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8459e9990 con 0x55a8459e8b30 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29b98b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37606/0 (socket says 172.21.15.145:37606) 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 learned_addr learned my addr 172.21.15.145:0/2634288823 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8459f0510 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a6a0 tx=0x7f29ac05f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f288b7fe640 1 -- 172.21.15.145:0/2634288823 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac070020 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f288b7fe640 1 -- 172.21.15.145:0/2634288823 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac055b40 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8459f0510 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f288b7fe640 1 -- 172.21.15.145:0/2634288823 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac067040 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.248+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8459f0510 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.249+0000 7f288b7fe640 1 -- 172.21.15.145:0/2634288823 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f29ac073020 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.249+0000 7f288b7fe640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f288403c780 0x7f288403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.249+0000 7f288b7fe640 1 -- 172.21.15.145:0/2634288823 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f29ac076d60 con 0x55a8459e8b30 2024-09-10T04:51:27.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.249+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f288403c780 0x7f288403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8459fb510 0x55a8459fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459fe120 con 0x55a8459fb510 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8459fb510 0x55a8459fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f288403c780 0x7f288403ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f29a4053fd0 tx=0x7f29a4053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8459fb510 0x55a8459fd9d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 20 realm 2024-09-10T04:51:27.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.250+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459fa840 con 0x55a8459fb510 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a8459febb0 con 0x55a8459fb510 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459ff990 0x55a845a01d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a023b0 con 0x55a8459ff990 2024-09-10T04:51:27.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459ff990 0x55a845a01d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.251+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459ff990 0x55a845a01d80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a02c50 con 0x55a8459fb510 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 20 searching for the correct realm 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a845a049c0 0x55a845a06df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a845a049c0 0x55a845a06df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.252+0000 7f29b3fff640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a845a049c0 0x55a845a06df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29b98b0640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f29ac080040 0x7f29ac05c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f29ac080040 0x7f29ac05c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29ba0b1640 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f29ac080040 0x7f29ac05c800 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f29b400a4d0 con 0x7f29ac080040 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.253+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.254+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400a4d0 con 0x55a8459fb510 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.255+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.256+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.257+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459fb510 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.258+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b4030040 con 0x7f29ac080040 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a845a049c0 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.259+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a845a074c0 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a03600 con 0x55a8459fb510 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b4030040 con 0x55a8459fb510 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a03a80 con 0x55a8459ff990 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.260+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a03f20 con 0x7f29ac080040 2024-09-10T04:51:27.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 zone default found 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 4 Realm: () 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 zonegroup default 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a03230 con 0x7f29ac080040 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a098b0 con 0x55a845a049c0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a09ef0 con 0x55a845a049c0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 started sync module instance, tier type = 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.261+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a08d20 con 0x55a8459ff990 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.263+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.263+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181211017488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a08d20 con 0x55a8459ff990 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.263+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0a970 con 0x55a8459fb510 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.264+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.264+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181211017488] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.264+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181211015792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0a970 con 0x55a8459fb510 2024-09-10T04:51:27.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.264+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0b370 con 0x55a8459ff990 2024-09-10T04:51:27.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.265+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181211015792] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.265+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.265+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181211025024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0a970 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.265+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0bdf0 con 0x7f29ac080040 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.266+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181211025024] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.266+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.266+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181211027712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0bdf0 con 0x7f29ac080040 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.266+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0c8e0 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.267+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181211027712] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.267+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.267+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181211030448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0c8a0 con 0x55a8459ff990 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.267+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0d2f0 con 0x55a845a049c0 2024-09-10T04:51:27.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.268+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.268+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181211033152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0db90 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.268+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0e5f0 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.269+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181211030448] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.269+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181211033152] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.269+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.269+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181211035360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0e100 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.269+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0f030 con 0x7f29ac080040 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181211035360] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181211022528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0f030 con 0x7f29ac080040 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=0 2024-09-10T04:51:27.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=1 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=2 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=3 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=4 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=5 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.270+0000 7f29bdb30800 20 add_watcher() i=6 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.271+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181211022528] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.271+0000 7f29bdb30800 20 add_watcher() i=7 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.271+0000 7f29bdb30800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.271+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a122f0 con 0x55a8459fb510 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.272+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.272+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181211041008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0f5c0 con 0x55a8459fb510 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.273+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181211041008] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.273+0000 7f286b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.273+0000 7f29bdb30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.273+0000 7f29bdb30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.273+0000 7f29bdb30800 5 note: GC not initialized 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f286a7fc640 20 reqs_thread_entry: start 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 20 Filter name: none 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f27dbfff640 20 reqs_thread_entry: start 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a44f30 con 0x55a8459fb510 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.274+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a845a46350 con 0x55a845a049c0 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.275+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.275+0000 7f286b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.276+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181211041008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a44850 con 0x55a8459fb510 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.277+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94181211041008] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.277+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181211017488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ecf0 con 0x55a8459ff990 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.278+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94181211017488] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.278+0000 7f29bdb30800 20 remove_watcher() i=0 2024-09-10T04:51:27.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.278+0000 7f29bdb30800 2 removed watcher, disabling cache 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.278+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181211015792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ecf0 con 0x55a8459fb510 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.279+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94181211015792] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x55a8459fb510 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.279+0000 7f29bdb30800 20 remove_watcher() i=1 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.279+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181211025024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a08a70 con 0x55a8459ff990 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.281+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94181211025024] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.281+0000 7f29bdb30800 20 remove_watcher() i=2 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.281+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181211027712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ecf0 con 0x7f29ac080040 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.282+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94181211027712] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.282+0000 7f29bdb30800 20 remove_watcher() i=3 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.282+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181211030448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ae80 con 0x55a8459ff990 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.283+0000 7f29b98b0640 1 -- 172.21.15.145:0/2634288823 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94181211030448] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ac06a040 con 0x55a8459ff990 2024-09-10T04:51:27.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.283+0000 7f29bdb30800 20 remove_watcher() i=4 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.283+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181211033152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0b900 con 0x55a845a049c0 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.284+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94181211033152] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.284+0000 7f29bdb30800 20 remove_watcher() i=5 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.284+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181211035360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ecf0 con 0x55a845a049c0 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.285+0000 7f29b3fff640 1 -- 172.21.15.145:0/2634288823 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94181211035360] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a407c040 con 0x55a845a049c0 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.285+0000 7f29bdb30800 20 remove_watcher() i=6 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.285+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181211022528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a845a0ae80 con 0x7f29ac080040 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94181211022528] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b4041040 con 0x7f29ac080040 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 20 remove_watcher() i=7 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459ff990 msgr2=0x55a845a01d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459ff990 0x55a845a01d80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8459fb510 msgr2=0x55a8459fd9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8459fb510 0x55a8459fd9d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f29ac080040 msgr2=0x7f29ac05c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f29ac080040 0x7f29ac05c800 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a845a049c0 msgr2=0x55a845a06df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.286+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a845a049c0 0x55a845a06df0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f288403c780 msgr2=0x7f288403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f288403c780 0x7f288403ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f29a4053fd0 tx=0x7f29a4053000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 msgr2=0x55a8459effb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29ba0b1640 1 -- 172.21.15.145:0/2634288823 reap_dead start 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a6a0 tx=0x7f29ac05f000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 shutdown_connections 2024-09-10T04:51:27.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2634288823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459e8b30 0x55a8459effb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 >> 172.21.15.145:0/2634288823 conn(0x55a8459e4f30 msgr2=0x55a8459e3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 shutdown_connections 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2634288823 wait complete. 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 msgr2=0x7f289403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 0x7f289403ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55a8459bf7d0 tx=0x7f29a4005a00 comp rx=0 tx=0).stop 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 msgr2=0x55a8459dc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f29ac018f90 tx=0x7f29ac04b2c0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 shutdown_connections 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f289403c730 0x7f289403ebf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/2592511689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8459dc2b0 0x55a8459dc6d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 >> 172.21.15.145:0/2592511689 conn(0x55a8459d0660 msgr2=0x55a8459d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 shutdown_connections 2024-09-10T04:51:27.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/2592511689 wait complete. 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459c67a0 msgr2=0x55a8459c8b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a8459c67a0 0x55a8459c8b90 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8458c4ff0 msgr2=0x55a8459c5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a8458c4ff0 0x55a8459c5830 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a8459cbe30 msgr2=0x55a8459ce220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.287+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a8459cbe30 0x55a8459ce220 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f28a003c730 msgr2=0x7f28a003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f28a003c730 0x7f28a003ebf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29a4057000 tx=0x7f29a4052000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 msgr2=0x55a8459be1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 --2- 172.21.15.145:0/1944927760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8458c34d0 0x55a8459be1e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0012b0 tx=0x7f29ac000ed0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29ba0b1640 1 -- 172.21.15.145:0/1944927760 reap_dead start 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 shutdown_connections 2024-09-10T04:51:27.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 >> 172.21.15.145:0/1944927760 conn(0x55a8458bf200 msgr2=0x55a8459b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 shutdown_connections 2024-09-10T04:51:27.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.288+0000 7f29bdb30800 1 -- 172.21.15.145:0/1944927760 wait complete. 2024-09-10T04:51:27.304 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.304 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T04:51:27.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T04:51:27.304 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-10T04:51:27.351 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.351 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.350+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47ff13d800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5612ce0136a0 0x5612ce015a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47ff13d800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612cdebce40 con 0x5612ce016030 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47ff13d800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5612cde87680 con 0x5612ce0136a0 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fae2a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5612ce0136a0 0x5612ce015a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fae2a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5612ce0136a0 0x5612ce015a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37614/0 (socket says 172.21.15.145:37614) 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fae2a640 1 -- 172.21.15.145:0/3983807582 learned_addr learned my addr 172.21.15.145:0/3983807582 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fa629640 1 --1- 172.21.15.145:0/3983807582 >> v1:172.21.15.98:6789/0 conn(0x5612ce016030 0x5612ce0184f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33018/0 (socket says 172.21.15.145:33018) 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fae2a640 1 -- 172.21.15.145:0/3983807582 >> v1:172.21.15.98:6789/0 conn(0x5612ce016030 legacy=0x5612ce0184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.351+0000 7f47fae2a640 1 -- 172.21.15.145:0/3983807582 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612cdea36b0 con 0x5612ce0136a0 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.353+0000 7f47fae2a640 1 --2- 172.21.15.145:0/3983807582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce015a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b949c8ffd131e540 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.353+0000 7f47f9e28640 1 -- 172.21.15.145:0/3983807582 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec04e600 con 0x5612ce0136a0 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.353+0000 7f47f9e28640 1 -- 172.21.15.145:0/3983807582 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec04e7a0 con 0x5612ce0136a0 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.353+0000 7f47f9e28640 1 -- 172.21.15.145:0/3983807582 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec04eaa0 con 0x5612ce0136a0 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 -- 172.21.15.145:0/3983807582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 msgr2=0x5612ce015a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3983807582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce015a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec045cf0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 -- 172.21.15.145:0/3983807582 shutdown_connections 2024-09-10T04:51:27.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3983807582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce015a90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 -- 172.21.15.145:0/3983807582 >> 172.21.15.145:0/3983807582 conn(0x5612ce00d200 msgr2=0x5612ce00f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 -- 172.21.15.145:0/3983807582 shutdown_connections 2024-09-10T04:51:27.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.354+0000 7f47ff13d800 1 -- 172.21.15.145:0/3983807582 wait complete. 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47ff13d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47ff13d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612cdeabdd0 con 0x5612ce0136a0 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37622/0 (socket says 172.21.15.145:37622) 2024-09-10T04:51:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47fae2a640 1 -- 172.21.15.145:0/2681063999 learned_addr learned my addr 172.21.15.145:0/2681063999 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.368+0000 7f47fae2a640 1 -- 172.21.15.145:0/2681063999 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612cdec4e10 con 0x5612ce0136a0 2024-09-10T04:51:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.369+0000 7f47fae2a640 1 --2- 172.21.15.145:0/2681063999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257c83408d289be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.369+0000 7f46e8e09640 1 -- 172.21.15.145:0/2681063999 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec04eb40 con 0x5612ce0136a0 2024-09-10T04:51:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.369+0000 7f46e8e09640 1 -- 172.21.15.145:0/2681063999 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec066070 con 0x5612ce0136a0 2024-09-10T04:51:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.369+0000 7f46e8e09640 1 -- 172.21.15.145:0/2681063999 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec04ee50 con 0x5612ce0136a0 2024-09-10T04:51:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- 172.21.15.145:0/2681063999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 msgr2=0x5612ce1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 --2- 172.21.15.145:0/2681063999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec050000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- 172.21.15.145:0/2681063999 shutdown_connections 2024-09-10T04:51:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 --2- 172.21.15.145:0/2681063999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce1026a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- 172.21.15.145:0/2681063999 >> 172.21.15.145:0/2681063999 conn(0x5612ce00d200 msgr2=0x5612ce0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- 172.21.15.145:0/2681063999 shutdown_connections 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- 172.21.15.145:0/2681063999 wait complete. 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce109f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47ff13d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612ce01a050 con 0x5612ce0136a0 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce109f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce109f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37632/0 (socket says 172.21.15.145:37632) 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.370+0000 7f47fae2a640 1 -- 172.21.15.145:0/3746887490 learned_addr learned my addr 172.21.15.145:0/3746887490 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f47fae2a640 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ce10a470 con 0x5612ce0136a0 2024-09-10T04:51:27.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f47fae2a640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce109f10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f47ec063040 tx=0x7f47ec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f46e7606640 1 -- 172.21.15.145:0/3746887490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec06d550 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f46e7606640 1 -- 172.21.15.145:0/3746887490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec071030 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612ce10a700 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f46e7606640 1 -- 172.21.15.145:0/3746887490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec06d820 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.371+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612ce10b100 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f46e7606640 1 -- 172.21.15.145:0/3746887490 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f47ec06d9c0 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f46e7606640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46e003c780 0x7f46e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f46e7606640 1 -- 172.21.15.145:0/3746887490 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f47ec098340 con 0x5612ce0136a0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f47fa629640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46e003c780 0x7f46e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce016030 0x5612ce111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce10bcf0 con 0x5612ce016030 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f47fb62b640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce016030 0x5612ce111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.372+0000 7f47fa629640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46e003c780 0x7f46e003ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47f0001e30 tx=0x7f47f0001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47fb62b640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce016030 0x5612ce111560 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47fb62b640 1 -- 172.21.15.145:0/3746887490 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce016030 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce1124f0 0x5612ce1148e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce114f40 con 0x5612ce1124f0 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47fae2a640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce1124f0 0x5612ce1148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.373+0000 7f47fae2a640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce1124f0 0x5612ce1148e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47fae2a640 1 -- 172.21.15.145:0/3746887490 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47ec07d070 con 0x5612ce1124f0 2024-09-10T04:51:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1167f0 con 0x5612ce016030 2024-09-10T04:51:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47fb62b640 1 -- 172.21.15.145:0/3746887490 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce016030 2024-09-10T04:51:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce115a20 con 0x5612ce1124f0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47fae2a640 1 -- 172.21.15.145:0/3746887490 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47ec07d070 con 0x5612ce1124f0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612ce117ba0 0x5612ce119f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce11a4d0 con 0x5612ce117ba0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.374+0000 7f47fa629640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612ce117ba0 0x5612ce119f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47fa629640 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612ce117ba0 0x5612ce119f90 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47fa629640 1 -- 172.21.15.145:0/3746887490 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47f000bd50 con 0x5612ce117ba0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47ff13d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.375+0000 7f47ff13d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612cdf09a00 con 0x5612ce128050 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37640/0 (socket says 172.21.15.145:37640) 2024-09-10T04:51:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47fae2a640 1 -- 172.21.15.145:0/3861885982 learned_addr learned my addr 172.21.15.145:0/3861885982 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47fae2a640 1 -- 172.21.15.145:0/3861885982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ce128ab0 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47fae2a640 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f47ec06b010 tx=0x7f47ec058270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f46e4e01640 1 -- 172.21.15.145:0/3861885982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec08f070 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f46e4e01640 1 -- 172.21.15.145:0/3861885982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec05c040 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f46e4e01640 1 -- 172.21.15.145:0/3861885982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec061420 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612ce1292e0 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.376+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612ce1292e0 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.377+0000 7f46e4e01640 1 -- 172.21.15.145:0/3861885982 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f47ec06bb70 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.377+0000 7f46e4e01640 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 0x7f46d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.377+0000 7f46e4e01640 1 -- 172.21.15.145:0/3861885982 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f47ec0070a0 con 0x5612ce128050 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.377+0000 7f47fa629640 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 0x7f46d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.377+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fa629640 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 0x7f46d403ebf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5612ce10b500 tx=0x7f47f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47ff13d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47ff13d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612ce102e30 con 0x5612ce134740 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37656/0 (socket says 172.21.15.145:37656) 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fae2a640 1 -- 172.21.15.145:0/1221455136 learned_addr learned my addr 172.21.15.145:0/1221455136 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fae2a640 1 -- 172.21.15.145:0/1221455136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ce135130 con 0x5612ce134740 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f47fae2a640 1 --2- 172.21.15.145:0/1221455136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f47ec04ed30 tx=0x7f47ec0756c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d84b4af526ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.378+0000 7f46de7fc640 1 -- 172.21.15.145:0/1221455136 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec09d070 con 0x5612ce134740 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f46de7fc640 1 -- 172.21.15.145:0/1221455136 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec080450 con 0x5612ce134740 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f46de7fc640 1 -- 172.21.15.145:0/1221455136 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec056c90 con 0x5612ce134740 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- 172.21.15.145:0/1221455136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 msgr2=0x5612ce134b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 --2- 172.21.15.145:0/1221455136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f47ec04ed30 tx=0x7f47ec0756c0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- 172.21.15.145:0/1221455136 shutdown_connections 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 --2- 172.21.15.145:0/1221455136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce134b40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- 172.21.15.145:0/1221455136 >> 172.21.15.145:0/1221455136 conn(0x5612ce130b40 msgr2=0x5612ce12ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- 172.21.15.145:0/1221455136 shutdown_connections 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- 172.21.15.145:0/1221455136 wait complete. 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 Processor -- start 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- start start 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce13bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.379+0000 7f47ff13d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612ce1355a0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce13bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47fae2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce13bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37668/0 (socket says 172.21.15.145:37668) 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 learned_addr learned my addr 172.21.15.145:0/681272369 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ce13c1c0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47fae2a640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce13bc60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0953f0 tx=0x7f47ec052ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f46dcff9640 1 -- 172.21.15.145:0/681272369 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec056c90 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f46dcff9640 1 -- 172.21.15.145:0/681272369 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec0b1040 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612ce13c1c0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f46dcff9640 1 -- 172.21.15.145:0/681272369 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec0615c0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.380+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612ce13c1c0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.381+0000 7f46dcff9640 1 -- 172.21.15.145:0/681272369 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f47ec08f7f0 con 0x5612ce134740 2024-09-10T04:51:27.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.381+0000 7f46dcff9640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46c403c690 0x7f46c403eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.381+0000 7f46dcff9640 1 -- 172.21.15.145:0/681272369 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f47ec059160 con 0x5612ce134740 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.381+0000 7f47fa629640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46c403c690 0x7f46c403eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce147090 0x5612ce149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce149ca0 con 0x5612ce147090 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47fb62b640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce147090 0x5612ce149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47fa629640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46c403c690 0x7f46c403eb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5612ce116760 tx=0x7f47f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47fb62b640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce147090 0x5612ce149550 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce147090 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 20 realm 2024-09-10T04:51:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.382+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1463c0 con 0x5612ce147090 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce147090 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14a730 con 0x5612ce147090 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce147090 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce14b510 0x5612ce14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14df10 con 0x5612ce14b510 2024-09-10T04:51:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.383+0000 7f47fae2a640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce14b510 0x5612ce14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47fae2a640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce14b510 0x5612ce14d900 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce147090 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 20 searching for the correct realm 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5612ce1504d0 0x5612ce152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce152fd0 con 0x5612ce1504d0 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47fa629640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5612ce1504d0 0x5612ce152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.384+0000 7f47fa629640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5612ce1504d0 0x5612ce152900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce152fd0 con 0x5612ce14b510 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fae2a640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f47ec06d040 0x7f47ec0985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce152fd0 con 0x7f47ec06d040 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fb62b640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f47ec06d040 0x7f47ec0985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.385+0000 7f47fb62b640 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f47ec06d040 0x7f47ec0985e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47f40083e0 con 0x7f47ec06d040 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f40083e0 con 0x5612ce147090 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.386+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.387+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.388+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.389+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.390+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce147090 2024-09-10T04:51:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x7f47ec06d040 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.391+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce1504d0 2024-09-10T04:51:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.392+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14e760 con 0x5612ce14b510 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14efb0 con 0x5612ce147090 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14f3a0 con 0x5612ce14b510 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14f7c0 con 0x7f47ec06d040 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 zone default found 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 4 Realm: () 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.393+0000 7f47ff13d800 20 zonegroup default 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce14fbf0 con 0x7f47ec06d040 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce154e40 con 0x5612ce1504d0 2024-09-10T04:51:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1551e0 con 0x5612ce1504d0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 started sync module instance, tier type = 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.394+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1542e0 con 0x5612ce14b510 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.396+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.396+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638766900992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce155ac0 con 0x5612ce14b510 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.396+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce156310 con 0x5612ce147090 2024-09-10T04:51:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.397+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.397+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638766900992] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.397+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638766906320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce156620 con 0x5612ce147090 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.397+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce155650 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.398+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638766906320] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.398+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.398+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638766904848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce156c10 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.398+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce157630 con 0x7f47ec06d040 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.399+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638766904848] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.399+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.399+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638766911776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1575f0 con 0x7f47ec06d040 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.399+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce158040 con 0x5612ce14b510 2024-09-10T04:51:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.400+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638766911776] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.401+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.401+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638766907504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce158040 con 0x5612ce14b510 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.401+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce158a50 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.402+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638766907504] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.402+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.402+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638766914448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce157fb0 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.402+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce1597b0 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.403+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638766914448] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.403+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.403+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638766919632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15a050 con 0x5612ce1504d0 2024-09-10T04:51:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.403+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15aa10 con 0x7f47ec06d040 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638766919632] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638766923136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15aa10 con 0x7f47ec06d040 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=0 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=1 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=2 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=3 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=4 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=5 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.405+0000 7f47ff13d800 20 add_watcher() i=6 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638766923136] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47ff13d800 20 add_watcher() i=7 2024-09-10T04:51:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47ff13d800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15de40 con 0x5612ce147090 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.406+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638766925616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15b330 con 0x5612ce147090 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.407+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638766925616] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f46b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 5 note: GC not initialized 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f46b0fe1640 20 reqs_thread_entry: start 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 20 Filter name: none 2024-09-10T04:51:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f46a9ffb640 20 reqs_thread_entry: start 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.408+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce190a50 con 0x5612ce147090 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.409+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.409+0000 7f47ff13d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.409+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612ce191e70 con 0x5612ce1504d0 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.409+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.410+0000 7f46b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.410+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638766925616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce190370 con 0x5612ce147090 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.411+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94638766925616] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.411+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638766900992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce15a700 con 0x5612ce14b510 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.412+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94638766900992] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.412+0000 7f47ff13d800 20 remove_watcher() i=0 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.412+0000 7f47ff13d800 2 removed watcher, disabling cache 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.412+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638766906320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce154700 con 0x5612ce147090 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.413+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94638766906320] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x5612ce147090 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.413+0000 7f47ff13d800 20 remove_watcher() i=1 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.413+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638766904848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce154700 con 0x5612ce14b510 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.414+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94638766904848] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.414+0000 7f47ff13d800 20 remove_watcher() i=2 2024-09-10T04:51:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.414+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638766911776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce155610 con 0x7f47ec06d040 2024-09-10T04:51:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.415+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94638766911776] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.415+0000 7f47ff13d800 20 remove_watcher() i=3 2024-09-10T04:51:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.415+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638766907504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce154700 con 0x5612ce14b510 2024-09-10T04:51:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.416+0000 7f47fae2a640 1 -- 172.21.15.145:0/681272369 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94638766907504] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ec09f070 con 0x5612ce14b510 2024-09-10T04:51:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.416+0000 7f47ff13d800 20 remove_watcher() i=4 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.416+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638766914448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce155610 con 0x5612ce1504d0 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.417+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94638766914448] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.417+0000 7f47ff13d800 20 remove_watcher() i=5 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.417+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638766919632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce154700 con 0x5612ce1504d0 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.418+0000 7f47fa629640 1 -- 172.21.15.145:0/681272369 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94638766919632] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f0037040 con 0x5612ce1504d0 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.418+0000 7f47ff13d800 20 remove_watcher() i=6 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.418+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638766923136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612ce157b90 con 0x7f47ec06d040 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94638766923136] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f4025040 con 0x7f47ec06d040 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 20 remove_watcher() i=7 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce14b510 msgr2=0x5612ce14d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce14b510 0x5612ce14d900 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce147090 msgr2=0x5612ce149550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce147090 0x5612ce149550 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f47ec06d040 msgr2=0x7f47ec0985e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f47ec06d040 0x7f47ec0985e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5612ce1504d0 msgr2=0x5612ce152900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5612ce1504d0 0x5612ce152900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46c403c690 msgr2=0x7f46c403eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46c403c690 0x7f46c403eb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5612ce116760 tx=0x7f47f0010000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 msgr2=0x5612ce13bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 --2- 172.21.15.145:0/681272369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce134740 0x5612ce13bc60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0953f0 tx=0x7f47ec052ee0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 reap_dead start 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47fb62b640 1 -- 172.21.15.145:0/681272369 reap_dead start 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 shutdown_connections 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.419+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 >> 172.21.15.145:0/681272369 conn(0x5612ce130b40 msgr2=0x5612ce12ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 shutdown_connections 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/681272369 wait complete. 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 msgr2=0x7f46d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 0x7f46d403ebf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5612ce10b500 tx=0x7f47f000f000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 msgr2=0x5612ce128470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f47ec06b010 tx=0x7f47ec058270 comp rx=0 tx=0).stop 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 shutdown_connections 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46d403c730 0x7f46d403ebf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3861885982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce128050 0x5612ce128470 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 >> 172.21.15.145:0/3861885982 conn(0x5612ce11c400 msgr2=0x5612ce11c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 shutdown_connections 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3861885982 wait complete. 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce1124f0 msgr2=0x5612ce1148e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5612ce1124f0 0x5612ce1148e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce016030 msgr2=0x5612ce111560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5612ce016030 0x5612ce111560 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612ce117ba0 msgr2=0x5612ce119f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5612ce117ba0 0x5612ce119f90 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46e003c780 msgr2=0x7f46e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f46e003c780 0x7f46e003ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47f0001e30 tx=0x7f47f0001390 comp rx=0 tx=0).stop 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 msgr2=0x5612ce109f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 --2- 172.21.15.145:0/3746887490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612ce0136a0 0x5612ce109f10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f47ec063040 tx=0x7f47ec003330 comp rx=0 tx=0).stop 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47fb62b640 1 -- 172.21.15.145:0/3746887490 reap_dead start 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 shutdown_connections 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.420+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 >> 172.21.15.145:0/3746887490 conn(0x5612ce00d200 msgr2=0x5612ce103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.421+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 shutdown_connections 2024-09-10T04:51:27.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.421+0000 7f47ff13d800 1 -- 172.21.15.145:0/3746887490 wait complete. 2024-09-10T04:51:27.434 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.435 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.435 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T04:51:27.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T04:51:27.435 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-10T04:51:27.481 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.481 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f500952c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a3e02e6fb0 0x55a3e02efad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f500952c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3e0190e40 con 0x55a3e02e5490 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f500952c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a3e015b680 con 0x55a3e02e6fb0 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f4ffcaac640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a3e02e6fb0 0x55a3e02efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f50052ad640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55a3e02e5490 0x55a3e02e5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33028/0 (socket says 172.21.15.145:33028) 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f4ffcaac640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a3e02e6fb0 0x55a3e02efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37678/0 (socket says 172.21.15.145:37678) 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f50052ad640 1 -- 172.21.15.145:0/2741271737 learned_addr learned my addr 172.21.15.145:0/2741271737 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f4ffcaac640 1 -- 172.21.15.145:0/2741271737 >> v1:172.21.15.98:6789/0 conn(0x55a3e02e5490 legacy=0x55a3e02e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.481+0000 7f4ffcaac640 1 -- 172.21.15.145:0/2741271737 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e01776b0 con 0x55a3e02e6fb0 2024-09-10T04:51:27.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.483+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/2741271737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e6fb0 0x55a3e02efad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000a470 tx=0x7f4ff0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef550880b1f1fe46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.483+0000 7f5004aac640 1 -- 172.21.15.145:0/2741271737 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff0053570 con 0x55a3e02e6fb0 2024-09-10T04:51:27.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.483+0000 7f5004aac640 1 -- 172.21.15.145:0/2741271737 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0058070 con 0x55a3e02e6fb0 2024-09-10T04:51:27.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.483+0000 7f5004aac640 1 -- 172.21.15.145:0/2741271737 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff0053880 con 0x55a3e02e6fb0 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 -- 172.21.15.145:0/2741271737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e6fb0 msgr2=0x55a3e02efad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 --2- 172.21.15.145:0/2741271737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e6fb0 0x55a3e02efad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000a470 tx=0x7f4ff0045a20 comp rx=0 tx=0).stop 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 -- 172.21.15.145:0/2741271737 shutdown_connections 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 --2- 172.21.15.145:0/2741271737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e6fb0 0x55a3e02efad0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 -- 172.21.15.145:0/2741271737 >> 172.21.15.145:0/2741271737 conn(0x55a3e02e11c0 msgr2=0x55a3e02e3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 -- 172.21.15.145:0/2741271737 shutdown_connections 2024-09-10T04:51:27.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.484+0000 7f500952c800 1 -- 172.21.15.145:0/2741271737 wait complete. 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.497+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.497+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f500952c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f500952c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e017fdd0 con 0x55a3e02e5490 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37692/0 (socket says 172.21.15.145:37692) 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f50052ad640 1 -- 172.21.15.145:0/2688679668 learned_addr learned my addr 172.21.15.145:0/2688679668 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f50052ad640 1 -- 172.21.15.145:0/2688679668 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e0198e10 con 0x55a3e02e5490 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f50052ad640 1 --2- 172.21.15.145:0/2688679668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001df0 tx=0x7f4ff800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9431924e37bd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f4ef3606640 1 -- 172.21.15.145:0/2688679668 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8012020 con 0x55a3e02e5490 2024-09-10T04:51:27.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f4ef3606640 1 -- 172.21.15.145:0/2688679668 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff800e470 con 0x55a3e02e5490 2024-09-10T04:51:27.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.498+0000 7f4ef3606640 1 -- 172.21.15.145:0/2688679668 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff800e7f0 con 0x55a3e02e5490 2024-09-10T04:51:27.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 -- 172.21.15.145:0/2688679668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 msgr2=0x55a3e03d88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 --2- 172.21.15.145:0/2688679668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001df0 tx=0x7f4ff800b6c0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 -- 172.21.15.145:0/2688679668 shutdown_connections 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 --2- 172.21.15.145:0/2688679668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03d88c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 -- 172.21.15.145:0/2688679668 >> 172.21.15.145:0/2688679668 conn(0x55a3e02e11c0 msgr2=0x55a3e03d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 -- 172.21.15.145:0/2688679668 shutdown_connections 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.499+0000 7f500952c800 1 -- 172.21.15.145:0/2688679668 wait complete. 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f500952c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f500952c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e02f02e0 con 0x55a3e02e5490 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37700/0 (socket says 172.21.15.145:37700) 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f50052ad640 1 -- 172.21.15.145:0/515182312 learned_addr learned my addr 172.21.15.145:0/515182312 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f50052ad640 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e03e0750 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f50052ad640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03e01f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55a3e03d9850 tx=0x7f4ff8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.500+0000 7f4ef1e03640 1 -- 172.21.15.145:0/515182312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8012030 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.501+0000 7f4ef1e03640 1 -- 172.21.15.145:0/515182312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff801a6d0 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.501+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3e03e09e0 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.501+0000 7f4ef1e03640 1 -- 172.21.15.145:0/515182312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff801a9d0 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.501+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e03e13e0 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.501+0000 7f4ef1e03640 1 -- 172.21.15.145:0/515182312 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4ff8015020 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f4ef1e03640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4eec03c730 0x7f4eec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f4ef1e03640 1 -- 172.21.15.145:0/515182312 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4ff8020030 con 0x55a3e02e5490 2024-09-10T04:51:27.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4eec03c730 0x7f4eec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e02e6fb0 0x55a3e03e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e03e7d80 con 0x55a3e02e6fb0 2024-09-10T04:51:27.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f5005aae640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e02e6fb0 0x55a3e03e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4eec03c730 0x7f4eec03ebf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0057000 tx=0x7f4ff0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f5005aae640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e02e6fb0 0x55a3e03e7840 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.502+0000 7f5005aae640 1 -- 172.21.15.145:0/515182312 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e02e6fb0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e03e8680 0x55a3e03eab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e03eb290 con 0x55a3e03e8680 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f50052ad640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e03e8680 0x55a3e03eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f50052ad640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e03e8680 0x55a3e03eab20 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f50052ad640 1 -- 172.21.15.145:0/515182312 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ff801ad50 con 0x55a3e03e8680 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.503+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e03ecb40 con 0x55a3e02e6fb0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f5005aae640 1 -- 172.21.15.145:0/515182312 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e02e6fb0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e03ebd70 con 0x55a3e03e8680 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f50052ad640 1 -- 172.21.15.145:0/515182312 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ff801ad50 con 0x55a3e03e8680 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a3e03edef0 0x55a3e03f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e03f0820 con 0x55a3e03edef0 2024-09-10T04:51:27.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a3e03edef0 0x55a3e03f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.504+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a3e03edef0 0x55a3e03f02e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f4ffcaac640 1 -- 172.21.15.145:0/515182312 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e03edef0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f500952c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f500952c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e01dda00 con 0x55a3e03fe3a0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37702/0 (socket says 172.21.15.145:37702) 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.505+0000 7f50052ad640 1 -- 172.21.15.145:0/723125375 learned_addr learned my addr 172.21.15.145:0/723125375 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f50052ad640 1 -- 172.21.15.145:0/723125375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e03fee00 con 0x55a3e03fe3a0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f50052ad640 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8052050 tx=0x7f4ff8017e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f4eeaffd640 1 -- 172.21.15.145:0/723125375 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff80165c0 con 0x55a3e03fe3a0 2024-09-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f4eeaffd640 1 -- 172.21.15.145:0/723125375 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8050070 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3e03ff630 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f4eeaffd640 1 -- 172.21.15.145:0/723125375 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8016890 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.506+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e03ffbd0 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f4eeaffd640 1 -- 172.21.15.145:0/723125375 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4ff8022780 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f4eeaffd640 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 0x7f4edc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f4eeaffd640 1 -- 172.21.15.145:0/723125375 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4ff8037d90 con 0x55a3e03fe3a0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 0x7f4edc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 0x7f4edc03ebf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55a3e03e2150 tx=0x7f4ff0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f500952c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f500952c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e03d9110 con 0x55a3e040ac80 2024-09-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37710/0 (socket says 172.21.15.145:37710) 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.507+0000 7f50052ad640 1 -- 172.21.15.145:0/3024142329 learned_addr learned my addr 172.21.15.145:0/3024142329 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f50052ad640 1 -- 172.21.15.145:0/3024142329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e040b670 con 0x55a3e040ac80 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f50052ad640 1 --2- 172.21.15.145:0/3024142329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ff801a6a0 tx=0x7f4ff801cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de269a4df824897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f4ee8ff9640 1 -- 172.21.15.145:0/3024142329 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff803b030 con 0x55a3e040ac80 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f4ee8ff9640 1 -- 172.21.15.145:0/3024142329 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8062070 con 0x55a3e040ac80 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f4ee8ff9640 1 -- 172.21.15.145:0/3024142329 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff802dd10 con 0x55a3e040ac80 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f500952c800 1 -- 172.21.15.145:0/3024142329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 msgr2=0x55a3e040b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f500952c800 1 --2- 172.21.15.145:0/3024142329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ff801a6a0 tx=0x7f4ff801cf90 comp rx=0 tx=0).stop 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f500952c800 1 -- 172.21.15.145:0/3024142329 shutdown_connections 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f500952c800 1 --2- 172.21.15.145:0/3024142329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e040b080 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.508+0000 7f500952c800 1 -- 172.21.15.145:0/3024142329 >> 172.21.15.145:0/3024142329 conn(0x55a3e0407080 msgr2=0x55a3e04052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 -- 172.21.15.145:0/3024142329 shutdown_connections 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 -- 172.21.15.145:0/3024142329 wait complete. 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 Processor -- start 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 -- start start 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f500952c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e040bae0 con 0x55a3e040ac80 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f50052ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37716/0 (socket says 172.21.15.145:37716) 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 learned_addr learned my addr 172.21.15.145:0/3293388110 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.509+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e04124d0 con 0x55a3e040ac80 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f50052ad640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8038000 tx=0x7f4ff8053c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f4edaffd640 1 -- 172.21.15.145:0/3293388110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff806f030 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f4edaffd640 1 -- 172.21.15.145:0/3293388110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff802dd10 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3e04124d0 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f4edaffd640 1 -- 172.21.15.145:0/3293388110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8022a70 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.510+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e04124d0 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f4edaffd640 1 -- 172.21.15.145:0/3293388110 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4ff8072030 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f4edaffd640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ed003c730 0x7f4ed003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f4edaffd640 1 -- 172.21.15.145:0/3293388110 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4ff8070070 con 0x55a3e040ac80 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ed003c730 0x7f4ed003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e041d360 0x55a3e041f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e041ff70 con 0x55a3e041d360 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f5005aae640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e041d360 0x55a3e041f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.511+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ed003c730 0x7f4ed003ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0045a60 tx=0x7f4ff0053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f5005aae640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e041d360 0x55a3e041f820 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 realm 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e041c690 con 0x55a3e041d360 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0420a00 con 0x55a3e041d360 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e04217e0 0x55a3e0423bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0424200 con 0x55a3e04217e0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.512+0000 7f50052ad640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e04217e0 0x55a3e0423bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f50052ad640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e04217e0 0x55a3e0423bd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0424aa0 con 0x55a3e041d360 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 20 searching for the correct realm 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a3e0426810 0x55a3e0428c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.513+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a3e0426810 0x55a3e0428c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f4ffcaac640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a3e0426810 0x55a3e0428c40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f50052ad640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4ff8017050 0x7f4ff804c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.514+0000 7f5005aae640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4ff8017050 0x7f4ff804c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4ff8017050 0x7f4ff804c510 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f500000a4d0 con 0x7f4ff8017050 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.515+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.516+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500000a4d0 con 0x55a3e041d360 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.517+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.518+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.519+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e041d360 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x7f4ff8017050 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5000030040 con 0x7f4ff8017050 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.520+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e0426810 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.521+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0429310 con 0x55a3e04217e0 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e04253f0 con 0x55a3e041d360 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5000030040 con 0x55a3e041d360 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0425870 con 0x55a3e04217e0 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0425d10 con 0x7f4ff8017050 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 zone default found 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 4 Realm: () 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 zonegroup default 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.522+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e04297e0 con 0x7f4ff8017050 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042b330 con 0x55a3e0426810 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042b810 con 0x55a3e0426810 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 started sync module instance, tier type = 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.523+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042a670 con 0x55a3e04217e0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.524+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.524+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94162330495584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042c120 con 0x55a3e04217e0 2024-09-10T04:51:27.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.524+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042c970 con 0x55a3e041d360 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.525+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94162330495584] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.526+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.526+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94162330500208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042ca10 con 0x55a3e041d360 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.526+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042d530 con 0x55a3e04217e0 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.527+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94162330500208] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.527+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.527+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94162330505216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042d4f0 con 0x55a3e04217e0 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.527+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042df80 con 0x7f4ff8017050 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.528+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94162330505216] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.528+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.528+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94162330502336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042df40 con 0x7f4ff8017050 2024-09-10T04:51:27.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.528+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042e9d0 con 0x55a3e04217e0 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.529+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94162330502336] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.529+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.529+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94162330510560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042df40 con 0x55a3e04217e0 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.529+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042f3e0 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.530+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.530+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94162330513200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042fc80 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.530+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94162330510560] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.530+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042da90 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.531+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94162330513200] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.531+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.531+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94162330518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0430ac0 con 0x55a3e0426810 2024-09-10T04:51:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.531+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0431350 con 0x7f4ff8017050 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.532+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94162330520848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e04317c0 con 0x7f4ff8017050 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=0 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=1 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=2 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=3 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=4 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=5 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94162330518000] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f500952c800 20 add_watcher() i=6 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.533+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94162330520848] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.534+0000 7f500952c800 20 add_watcher() i=7 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.534+0000 7f500952c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.534+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0430610 con 0x55a3e041d360 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.534+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.534+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94162330522192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0430610 con 0x55a3e041d360 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94162330522192] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f4ebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f500952c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f500952c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f500952c800 5 note: GC not initialized 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.535+0000 7f4eba7e4640 20 reqs_thread_entry: start 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 20 Filter name: none 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f4e2bfff640 20 reqs_thread_entry: start 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e04673c0 con 0x55a3e041d360 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.536+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3e04687b0 con 0x55a3e0426810 2024-09-10T04:51:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.537+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.537+0000 7f4ebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.537+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94162330522192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0466ce0 con 0x55a3e041d360 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.538+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94162330522192] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.538+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94162330495584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e0431210 con 0x55a3e04217e0 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.539+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94162330495584] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.539+0000 7f500952c800 20 remove_watcher() i=0 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.539+0000 7f500952c800 2 removed watcher, disabling cache 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.539+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94162330500208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042aa60 con 0x55a3e041d360 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.540+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94162330500208] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x55a3e041d360 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.540+0000 7f500952c800 20 remove_watcher() i=1 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.540+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94162330505216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042aa60 con 0x55a3e04217e0 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.541+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94162330505216] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.541+0000 7f500952c800 20 remove_watcher() i=2 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.541+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94162330502336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042aa60 con 0x7f4ff8017050 2024-09-10T04:51:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.542+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94162330502336] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.542+0000 7f500952c800 20 remove_watcher() i=3 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.542+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94162330510560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042c4c0 con 0x55a3e04217e0 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.543+0000 7f50052ad640 1 -- 172.21.15.145:0/3293388110 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94162330510560] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff807b070 con 0x55a3e04217e0 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.543+0000 7f500952c800 20 remove_watcher() i=4 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.543+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94162330513200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042aa60 con 0x55a3e0426810 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.544+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94162330513200] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.544+0000 7f500952c800 20 remove_watcher() i=5 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.544+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94162330518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042e4e0 con 0x55a3e0426810 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.545+0000 7f4ffcaac640 1 -- 172.21.15.145:0/3293388110 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94162330518000] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff0051070 con 0x55a3e0426810 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.545+0000 7f500952c800 20 remove_watcher() i=6 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.545+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94162330520848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3e042c4c0 con 0x7f4ff8017050 2024-09-10T04:51:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.546+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94162330520848] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5000041040 con 0x7f4ff8017050 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.546+0000 7f500952c800 20 remove_watcher() i=7 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e04217e0 msgr2=0x55a3e0423bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e04217e0 0x55a3e0423bd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e041d360 msgr2=0x55a3e041f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e041d360 0x55a3e041f820 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4ff8017050 msgr2=0x7f4ff804c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4ff8017050 0x7f4ff804c510 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a3e0426810 msgr2=0x55a3e0428c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a3e0426810 0x55a3e0428c40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ed003c730 msgr2=0x7f4ed003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ed003c730 0x7f4ed003ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0045a60 tx=0x7f4ff0053000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 msgr2=0x55a3e0411f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f5005aae640 1 -- 172.21.15.145:0/3293388110 reap_dead start 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8038000 tx=0x7f4ff8053c30 comp rx=0 tx=0).stop 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 shutdown_connections 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/3293388110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e040ac80 0x55a3e0411f70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 >> 172.21.15.145:0/3293388110 conn(0x55a3e0407080 msgr2=0x55a3e0405290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 shutdown_connections 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/3293388110 wait complete. 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 msgr2=0x7f4edc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 0x7f4edc03ebf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55a3e03e2150 tx=0x7f4ff0005a00 comp rx=0 tx=0).stop 2024-09-10T04:51:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 msgr2=0x55a3e03fe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8052050 tx=0x7f4ff8017e10 comp rx=0 tx=0).stop 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 shutdown_connections 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4edc03c730 0x7f4edc03ebf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 --2- 172.21.15.145:0/723125375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e03fe3a0 0x55a3e03fe7c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 >> 172.21.15.145:0/723125375 conn(0x55a3e03f2750 msgr2=0x55a3e03f2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 shutdown_connections 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.547+0000 7f500952c800 1 -- 172.21.15.145:0/723125375 wait complete. 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e03e8680 msgr2=0x55a3e03eab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a3e03e8680 0x55a3e03eab20 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e02e6fb0 msgr2=0x55a3e03e7840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a3e02e6fb0 0x55a3e03e7840 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a3e03edef0 msgr2=0x55a3e03f02e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a3e03edef0 0x55a3e03f02e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4eec03c730 msgr2=0x7f4eec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4eec03c730 0x7f4eec03ebf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0057000 tx=0x7f4ff0052000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 msgr2=0x55a3e03e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 --2- 172.21.15.145:0/515182312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e02e5490 0x55a3e03e01f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55a3e03d9850 tx=0x7f4ff8000bc0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f5005aae640 1 -- 172.21.15.145:0/515182312 reap_dead start 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 shutdown_connections 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 >> 172.21.15.145:0/515182312 conn(0x55a3e02e11c0 msgr2=0x55a3e03d9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 shutdown_connections 2024-09-10T04:51:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.548+0000 7f500952c800 1 -- 172.21.15.145:0/515182312 wait complete. 2024-09-10T04:51:27.563 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.563 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T04:51:27.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T04:51:27.564 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-10T04:51:27.610 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.610 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a4746800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5598ba57d310 0x5598ba57d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a4746800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598ba427e40 con 0x5598ba57dd40 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a4746800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5598ba3f2680 con 0x5598ba57d310 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a2230640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5598ba57d310 0x5598ba57d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a1a2f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5598ba57dd40 0x5598ba57e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33032/0 (socket says 172.21.15.145:33032) 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a1a2f640 1 -- 172.21.15.145:0/1952282239 learned_addr learned my addr 172.21.15.145:0/1952282239 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a2230640 1 -- 172.21.15.145:0/1952282239 >> v1:172.21.15.98:6789/0 conn(0x5598ba57dd40 legacy=0x5598ba57e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.610+0000 7f39a2230640 1 -- 172.21.15.145:0/1952282239 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba40e6b0 con 0x5598ba57d310 2024-09-10T04:51:27.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.612+0000 7f39a2230640 1 --2- 172.21.15.145:0/1952282239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba57d710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f399c005fd0 tx=0x7f399c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f834a564b34800 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.612+0000 7f39a122e640 1 -- 172.21.15.145:0/1952282239 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c058530 con 0x5598ba57d310 2024-09-10T04:51:27.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a122e640 1 -- 172.21.15.145:0/1952282239 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c0586d0 con 0x5598ba57d310 2024-09-10T04:51:27.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a122e640 1 -- 172.21.15.145:0/1952282239 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0589d0 con 0x5598ba57d310 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 -- 172.21.15.145:0/1952282239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 msgr2=0x5598ba57d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 --2- 172.21.15.145:0/1952282239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba57d710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f399c005fd0 tx=0x7f399c045c30 comp rx=0 tx=0).stop 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 -- 172.21.15.145:0/1952282239 shutdown_connections 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 --2- 172.21.15.145:0/1952282239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba57d710 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 -- 172.21.15.145:0/1952282239 >> 172.21.15.145:0/1952282239 conn(0x5598ba577930 msgr2=0x5598ba579db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 -- 172.21.15.145:0/1952282239 shutdown_connections 2024-09-10T04:51:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.613+0000 7f39a4746800 1 -- 172.21.15.145:0/1952282239 wait complete. 2024-09-10T04:51:27.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a4746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a4746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5598ba416dd0 con 0x5598ba57d310 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37734/0 (socket says 172.21.15.145:37734) 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.627+0000 7f39a2230640 1 -- 172.21.15.145:0/1463733297 learned_addr learned my addr 172.21.15.145:0/1463733297 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.628+0000 7f39a2230640 1 -- 172.21.15.145:0/1463733297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba42fe10 con 0x5598ba57d310 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.628+0000 7f39a2230640 1 --2- 172.21.15.145:0/1463733297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f399c025a60 tx=0x7f399c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fa7290f9060a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.628+0000 7f3890608640 1 -- 172.21.15.145:0/1463733297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0589b0 con 0x5598ba57d310 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.628+0000 7f3890608640 1 -- 172.21.15.145:0/1463733297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c068070 con 0x5598ba57d310 2024-09-10T04:51:27.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.628+0000 7f3890608640 1 -- 172.21.15.145:0/1463733297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c058c80 con 0x5598ba57d310 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- 172.21.15.145:0/1463733297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 msgr2=0x5598ba66d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 --2- 172.21.15.145:0/1463733297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f399c025a60 tx=0x7f399c051000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- 172.21.15.145:0/1463733297 shutdown_connections 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 --2- 172.21.15.145:0/1463733297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba66d700 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- 172.21.15.145:0/1463733297 >> 172.21.15.145:0/1463733297 conn(0x5598ba577930 msgr2=0x5598ba66ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- 172.21.15.145:0/1463733297 shutdown_connections 2024-09-10T04:51:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- 172.21.15.145:0/1463733297 wait complete. 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba674eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.629+0000 7f39a4746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5598ba5840c0 con 0x5598ba57d310 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba674eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba674eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37740/0 (socket says 172.21.15.145:37740) 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a2230640 1 -- 172.21.15.145:0/473449919 learned_addr learned my addr 172.21.15.145:0/473449919 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a2230640 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba675410 con 0x5598ba57d310 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a2230640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba674eb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f399c025a60 tx=0x7f399c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f388ee05640 1 -- 172.21.15.145:0/473449919 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0635f0 con 0x5598ba57d310 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f388ee05640 1 -- 172.21.15.145:0/473449919 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c063790 con 0x5598ba57d310 2024-09-10T04:51:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ba6756a0 con 0x5598ba57d310 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f388ee05640 1 -- 172.21.15.145:0/473449919 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c063a90 con 0x5598ba57d310 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.630+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ba6760a0 con 0x5598ba57d310 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.631+0000 7f388ee05640 1 -- 172.21.15.145:0/473449919 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f399c075020 con 0x5598ba57d310 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.631+0000 7f388ee05640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f388803c780 0x7f388803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.631+0000 7f388ee05640 1 -- 172.21.15.145:0/473449919 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f399c097ea0 con 0x5598ba57d310 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.631+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f388803c780 0x7f388803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba57dd40 0x5598ba67c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba676c60 con 0x5598ba57dd40 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a2a31640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba57dd40 0x5598ba67c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f388803c780 0x7f388803ec40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f398c001d70 tx=0x7f398c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a2a31640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba57dd40 0x5598ba67c500 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a2a31640 1 -- 172.21.15.145:0/473449919 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba57dd40 2024-09-10T04:51:27.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba67d470 0x5598ba67f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.632+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba67fec0 con 0x5598ba67d470 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.633+0000 7f39a2230640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba67d470 0x5598ba67f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.633+0000 7f39a2230640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba67d470 0x5598ba67f860 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.633+0000 7f39a2230640 1 -- 172.21.15.145:0/473449919 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f399c06dd00 con 0x5598ba67d470 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.633+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba681770 con 0x5598ba57dd40 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.633+0000 7f39a2a31640 1 -- 172.21.15.145:0/473449919 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba57dd40 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6809a0 con 0x5598ba67d470 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a2230640 1 -- 172.21.15.145:0/473449919 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f399c06dd00 con 0x5598ba67d470 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5598ba682b20 0x5598ba684f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba685450 con 0x5598ba682b20 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5598ba682b20 0x5598ba684f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5598ba682b20 0x5598ba684f10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.634+0000 7f39a1a2f640 1 -- 172.21.15.145:0/473449919 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f398c009050 con 0x5598ba682b20 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a4746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a4746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5598ba474a00 con 0x5598ba669210 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37752/0 (socket says 172.21.15.145:37752) 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a2230640 1 -- 172.21.15.145:0/119347381 learned_addr learned my addr 172.21.15.145:0/119347381 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.635+0000 7f39a2230640 1 -- 172.21.15.145:0/119347381 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba669730 con 0x5598ba669210 2024-09-10T04:51:27.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f39a2230640 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f399c06dfd0 tx=0x7f399c06d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f3887fff640 1 -- 172.21.15.145:0/119347381 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c099020 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f3887fff640 1 -- 172.21.15.145:0/119347381 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c06c7d0 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f3887fff640 1 -- 172.21.15.145:0/119347381 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c087040 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ba667fc0 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.636+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ba668510 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f3887fff640 1 -- 172.21.15.145:0/119347381 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f399c08efa0 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f3887fff640 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 0x7f387c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f3887fff640 1 -- 172.21.15.145:0/119347381 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f399c0510c0 con 0x5598ba669210 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 0x7f387c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 0x7f387c03ebf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f398c0016b0 tx=0x7f398c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a4746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a4746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5598ba66de90 con 0x5598ba6a1ab0 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.637+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37766/0 (socket says 172.21.15.145:37766) 2024-09-10T04:51:27.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a2230640 1 -- 172.21.15.145:0/1541002409 learned_addr learned my addr 172.21.15.145:0/1541002409 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a2230640 1 -- 172.21.15.145:0/1541002409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba6a24a0 con 0x5598ba6a1ab0 2024-09-10T04:51:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a2230640 1 --2- 172.21.15.145:0/1541002409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f399c07fe50 tx=0x7f399c076d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ed124872e6c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f3885ffb640 1 -- 172.21.15.145:0/1541002409 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0ac070 con 0x5598ba6a1ab0 2024-09-10T04:51:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f3885ffb640 1 -- 172.21.15.145:0/1541002409 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c08b590 con 0x5598ba6a1ab0 2024-09-10T04:51:27.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f3885ffb640 1 -- 172.21.15.145:0/1541002409 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0764c0 con 0x5598ba6a1ab0 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a4746800 1 -- 172.21.15.145:0/1541002409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 msgr2=0x5598ba6a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a4746800 1 --2- 172.21.15.145:0/1541002409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f399c07fe50 tx=0x7f399c076d50 comp rx=0 tx=0).stop 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a4746800 1 -- 172.21.15.145:0/1541002409 shutdown_connections 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a4746800 1 --2- 172.21.15.145:0/1541002409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a1eb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.638+0000 7f39a4746800 1 -- 172.21.15.145:0/1541002409 >> 172.21.15.145:0/1541002409 conn(0x5598ba69deb0 msgr2=0x5598ba69c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 -- 172.21.15.145:0/1541002409 shutdown_connections 2024-09-10T04:51:27.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 -- 172.21.15.145:0/1541002409 wait complete. 2024-09-10T04:51:27.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 Processor -- start 2024-09-10T04:51:27.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 -- start start 2024-09-10T04:51:27.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a4746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5598ba6a2910 con 0x5598ba6a1ab0 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a2230640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37772/0 (socket says 172.21.15.145:37772) 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 learned_addr learned my addr 172.21.15.145:0/2672665228 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.639+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ba6a9490 con 0x5598ba6a1ab0 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f39a2230640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f399c094fa0 tx=0x7f399c077f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f3873fff640 1 -- 172.21.15.145:0/2672665228 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c0bb070 con 0x5598ba6a1ab0 2024-09-10T04:51:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f3873fff640 1 -- 172.21.15.145:0/2672665228 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c076700 con 0x5598ba6a1ab0 2024-09-10T04:51:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ba6a9490 con 0x5598ba6a1ab0 2024-09-10T04:51:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f3873fff640 1 -- 172.21.15.145:0/2672665228 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c076a40 con 0x5598ba6a1ab0 2024-09-10T04:51:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ba6a9490 con 0x5598ba6a1ab0 2024-09-10T04:51:27.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.640+0000 7f3873fff640 1 -- 172.21.15.145:0/2672665228 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f399c0c6060 con 0x5598ba6a1ab0 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f3873fff640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f386c03c730 0x7f386c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f3873fff640 1 -- 172.21.15.145:0/2672665228 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f399c0c0d60 con 0x5598ba6a1ab0 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f386c03c730 0x7f386c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba6b44e0 0x5598ba6b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6b70f0 con 0x5598ba6b44e0 2024-09-10T04:51:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a2a31640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba6b44e0 0x5598ba6b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f386c03c730 0x7f386c03ebf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f398c00bf40 tx=0x7f398c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.641+0000 7f39a2a31640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba6b44e0 0x5598ba6b69a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba6b44e0 2024-09-10T04:51:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 realm 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6b3810 con 0x5598ba6b44e0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba6b44e0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6b7b80 con 0x5598ba6b44e0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba6b44e0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba6b8960 0x5598ba6bad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bb380 con 0x5598ba6b8960 2024-09-10T04:51:27.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.642+0000 7f39a2230640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba6b8960 0x5598ba6bad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a2230640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba6b8960 0x5598ba6bad50 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba6b44e0 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 20 searching for the correct realm 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5598ba6bd990 0x5598ba6bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c0450 con 0x5598ba6bd990 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.643+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5598ba6bd990 0x5598ba6bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a1a2f640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5598ba6bd990 0x5598ba6bfd80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c0450 con 0x5598ba6b8960 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a2230640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f399c0c8070 0x7f399c082a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c0450 con 0x7f399c0c8070 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a2a31640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f399c0c8070 0x7f399c082a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.644+0000 7f39a2a31640 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f399c0c8070 0x7f399c082a90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39940083e0 con 0x7f399c0c8070 2024-09-10T04:51:27.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39940083e0 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.645+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.646+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.647+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.648+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.649+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b44e0 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x7f399c0c8070 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.650+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6bd990 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bbc20 con 0x5598ba6b8960 2024-09-10T04:51:27.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.651+0000 7f39a4746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bc470 con 0x5598ba6b44e0 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bc860 con 0x5598ba6b8960 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bcc80 con 0x7f399c0c8070 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 zone default found 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 4 Realm: () 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 zonegroup default 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6bd0b0 con 0x7f399c0c8070 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.652+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c22c0 con 0x5598ba6bd990 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c2660 con 0x5598ba6bd990 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 started sync module instance, tier type = 2024-09-10T04:51:27.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.653+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1760 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.655+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.655+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114451037056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c2f00 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.655+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c3750 con 0x5598ba6b44e0 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.656+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114451037056] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.656+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.656+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114451040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c3480 con 0x5598ba6b44e0 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.656+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c3f50 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.657+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114451040848] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.657+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.657+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114451044928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c3f10 con 0x5598ba6b8960 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.657+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c49f0 con 0x7f399c0c8070 2024-09-10T04:51:27.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.658+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114451044928] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.658+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.658+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114451042000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c49b0 con 0x7f399c0c8070 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.658+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c5460 con 0x5598ba6b8960 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.659+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114451042000] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.659+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.659+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114451050352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c49b0 con 0x5598ba6b8960 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.659+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c5ea0 con 0x5598ba6bd990 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.660+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.660+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114451050352] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.660+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114451047680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c4920 con 0x5598ba6bd990 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.660+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c6d10 con 0x5598ba6bd990 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.661+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114451047680] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.662+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.662+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114451055168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c7560 con 0x5598ba6bd990 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.662+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c7e30 con 0x7f399c0c8070 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114451060992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c86d0 con 0x7f399c0c8070 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=0 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=1 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=2 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=3 2024-09-10T04:51:27.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=4 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=5 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114451055168] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.663+0000 7f39a4746800 20 add_watcher() i=6 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.665+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114451060992] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.665+0000 7f39a4746800 20 add_watcher() i=7 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.665+0000 7f39a4746800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.665+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c86d0 con 0x5598ba6b44e0 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.666+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.666+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114451063248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c85f0 con 0x5598ba6b44e0 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114451063248] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f3858fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f39a4746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f39a4746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f39a4746800 5 note: GC not initialized 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.667+0000 7f37d37fe640 20 reqs_thread_entry: start 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 20 Filter name: none 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f37d17fa640 20 reqs_thread_entry: start 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6fe340 con 0x5598ba6b44e0 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6ff760 con 0x5598ba6bd990 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.668+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.669+0000 7f3858fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.669+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114451063248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6fdc60 con 0x5598ba6b44e0 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.670+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94114451063248] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.670+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114451037056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c81d0 con 0x5598ba6b8960 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.671+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94114451037056] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.671+0000 7f39a4746800 20 remove_watcher() i=0 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.671+0000 7f39a4746800 2 removed watcher, disabling cache 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.671+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114451040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x5598ba6b44e0 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.672+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94114451040848] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x5598ba6b44e0 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.672+0000 7f39a4746800 20 remove_watcher() i=1 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.672+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114451044928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x5598ba6b8960 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.673+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94114451044928] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.673+0000 7f39a4746800 20 remove_watcher() i=2 2024-09-10T04:51:27.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.673+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114451042000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x7f399c0c8070 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.674+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94114451042000] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.674+0000 7f39a4746800 20 remove_watcher() i=3 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.674+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114451050352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x5598ba6b8960 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.676+0000 7f39a2230640 1 -- 172.21.15.145:0/2672665228 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94114451050352] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c09b020 con 0x5598ba6b8960 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.676+0000 7f39a4746800 20 remove_watcher() i=4 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.676+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114451047680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x5598ba6bd990 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.677+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94114451047680] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.677+0000 7f39a4746800 20 remove_watcher() i=5 2024-09-10T04:51:27.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.677+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114451055168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x5598ba6bd990 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.678+0000 7f39a1a2f640 1 -- 172.21.15.145:0/2672665228 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94114451055168] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c009050 con 0x5598ba6bd990 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.678+0000 7f39a4746800 20 remove_watcher() i=6 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.678+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114451060992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598ba6c1b80 con 0x7f399c0c8070 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94114451060992] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3994025040 con 0x7f399c0c8070 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 20 remove_watcher() i=7 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba6b8960 msgr2=0x5598ba6bad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba6b8960 0x5598ba6bad50 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba6b44e0 msgr2=0x5598ba6b69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba6b44e0 0x5598ba6b69a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f399c0c8070 msgr2=0x7f399c082a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f399c0c8070 0x7f399c082a90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5598ba6bd990 msgr2=0x5598ba6bfd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5598ba6bd990 0x5598ba6bfd80 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f386c03c730 msgr2=0x7f386c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f386c03c730 0x7f386c03ebf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f398c00bf40 tx=0x7f398c010000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 msgr2=0x5598ba6a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a2a31640 1 -- 172.21.15.145:0/2672665228 reap_dead start 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f399c094fa0 tx=0x7f399c077f30 comp rx=0 tx=0).stop 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 shutdown_connections 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/2672665228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba6a1ab0 0x5598ba6a8f30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 >> 172.21.15.145:0/2672665228 conn(0x5598ba69deb0 msgr2=0x5598ba69c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 shutdown_connections 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/2672665228 wait complete. 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 msgr2=0x7f387c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.679+0000 7f39a4746800 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 0x7f387c03ebf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f398c0016b0 tx=0x7f398c00f000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 msgr2=0x5598ba667a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f399c06dfd0 tx=0x7f399c06d6f0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 shutdown_connections 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f387c03c730 0x7f387c03ebf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/119347381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba669210 0x5598ba667a80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 >> 172.21.15.145:0/119347381 conn(0x5598ba6873b0 msgr2=0x5598ba687790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 shutdown_connections 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/119347381 wait complete. 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba67d470 msgr2=0x5598ba67f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5598ba67d470 0x5598ba67f860 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba57dd40 msgr2=0x5598ba67c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5598ba57dd40 0x5598ba67c500 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5598ba682b20 msgr2=0x5598ba684f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5598ba682b20 0x5598ba684f10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f388803c780 msgr2=0x7f388803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f388803c780 0x7f388803ec40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f398c001d70 tx=0x7f398c0012d0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 msgr2=0x5598ba674eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 --2- 172.21.15.145:0/473449919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5598ba57d310 0x5598ba674eb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f399c025a60 tx=0x7f399c003330 comp rx=0 tx=0).stop 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a2a31640 1 -- 172.21.15.145:0/473449919 reap_dead start 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 shutdown_connections 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 >> 172.21.15.145:0/473449919 conn(0x5598ba577930 msgr2=0x5598ba666f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 shutdown_connections 2024-09-10T04:51:27.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.680+0000 7f39a4746800 1 -- 172.21.15.145:0/473449919 wait complete. 2024-09-10T04:51:27.714 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T04:00:00.000000Z","epoch":1725940800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T04:51:27.715 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:51:27.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T04:51:27.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T04:51:27.715 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-10T04:51:27.768 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.768 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.767+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.767+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.767+0000 7fe7c4b28800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55988ac2d4c0 0x55988ac2d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.767+0000 7fe7c4b28800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55988aad8e40 con 0x55988ac2de00 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.767+0000 7fe7c4b28800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55988aaa3680 con 0x55988ac2d4c0 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7c086f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55988ac2d4c0 0x55988ac2d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7b806e640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55988ac2de00 0x55988ac2e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33046/0 (socket says 172.21.15.145:33046) 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7c086f640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55988ac2d4c0 0x55988ac2d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37786/0 (socket says 172.21.15.145:37786) 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7b806e640 1 -- 172.21.15.145:0/2111835772 learned_addr learned my addr 172.21.15.145:0/2111835772 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7c086f640 1 -- 172.21.15.145:0/2111835772 >> v1:172.21.15.98:6789/0 conn(0x55988ac2de00 legacy=0x55988ac2e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.768+0000 7fe7c086f640 1 -- 172.21.15.145:0/2111835772 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988aabf6b0 con 0x55988ac2d4c0 2024-09-10T04:51:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2111835772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ac2d8c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000a470 tx=0x7fe7b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2982046c07d93918 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7bbfff640 1 -- 172.21.15.145:0/2111835772 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0053570 con 0x55988ac2d4c0 2024-09-10T04:51:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7bbfff640 1 -- 172.21.15.145:0/2111835772 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0058070 con 0x55988ac2d4c0 2024-09-10T04:51:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7bbfff640 1 -- 172.21.15.145:0/2111835772 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0053880 con 0x55988ac2d4c0 2024-09-10T04:51:27.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2111835772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 msgr2=0x55988ac2d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2111835772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ac2d8c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000a470 tx=0x7fe7b0045a20 comp rx=0 tx=0).stop 2024-09-10T04:51:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2111835772 shutdown_connections 2024-09-10T04:51:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2111835772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ac2d8c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2111835772 >> 172.21.15.145:0/2111835772 conn(0x55988ac291f0 msgr2=0x55988ac2b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2111835772 shutdown_connections 2024-09-10T04:51:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.770+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2111835772 wait complete. 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.784+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.784+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.784+0000 7fe7c4b28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.784+0000 7fe7c4b28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55988aac7dd0 con 0x55988ac2d4c0 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37790/0 (socket says 172.21.15.145:37790) 2024-09-10T04:51:27.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe7c086f640 1 -- 172.21.15.145:0/888727710 learned_addr learned my addr 172.21.15.145:0/888727710 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe7c086f640 1 -- 172.21.15.145:0/888727710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988aae0e10 con 0x55988ac2d4c0 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe7c086f640 1 --2- 172.21.15.145:0/888727710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0025c20 tx=0x7fe7b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fcf122c0866a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe6aee0d640 1 -- 172.21.15.145:0/888727710 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0053570 con 0x55988ac2d4c0 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe6aee0d640 1 -- 172.21.15.145:0/888727710 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0063070 con 0x55988ac2d4c0 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.785+0000 7fe6aee0d640 1 -- 172.21.15.145:0/888727710 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0053840 con 0x55988ac2d4c0 2024-09-10T04:51:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 -- 172.21.15.145:0/888727710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 msgr2=0x55988ad20970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/888727710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0025c20 tx=0x7fe7b0051000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 -- 172.21.15.145:0/888727710 shutdown_connections 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/888727710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad20970 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 -- 172.21.15.145:0/888727710 >> 172.21.15.145:0/888727710 conn(0x55988ac291f0 msgr2=0x55988ad1c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 -- 172.21.15.145:0/888727710 shutdown_connections 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 -- 172.21.15.145:0/888727710 wait complete. 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.786+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c4b28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad28190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c4b28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55988ac2ed80 con 0x55988ac2d4c0 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad28190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad28190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37792/0 (socket says 172.21.15.145:37792) 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c086f640 1 -- 172.21.15.145:0/1842017320 learned_addr learned my addr 172.21.15.145:0/1842017320 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c086f640 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988ad286f0 con 0x55988ac2d4c0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c086f640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad28190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0053d60 tx=0x7fe7b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe6ad60a640 1 -- 172.21.15.145:0/1842017320 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0068470 con 0x55988ac2d4c0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe6ad60a640 1 -- 172.21.15.145:0/1842017320 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0068610 con 0x55988ac2d4c0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55988ad28980 con 0x55988ac2d4c0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.787+0000 7fe6ad60a640 1 -- 172.21.15.145:0/1842017320 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b00688f0 con 0x55988ac2d4c0 2024-09-10T04:51:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.788+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988ad29380 con 0x55988ac2d4c0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.788+0000 7fe6ad60a640 1 -- 172.21.15.145:0/1842017320 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe7b0068a90 con 0x55988ac2d4c0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.788+0000 7fe6ad60a640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe6a803c730 0x7fe6a803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe6ad60a640 1 -- 172.21.15.145:0/1842017320 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe7b0097fe0 con 0x55988ac2d4c0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7b806e640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe6a803c730 0x7fe6a803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ac2de00 0x55988ad2f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad29f30 con 0x55988ac2de00 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c1070640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ac2de00 0x55988ad2f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7b806e640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe6a803c730 0x7fe6a803ebf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8001d70 tx=0x7fe7a80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c1070640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ac2de00 0x55988ad2f7e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c1070640 1 -- 172.21.15.145:0/1842017320 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ac2de00 2024-09-10T04:51:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad30710 0x55988ad32b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.789+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad33160 con 0x55988ad30710 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.790+0000 7fe7c086f640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad30710 0x55988ad32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.790+0000 7fe7c086f640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad30710 0x55988ad32b00 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.790+0000 7fe7c086f640 1 -- 172.21.15.145:0/1842017320 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7b0079020 con 0x55988ad30710 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.790+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad34a10 con 0x55988ac2de00 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7c1070640 1 -- 172.21.15.145:0/1842017320 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ac2de00 2024-09-10T04:51:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad33b50 con 0x55988ad30710 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7c086f640 1 -- 172.21.15.145:0/1842017320 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7b0079020 con 0x55988ad30710 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55988ad345c0 0x55988ad37dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad38540 con 0x55988ad345c0 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7b806e640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55988ad345c0 0x55988ad37dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.791+0000 7fe7b806e640 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55988ad345c0 0x55988ad37dd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7b806e640 1 -- 172.21.15.145:0/1842017320 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad345c0 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c4b28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c4b28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55988ab25a00 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37796/0 (socket says 172.21.15.145:37796) 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.792+0000 7fe7c086f640 1 -- 172.21.15.145:0/2744901503 learned_addr learned my addr 172.21.15.145:0/2744901503 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe7c086f640 1 -- 172.21.15.145:0/2744901503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988ad46c20 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00962a0 tx=0x7fe7b005d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe6a67fc640 1 -- 172.21.15.145:0/2744901503 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b005c410 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe6a67fc640 1 -- 172.21.15.145:0/2744901503 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b005c5b0 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe6a67fc640 1 -- 172.21.15.145:0/2744901503 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b005c890 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55988ad47450 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.793+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988ad479f0 con 0x55988ad461c0 2024-09-10T04:51:27.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe6a67fc640 1 -- 172.21.15.145:0/2744901503 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe7b007c440 con 0x55988ad461c0 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe6a67fc640 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 0x7fe69803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe6a67fc640 1 -- 172.21.15.145:0/2744901503 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe7b0090070 con 0x55988ad461c0 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 0x7fe69803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 0x7fe69803ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80016b0 tx=0x7fe7a800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7c4b28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.794+0000 7fe7c4b28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55988ad21160 con 0x55988ad52a80 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37808/0 (socket says 172.21.15.145:37808) 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe7c086f640 1 -- 172.21.15.145:0/2269321829 learned_addr learned my addr 172.21.15.145:0/2269321829 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe7c086f640 1 -- 172.21.15.145:0/2269321829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988ad53450 con 0x55988ad52a80 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2269321829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0052f10 tx=0x7fe7b0099730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d128cd0856ba04fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe697fff640 1 -- 172.21.15.145:0/2269321829 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b005ecd0 con 0x55988ad52a80 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe697fff640 1 -- 172.21.15.145:0/2269321829 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b00ae070 con 0x55988ad52a80 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.795+0000 7fe697fff640 1 -- 172.21.15.145:0/2269321829 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b005e7b0 con 0x55988ad52a80 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2269321829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 msgr2=0x55988ad52e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2269321829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0052f10 tx=0x7fe7b0099730 comp rx=0 tx=0).stop 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2269321829 shutdown_connections 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2269321829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad52e60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2269321829 >> 172.21.15.145:0/2269321829 conn(0x55988ad4ee80 msgr2=0x55988ad4d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2269321829 shutdown_connections 2024-09-10T04:51:27.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2269321829 wait complete. 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 Processor -- start 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- start start 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad59e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c4b28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55988ad538e0 con 0x55988ad52a80 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad59e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c086f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad59e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37822/0 (socket says 172.21.15.145:37822) 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.796+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 learned_addr learned my addr 172.21.15.145:0/2597840772 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988ad5a3a0 con 0x55988ad52a80 2024-09-10T04:51:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad59e40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0088e90 tx=0x7fe7b00a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe6967fc640 1 -- 172.21.15.145:0/2597840772 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0074d50 con 0x55988ad52a80 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe6967fc640 1 -- 172.21.15.145:0/2597840772 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0051800 con 0x55988ad52a80 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55988ad5a3a0 con 0x55988ad52a80 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe6967fc640 1 -- 172.21.15.145:0/2597840772 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b00519b0 con 0x55988ad52a80 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.797+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988ad5a3a0 con 0x55988ad52a80 2024-09-10T04:51:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.798+0000 7fe6967fc640 1 -- 172.21.15.145:0/2597840772 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe7b0060a50 con 0x55988ad52a80 2024-09-10T04:51:27.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.798+0000 7fe6967fc640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe68c03c730 0x7fe68c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.798+0000 7fe6967fc640 1 -- 172.21.15.145:0/2597840772 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe7b0084040 con 0x55988ad52a80 2024-09-10T04:51:27.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.798+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe68c03c730 0x7fe68c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.798+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe68c03c730 0x7fe68c03ebf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800efd0 tx=0x7fe7a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ad65250 0x55988ad67710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad67e60 con 0x55988ad65250 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c1070640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ad65250 0x55988ad67710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c1070640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ad65250 0x55988ad67710 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 realm 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad64580 con 0x55988ad65250 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.799+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad688f0 con 0x55988ad65250 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad696d0 0x55988ad6bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad696d0 0x55988ad6bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad696d0 0x55988ad6bac0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.800+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c970 con 0x55988ad65250 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7c4b28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7c4b28800 20 searching for the correct realm 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55988ad6e6e0 0x55988ad70af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad711c0 con 0x55988ad6e6e0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55988ad6e6e0 0x55988ad70af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7b806e640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55988ad6e6e0 0x55988ad70af0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.801+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad711c0 con 0x55988ad696d0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c086f640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe7b005f040 0x7fe7b00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe7b005f040 0x7fe7b00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe7b005f040 0x7fe7b00b3810 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x7fe7b005f040 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.802+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.803+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc00a4d0 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.804+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.805+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.806+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad65250 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.807+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x7fe7b005f040 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7bc030040 con 0x7fe7b005f040 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad6e6e0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.808+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6c120 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6d1c0 con 0x55988ad65250 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7bc030040 con 0x55988ad65250 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6d5b0 con 0x55988ad696d0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.809+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6d5b0 con 0x7fe7b005f040 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 zone default found 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 4 Realm: () 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 zonegroup default 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad6cdb0 con 0x7fe7b005f040 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad73030 con 0x55988ad6e6e0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad733d0 con 0x55988ad6e6e0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 started sync module instance, tier type = 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.810+0000 7fe7c4b28800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.811+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad724d0 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.812+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.812+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113652746752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad724d0 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.812+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad73d90 con 0x55988ad65250 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.813+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.813+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113652750560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad73d60 con 0x55988ad65250 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.813+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad74d70 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.813+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113652746752] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.814+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113652750560] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.814+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.814+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113652752768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad74d30 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.814+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad75610 con 0x7fe7b005f040 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.815+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113652752768] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.815+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.815+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113652754464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad74d30 con 0x7fe7b005f040 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.815+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad75d20 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.816+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113652754464] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.816+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.816+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113652758528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad75d20 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.816+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad76730 con 0x55988ad6e6e0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.817+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113652758528] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.817+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.817+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113652761216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad76b20 con 0x55988ad6e6e0 2024-09-10T04:51:27.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.817+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad77540 con 0x55988ad6e6e0 2024-09-10T04:51:27.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.819+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113652761216] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.819+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.819+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113652756304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad77e10 con 0x55988ad6e6e0 2024-09-10T04:51:27.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.819+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad787d0 con 0x7fe7b005f040 2024-09-10T04:51:27.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113652770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad78ef0 con 0x7fe7b005f040 2024-09-10T04:51:27.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=0 2024-09-10T04:51:27.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=1 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=2 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=3 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=4 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.820+0000 7fe7c4b28800 20 add_watcher() i=5 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.821+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113652756304] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.821+0000 7fe7c4b28800 20 add_watcher() i=6 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.821+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113652770048] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.822+0000 7fe7c4b28800 20 add_watcher() i=7 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.822+0000 7fe7c4b28800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.822+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988ad77960 con 0x55988ad65250 2024-09-10T04:51:27.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.822+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.822+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113652771232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988ad77960 con 0x55988ad65250 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.823+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113652771232] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.823+0000 7fe6777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 5 note: GC not initialized 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe6767e4640 20 reqs_thread_entry: start 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 Filter name: none 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe66f7fe640 20 reqs_thread_entry: start 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T04:51:27.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988adaf070 con 0x7fe7b005f040 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.824+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988adad710 con 0x55988ad65250 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T04:51:27.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.825+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adadfe0 con 0x7fe7b005f040 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c4b28800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c4b28800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c4b28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94113652988720 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988adb29b0 con 0x7fe7b005f040 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== watch-notify(notify (1) cookie 94113652770048 notify 146028888074 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55988adae380 con 0x7fe7b005f040 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe697fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94113652770048 notifier 4727 bl.length()=556 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe697fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T04:51:27.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe697fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(65 notify.7 [notify cookie 94113652988720 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe697fff640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe684003ea0 con 0x7fe7b005f040 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.826+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== watch-notify(notify_complete (2) cookie 94113652988720 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55988adae9c0 con 0x7fe7b005f040 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.827+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adb04e0 con 0x55988ad65250 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7c4b28800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7c4b28800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7c4b28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94113652988608 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55988adb29b0 con 0x55988ad6e6e0 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== watch-notify(notify (1) cookie 94113652761216 notify 146028888078 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55988aad8e40 con 0x55988ad6e6e0 2024-09-10T04:51:27.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe6977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94113652761216 notifier 4727 bl.length()=177 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe6977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe6977fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(68 notify.5 [notify cookie 94113652988608 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe6977fe640 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5e8003400 con 0x55988ad6e6e0 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== watch-notify(notify_complete (2) cookie 94113652988608 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe7a8038500 con 0x55988ad6e6e0 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.828+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.850 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T04:51:27.826062Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:51:27.826044Z","tags":[],"group_ids":[]} 2024-09-10T04:51:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.829+0000 7fe6777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.829+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113652771232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad65250 2024-09-10T04:51:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.830+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94113652771232] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.830+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113652746752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad696d0 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.832+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94113652746752] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.832+0000 7fe7c4b28800 20 remove_watcher() i=0 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.832+0000 7fe7c4b28800 2 removed watcher, disabling cache 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.832+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113652750560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad65250 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.832+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94113652750560] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x55988ad65250 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.833+0000 7fe7c4b28800 20 remove_watcher() i=1 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.833+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113652752768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad696d0 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.834+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94113652752768] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.834+0000 7fe7c4b28800 20 remove_watcher() i=2 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.834+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113652754464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x7fe7b005f040 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.835+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94113652754464] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.835+0000 7fe7c4b28800 20 remove_watcher() i=3 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.835+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113652758528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad696d0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.836+0000 7fe7c086f640 1 -- 172.21.15.145:0/2597840772 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94113652758528] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7b00c4020 con 0x55988ad696d0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.836+0000 7fe7c4b28800 20 remove_watcher() i=4 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.836+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113652761216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad6e6e0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.837+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94113652761216] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.837+0000 7fe7c4b28800 20 remove_watcher() i=5 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.837+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113652756304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x55988ad6e6e0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.838+0000 7fe7b806e640 1 -- 172.21.15.145:0/2597840772 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94113652756304] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a8009050 con 0x55988ad6e6e0 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.838+0000 7fe7c4b28800 20 remove_watcher() i=6 2024-09-10T04:51:27.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.838+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113652770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55988adace40 con 0x7fe7b005f040 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94113652770048] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7bc041040 con 0x7fe7b005f040 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 20 remove_watcher() i=7 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad696d0 msgr2=0x55988ad6bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad696d0 0x55988ad6bac0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ad65250 msgr2=0x55988ad67710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ad65250 0x55988ad67710 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe7b005f040 msgr2=0x7fe7b00b3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe7b005f040 0x7fe7b00b3810 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55988ad6e6e0 msgr2=0x55988ad70af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55988ad6e6e0 0x55988ad70af0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe68c03c730 msgr2=0x7fe68c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe68c03c730 0x7fe68c03ebf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800efd0 tx=0x7fe7a8010000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 msgr2=0x55988ad59e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2597840772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad52a80 0x55988ad59e40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0088e90 tx=0x7fe7b00a8000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c1070640 1 -- 172.21.15.145:0/2597840772 reap_dead start 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 shutdown_connections 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.839+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 >> 172.21.15.145:0/2597840772 conn(0x55988ad4ee80 msgr2=0x55988ad4d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 shutdown_connections 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2597840772 wait complete. 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 msgr2=0x7fe69803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 0x7fe69803ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80016b0 tx=0x7fe7a800f000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 msgr2=0x55988ad465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00962a0 tx=0x7fe7b005d460 comp rx=0 tx=0).stop 2024-09-10T04:51:27.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 shutdown_connections 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe69803c780 0x7fe69803ec40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/2744901503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ad461c0 0x55988ad465e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 >> 172.21.15.145:0/2744901503 conn(0x55988ad3a520 msgr2=0x55988ad3a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 shutdown_connections 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/2744901503 wait complete. 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad30710 msgr2=0x55988ad32b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55988ad30710 0x55988ad32b00 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ac2de00 msgr2=0x55988ad2f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55988ac2de00 0x55988ad2f7e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55988ad345c0 msgr2=0x55988ad37dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55988ad345c0 0x55988ad37dd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe6a803c730 msgr2=0x7fe6a803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe6a803c730 0x7fe6a803ebf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8001d70 tx=0x7fe7a80012d0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 msgr2=0x55988ad28190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 --2- 172.21.15.145:0/1842017320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55988ac2d4c0 0x55988ad28190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0053d60 tx=0x7fe7b0002fb0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c1070640 1 -- 172.21.15.145:0/1842017320 reap_dead start 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 shutdown_connections 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 >> 172.21.15.145:0/1842017320 conn(0x55988ac291f0 msgr2=0x55988ad1aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 shutdown_connections 2024-09-10T04:51:27.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.840+0000 7fe7c4b28800 1 -- 172.21.15.145:0/1842017320 wait complete. 2024-09-10T04:51:27.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T04:51:27.826062Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:51:27.826044Z', 'tags': [], 'group_ids': []} 2024-09-10T04:51:27.877 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:51:27.883 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-10T04:51:27.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T04:51:27.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T04:51:27.883 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-10T04:51:27.929 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:27.930 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:27.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.929+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.929+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.929+0000 7f5977319800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5616d309de00 0x5616d309eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.929+0000 7f5977319800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616d2f48e40 con 0x5616d309f040 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.929+0000 7f5977319800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5616d2f13680 con 0x5616d309de00 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974e03640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5616d309de00 0x5616d309eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974e03640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5616d309de00 0x5616d309eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37830/0 (socket says 172.21.15.145:37830) 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974e03640 1 -- 172.21.15.145:0/3578096088 learned_addr learned my addr 172.21.15.145:0/3578096088 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974602640 1 --1- 172.21.15.145:0/3578096088 >> v1:172.21.15.98:6789/0 conn(0x5616d309f040 0x5616d30a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:33050/0 (socket says 172.21.15.145:33050) 2024-09-10T04:51:27.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974e03640 1 -- 172.21.15.145:0/3578096088 >> v1:172.21.15.98:6789/0 conn(0x5616d309f040 legacy=0x5616d30a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.930+0000 7f5974e03640 1 -- 172.21.15.145:0/3578096088 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d2f2f6b0 con 0x5616d309de00 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5974e03640 1 --2- 172.21.15.145:0/3578096088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d309eb00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5964005fd0 tx=0x7f5964045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bc12640dc7cf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5973e01640 1 -- 172.21.15.145:0/3578096088 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596404e600 con 0x5616d309de00 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5973e01640 1 -- 172.21.15.145:0/3578096088 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596404e7a0 con 0x5616d309de00 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5973e01640 1 -- 172.21.15.145:0/3578096088 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596404eaa0 con 0x5616d309de00 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5977319800 1 -- 172.21.15.145:0/3578096088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 msgr2=0x5616d309eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.932+0000 7f5977319800 1 --2- 172.21.15.145:0/3578096088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d309eb00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5964005fd0 tx=0x7f5964045cf0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.933+0000 7f5977319800 1 -- 172.21.15.145:0/3578096088 shutdown_connections 2024-09-10T04:51:27.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.933+0000 7f5977319800 1 --2- 172.21.15.145:0/3578096088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d309eb00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.933+0000 7f5977319800 1 -- 172.21.15.145:0/3578096088 >> 172.21.15.145:0/3578096088 conn(0x5616d30991d0 msgr2=0x5616d309b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.933+0000 7f5977319800 1 -- 172.21.15.145:0/3578096088 shutdown_connections 2024-09-10T04:51:27.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.933+0000 7f5977319800 1 -- 172.21.15.145:0/3578096088 wait complete. 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.946+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.946+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.946+0000 7f5977319800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.946+0000 7f5977319800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616d2f37dd0 con 0x5616d309de00 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37838/0 (socket says 172.21.15.145:37838) 2024-09-10T04:51:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5974e03640 1 -- 172.21.15.145:0/2852594468 learned_addr learned my addr 172.21.15.145:0/2852594468 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5974e03640 1 -- 172.21.15.145:0/2852594468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d2f50e10 con 0x5616d309de00 2024-09-10T04:51:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5974e03640 1 --2- 172.21.15.145:0/2852594468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5964005fd0 tx=0x7f5964050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9225287742af2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5862e0d640 1 -- 172.21.15.145:0/2852594468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596404eb40 con 0x5616d309de00 2024-09-10T04:51:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5862e0d640 1 -- 172.21.15.145:0/2852594468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964066070 con 0x5616d309de00 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.947+0000 7f5862e0d640 1 -- 172.21.15.145:0/2852594468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596404ee50 con 0x5616d309de00 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 -- 172.21.15.145:0/2852594468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 msgr2=0x5616d318d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 --2- 172.21.15.145:0/2852594468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5964005fd0 tx=0x7f5964050000 comp rx=0 tx=0).stop 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 -- 172.21.15.145:0/2852594468 shutdown_connections 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 --2- 172.21.15.145:0/2852594468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d318d570 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 -- 172.21.15.145:0/2852594468 >> 172.21.15.145:0/2852594468 conn(0x5616d30991d0 msgr2=0x5616d3188ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 -- 172.21.15.145:0/2852594468 shutdown_connections 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 -- 172.21.15.145:0/2852594468 wait complete. 2024-09-10T04:51:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.948+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5977319800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d3194de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5977319800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616d309f730 con 0x5616d309de00 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d3194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d3194de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37840/0 (socket says 172.21.15.145:37840) 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5974e03640 1 -- 172.21.15.145:0/3283193659 learned_addr learned my addr 172.21.15.145:0/3283193659 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5974e03640 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d3195340 con 0x5616d309de00 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5974e03640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d3194de0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5964063040 tx=0x7f5964003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f586160a640 1 -- 172.21.15.145:0/3283193659 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596406d550 con 0x5616d309de00 2024-09-10T04:51:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f586160a640 1 -- 172.21.15.145:0/3283193659 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964071030 con 0x5616d309de00 2024-09-10T04:51:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d31955d0 con 0x5616d309de00 2024-09-10T04:51:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.949+0000 7f586160a640 1 -- 172.21.15.145:0/3283193659 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596406d820 con 0x5616d309de00 2024-09-10T04:51:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.950+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d3195fd0 con 0x5616d309de00 2024-09-10T04:51:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.950+0000 7f586160a640 1 -- 172.21.15.145:0/3283193659 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f596406d9c0 con 0x5616d309de00 2024-09-10T04:51:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.950+0000 7f586160a640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f585c03c780 0x7f585c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f586160a640 1 -- 172.21.15.145:0/3283193659 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f5964098340 con 0x5616d309de00 2024-09-10T04:51:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5974602640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f585c03c780 0x7f585c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d309f040 0x5616d319c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3196bc0 con 0x5616d309f040 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5975604640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d309f040 0x5616d319c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5974602640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f585c03c780 0x7f585c03ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f595c001e30 tx=0x7f595c001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5975604640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d309f040 0x5616d319c430 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5975604640 1 -- 172.21.15.145:0/3283193659 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d309f040 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d319d3c0 0x5616d319f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.951+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d319fe10 con 0x5616d319d3c0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.952+0000 7f5974e03640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d319d3c0 0x5616d319f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.952+0000 7f5974e03640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d319d3c0 0x5616d319f7b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.952+0000 7f5974e03640 1 -- 172.21.15.145:0/3283193659 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f596407d070 con 0x5616d319d3c0 2024-09-10T04:51:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.952+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31a16c0 con 0x5616d309f040 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5975604640 1 -- 172.21.15.145:0/3283193659 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d309f040 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31a08f0 con 0x5616d319d3c0 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5974e03640 1 -- 172.21.15.145:0/3283193659 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f596407d070 con 0x5616d319d3c0 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5616d31a2a70 0x5616d31a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31a53a0 con 0x5616d31a2a70 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5974602640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5616d31a2a70 0x5616d31a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.953+0000 7f5974602640 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5616d31a2a70 0x5616d31a4e60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5974602640 1 -- 172.21.15.145:0/3283193659 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f595c00bd50 con 0x5616d31a2a70 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5977319800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5977319800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616d2f95a00 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37848/0 (socket says 172.21.15.145:37848) 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.954+0000 7f5974e03640 1 -- 172.21.15.145:0/4064704598 learned_addr learned my addr 172.21.15.145:0/4064704598 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f5974e03640 1 -- 172.21.15.145:0/4064704598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d31b4a90 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f5974e03640 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f596406b010 tx=0x7f5964058270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f585a7fc640 1 -- 172.21.15.145:0/4064704598 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596408f070 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f585a7fc640 1 -- 172.21.15.145:0/4064704598 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596405c040 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d31b52c0 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f585a7fc640 1 -- 172.21.15.145:0/4064704598 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5964061420 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.955+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d31b52c0 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f585a7fc640 1 -- 172.21.15.145:0/4064704598 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f596406bb70 con 0x5616d31b4030 2024-09-10T04:51:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f585a7fc640 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 0x7f584c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f585a7fc640 1 -- 172.21.15.145:0/4064704598 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f59640070a0 con 0x5616d31b4030 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5974602640 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 0x7f584c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5974602640 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 0x7f584c03ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5616d31963d0 tx=0x7f595c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5977319800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5977319800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616d318dd00 con 0x5616d31a73d0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37856/0 (socket says 172.21.15.145:37856) 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.956+0000 7f5974e03640 1 -- 172.21.15.145:0/236622111 learned_addr learned my addr 172.21.15.145:0/236622111 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5974e03640 1 -- 172.21.15.145:0/236622111 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d31a7dc0 con 0x5616d31a73d0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5974e03640 1 --2- 172.21.15.145:0/236622111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5964081fa0 tx=0x7f59640769e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c76d77ecaa10908 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f584bfff640 1 -- 172.21.15.145:0/236622111 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59640af070 con 0x5616d31a73d0 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f584bfff640 1 -- 172.21.15.145:0/236622111 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964076420 con 0x5616d31a73d0 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f584bfff640 1 -- 172.21.15.145:0/236622111 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f596409d040 con 0x5616d31a73d0 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 -- 172.21.15.145:0/236622111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 msgr2=0x5616d31a77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 --2- 172.21.15.145:0/236622111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5964081fa0 tx=0x7f59640769e0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 -- 172.21.15.145:0/236622111 shutdown_connections 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 --2- 172.21.15.145:0/236622111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31a77d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 -- 172.21.15.145:0/236622111 >> 172.21.15.145:0/236622111 conn(0x5616d31bcae0 msgr2=0x5616d31bad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 -- 172.21.15.145:0/236622111 shutdown_connections 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.957+0000 7f5977319800 1 -- 172.21.15.145:0/236622111 wait complete. 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5977319800 1 Processor -- start 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5977319800 1 -- start start 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5977319800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5977319800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5616d31a82b0 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5974e03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:37860/0 (socket says 172.21.15.145:37860) 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 learned_addr learned my addr 172.21.15.145:0/692716351 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.958+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d31ca240 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f5974e03640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f59640461a0 tx=0x7f5964075f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f584a7fc640 1 -- 172.21.15.145:0/692716351 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59640b7020 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f584a7fc640 1 -- 172.21.15.145:0/692716351 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640808d0 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f584a7fc640 1 -- 172.21.15.145:0/692716351 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59640af040 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d31ca240 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.959+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d31cae50 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.960+0000 7f584a7fc640 1 -- 172.21.15.145:0/692716351 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f59640ba020 con 0x5616d31a73d0 2024-09-10T04:51:27.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.960+0000 7f584a7fc640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584003c780 0x7f584003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.960+0000 7f584a7fc640 1 -- 172.21.15.145:0/692716351 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f59640bdd60 con 0x5616d31a73d0 2024-09-10T04:51:27.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.960+0000 7f5974602640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584003c780 0x7f584003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5974602640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584003c780 0x7f584003ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5616d31a1630 tx=0x7f595c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d31d5310 0x5616d31d77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31d7f20 con 0x5616d31d5310 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5975604640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d31d5310 0x5616d31d77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.961+0000 7f5975604640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d31d5310 0x5616d31d77d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d31d5310 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 realm 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31d4640 con 0x5616d31d5310 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d31d5310 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31d89b0 con 0x5616d31d5310 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d31d5310 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d31d9790 0x5616d31dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dc1b0 con 0x5616d31d9790 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.962+0000 7f5974e03640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d31d9790 0x5616d31dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5974e03640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d31d9790 0x5616d31dbb80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d31d5310 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 20 searching for the correct realm 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5616d31de770 0x5616d31e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e1290 con 0x5616d31de770 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.963+0000 7f5974602640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5616d31de770 0x5616d31e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974602640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5616d31de770 0x5616d31e0bc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e1290 con 0x5616d31d9790 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974e03640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f59640bc020 0x7f596404d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e1290 con 0x7f59640bc020 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.964+0000 7f5975604640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f59640bc020 0x7f596404d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f59640bc020 0x7f596404d380 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f596c0083e0 con 0x7f59640bc020 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c0083e0 con 0x5616d31d5310 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.965+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.966+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.967+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.968+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.969+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.970+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x7f59640bc020 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31de770 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.971+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dca00 con 0x5616d31d9790 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dd250 con 0x5616d31d5310 2024-09-10T04:51:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dd640 con 0x5616d31d9790 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.972+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31dda60 con 0x7f59640bc020 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 zone default found 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 4 Realm: () 2024-09-10T04:51:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 zonegroup default 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e1710 con 0x7f59640bc020 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e3230 con 0x5616d31de770 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e3780 con 0x5616d31de770 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 started sync module instance, tier type = 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.973+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e25a0 con 0x5616d31d9790 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.975+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.975+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656031238544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e4090 con 0x5616d31d9790 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.975+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e48e0 con 0x5616d31d5310 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.976+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.976+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656031244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e4b20 con 0x5616d31d5310 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.976+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656031238544] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.976+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5110 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.977+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656031244432] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.977+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.977+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656031243232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5110 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.977+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5b50 con 0x7f59640bc020 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.978+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656031243232] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.978+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.978+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656031245680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5b50 con 0x7f59640bc020 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.978+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e6570 con 0x5616d31d9790 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.979+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656031245680] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.979+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.979+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656031252576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5b50 con 0x5616d31d9790 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.979+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e6fb0 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.980+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656031252576] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.980+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.980+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656031250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e5ac0 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.980+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e7e20 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.981+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.982+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656031261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e8a90 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.982+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e94d0 con 0x7f59640bc020 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.982+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656031250080] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:27.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656031264672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e9490 con 0x7f59640bc020 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=0 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=1 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=2 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=3 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=4 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=5 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656031261120] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:27.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.983+0000 7f5977319800 20 add_watcher() i=6 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656031264672] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5977319800 20 add_watcher() i=7 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5977319800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e85e0 con 0x5616d31d5310 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.984+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656031257424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d31e85e0 con 0x5616d31d5310 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.985+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656031257424] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.985+0000 7f582afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.985+0000 7f5977319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.985+0000 7f5977319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.985+0000 7f5977319800 5 note: GC not initialized 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5829fe3640 20 reqs_thread_entry: start 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 20 Filter name: none 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f579b7fe640 20 reqs_thread_entry: start 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d321f590 con 0x7f59640bc020 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.986+0000 7f5977319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.987+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d32236b0 con 0x7f59640bc020 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5977319800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5977319800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94656031498544 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3224300 con 0x5616d31de770 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== watch-notify(notify (1) cookie 94656031250080 notify 146028888079 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f595c018040 con 0x5616d31de770 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f584bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94656031250080 notifier 4734 bl.length()=382 2024-09-10T04:51:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f584bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f584bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f584bfff640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5838003ea0 con 0x5616d31de770 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(64 notify.5 [notify cookie 94656031498544 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== watch-notify(notify_complete (2) cookie 94656031498544 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f595c009050 con 0x5616d31de770 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.988+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32241e0 con 0x5616d31d5310 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 : miss 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 20 rados->read ofs=0 len=0 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 8.1 8:8747c80c:root::.bucket.meta.myfoo6%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3221970 con 0x5616d31d5310 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(67 .bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.989+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 8.1 8:8747c80c:root::.bucket.meta.myfoo6%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d322b3e0 con 0x5616d31d5310 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.990+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(68 .bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.990+0000 7f5977319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.990+0000 7f5977319800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.990+0000 7f5977319800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.990+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9, ofs0, ns] 2024-09-10T04:51:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 94656031498224 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d322a0b0 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94656031252576 notify 146028888101 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5616d31b4a90 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f584b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94656031252576 notifier 4734 bl.length()=756 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f584b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f584b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f584b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(69 notify.4 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f584b7fe640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f57a8003530 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5964095040 con 0x5616d31d9790 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): orig_sources= new_sources= 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): potential sources added=[] removed=[] 2024-09-10T04:51:28.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): orig_dests= new_dests= 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): potential dests added=[] removed=[] 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.991+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3221ff0 con 0x5616d31d9790 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.992+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.992+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3229c00 con 0x5616d31d9790 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.993+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.993+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d322ac10 con 0x5616d31d5310 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.994+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.994+0000 7f5977319800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.994+0000 7f5977319800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.994+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.994+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94656031498224 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3224990 con 0x7f59640bc020 2024-09-10T04:51:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== watch-notify(notify (1) cookie 94656031245680 notify 146028888076 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5616d3228770 con 0x7f59640bc020 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f584b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94656031245680 notifier 4734 bl.length()=316 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f584b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f584b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f584b7fe640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f57a8003560 con 0x7f59640bc020 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(74 notify.3 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616d3221d60 con 0x7f59640bc020 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5977319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 : hit (requested=0x17, cached=0x17) 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5977319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.995+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 8.1 8:8747c80c:root::.bucket.meta.myfoo6%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3227e70 con 0x5616d31d5310 2024-09-10T04:51:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'7 uv7 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5977319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5977319800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5977319800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9, ofs0, ns] 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.996+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94656031498224 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3224e40 con 0x5616d31d9790 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== watch-notify(notify (1) cookie 94656031252576 notify 146028888102 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7f5964095040 con 0x5616d31d9790 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 notify.4 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f584bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94656031252576 notifier 4734 bl.length()=756 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f584bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f584bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f584bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T04:51:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f584bfff640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5838003ea0 con 0x5616d31d9790 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616d3195fd0 con 0x5616d31d9790 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): orig_sources= new_sources= 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): potential sources added=[] removed=[] 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): orig_dests= new_dests= 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5977319800 20 handle_bi_update(): bucket=:myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]): potential dests added=[] removed=[] 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.997+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 4.0 4:00d109ae:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31de770 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.998+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(79 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.998+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 4.5 4:a2a7b319:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d9790 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.998+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(80 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.998+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:81 4.1b 4:d92a389f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x7f59640bc020 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.999+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(81 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.999+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:82 4.3 4:c0bcfcc7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x7f59640bc020 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.999+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(82 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:27.999+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 4.25 4:a73ef476:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:84 4.3d 4:bd5ad4de:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(84 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:85 4.34 4:2c557535:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x7f59640bc020 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(85 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.000+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:86 4.5 4:a269b7c9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(86 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:87 4.4 4:226b1684:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d5310 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(87 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:88 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31d5310 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(88 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [call out=382b] v0'0 uv11 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5977319800 10 cls_bucket_list_unordered: got thirteen 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.001+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:89 4.21 4:868a1fc5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32224a0 con 0x5616d31de770 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(89 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 get_obj_state: octx=0x5616d31a77d0 obj=myfoo6:thirteen state=0x5616d32202f8 s->prefetch_data=0 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:90 3.cs0 3:332be2a3:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d32228d0 con 0x5616d31d9790 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(90 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 10 manifest: total_size = 8 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.15662239260690218326 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-10T04:51:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 get_obj_state: octx=0x5616d31a77d0 obj=myfoo6:thirteen state=0x5616d32202f8 s->prefetch_data=0 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 : hit (requested=0x17, cached=0x17) 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.002+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:91 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3227e40 con 0x5616d31d5310 2024-09-10T04:51:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.004+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(91 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.004+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:92 3.cs0 3:332be2a3:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3227e40 con 0x5616d31d9790 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.005+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(92 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.005+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:93 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d322e0b0 con 0x5616d31d5310 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:1 objects processed in :myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9]). Next marker thirteen 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.005+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x7f59640bc020 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(93 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f584bfff640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5977319800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5977319800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T04:51:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.006+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94656031498224 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== watch-notify(notify (1) cookie 94656031250080 notify 146028888080 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f595c009050 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f584b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94656031250080 notifier 4734 bl.length()=556 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f584b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f584b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(95 notify.5 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f584b7fe640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f57a8003090 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616d2f48e40 con 0x5616d31de770 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.007+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x5616d31d5310 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5977319800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5977319800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T04:51:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94656031498224 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== watch-notify(notify (1) cookie 94656031250080 notify 146028888081 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5616d2f48e40 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f584bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94656031250080 notifier 4734 bl.length()=177 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f584bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f584bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(98 notify.5 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.008+0000 7f584bfff640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5838003ea0 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.009+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.009+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f595c01fe70 con 0x5616d31de770 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.009+0000 7f5977319800 10 removing user index: bar 2024-09-10T04:51:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.009+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(100 bar [delete] v34'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5977319800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5977319800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94656031498224 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== watch-notify(notify (1) cookie 94656031264672 notify 146028888077 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5616d3224050 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f584b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94656031264672 notifier 4734 bl.length()=152 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f584b7fe640 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f57a8003090 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(101 notify.7 [notify cookie 94656031498224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.010+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.011+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== watch-notify(notify_complete (2) cookie 94656031498224 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616d322ac10 con 0x7f59640bc020 2024-09-10T04:51:28.030 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T04:51:27.826062Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:51:27.826044Z","tags":[],"group_ids":[]} 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.011+0000 7f582afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.011+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656031257424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x5616d31d5310 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.013+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94656031257424] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.013+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656031238544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d3223cb0 con 0x5616d31d9790 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.014+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94656031238544] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.014+0000 7f5977319800 20 remove_watcher() i=0 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.014+0000 7f5977319800 2 removed watcher, disabling cache 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.014+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656031244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x5616d31d5310 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.015+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94656031244432] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x5616d31d5310 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.015+0000 7f5977319800 20 remove_watcher() i=1 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.015+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656031243232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x5616d31d9790 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.016+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94656031243232] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.016+0000 7f5977319800 20 remove_watcher() i=2 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.016+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656031245680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x7f59640bc020 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.017+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94656031245680] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.017+0000 7f5977319800 20 remove_watcher() i=3 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.017+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656031252576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x5616d31d9790 2024-09-10T04:51:28.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.018+0000 7f5974e03640 1 -- 172.21.15.145:0/692716351 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94656031252576] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596409f070 con 0x5616d31d9790 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.018+0000 7f5977319800 20 remove_watcher() i=4 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.018+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656031250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x5616d31de770 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.019+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94656031250080] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.019+0000 7f5977319800 20 remove_watcher() i=5 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.019+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656031261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x5616d31de770 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.020+0000 7f5974602640 1 -- 172.21.15.145:0/692716351 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94656031261120] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c037040 con 0x5616d31de770 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.020+0000 7f5977319800 20 remove_watcher() i=6 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.020+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656031264672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616d321d3f0 con 0x7f59640bc020 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94656031264672] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f596c025040 con 0x7f59640bc020 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 20 remove_watcher() i=7 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d31d9790 msgr2=0x5616d31dbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d31d9790 0x5616d31dbb80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d31d5310 msgr2=0x5616d31d77d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d31d5310 0x5616d31d77d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f59640bc020 msgr2=0x7f596404d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f59640bc020 0x7f596404d380 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5616d31de770 msgr2=0x5616d31e0bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5616d31de770 0x5616d31e0bc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584003c780 msgr2=0x7f584003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584003c780 0x7f584003ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5616d31a1630 tx=0x7f595c010000 comp rx=0 tx=0).stop 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5975604640 1 -- 172.21.15.145:0/692716351 reap_dead start 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 msgr2=0x5616d31c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f59640461a0 tx=0x7f5964075f10 comp rx=0 tx=0).stop 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 shutdown_connections 2024-09-10T04:51:28.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 --2- 172.21.15.145:0/692716351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31a73d0 0x5616d31c9ce0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 >> 172.21.15.145:0/692716351 conn(0x5616d31bcae0 msgr2=0x5616d31bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 shutdown_connections 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.021+0000 7f5977319800 1 -- 172.21.15.145:0/692716351 wait complete. 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 msgr2=0x7f584c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 0x7f584c03ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5616d31963d0 tx=0x7f595c00f000 comp rx=0 tx=0).stop 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 msgr2=0x5616d31b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f596406b010 tx=0x7f5964058270 comp rx=0 tx=0).stop 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 shutdown_connections 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f584c03c780 0x7f584c03ec40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/4064704598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d31b4030 0x5616d31b4450 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 >> 172.21.15.145:0/4064704598 conn(0x5616d31a95e0 msgr2=0x5616d31ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:28.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 shutdown_connections 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/4064704598 wait complete. 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d319d3c0 msgr2=0x5616d319f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5616d319d3c0 0x5616d319f7b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d309f040 msgr2=0x5616d319c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5616d309f040 0x5616d319c430 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5616d31a2a70 msgr2=0x5616d31a4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5616d31a2a70 0x5616d31a4e60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f585c03c780 msgr2=0x7f585c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f585c03c780 0x7f585c03ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f595c001e30 tx=0x7f595c001390 comp rx=0 tx=0).stop 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 msgr2=0x5616d3194de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 --2- 172.21.15.145:0/3283193659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5616d309de00 0x5616d3194de0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5964063040 tx=0x7f5964003330 comp rx=0 tx=0).stop 2024-09-10T04:51:28.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5975604640 1 -- 172.21.15.145:0/3283193659 reap_dead start 2024-09-10T04:51:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 shutdown_connections 2024-09-10T04:51:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 >> 172.21.15.145:0/3283193659 conn(0x5616d30991d0 msgr2=0x5616d318e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 shutdown_connections 2024-09-10T04:51:28.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:28.022+0000 7f5977319800 1 -- 172.21.15.145:0/3283193659 wait complete. 2024-09-10T04:51:28.041 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T04:51:27.826062Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:51:27.826044Z', 'tags': [], 'group_ids': []} 2024-09-10T04:51:33.049 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:51:33.049 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T04:51:33.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T04:51:33.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T04:51:33.049 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-10T04:51:33.110 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:33.110 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.109+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.109+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.109+0000 7fb52b926800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e62b6b4640 0x55e62b6b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.109+0000 7fb52b926800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e62b55de40 con 0x55e62b6b7060 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.109+0000 7fb52b926800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55e62b528680 con 0x55e62b6b4640 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.110+0000 7fb5275d9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e62b6b4640 0x55e62b6b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.110+0000 7fb5275d9640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e62b6b4640 0x55e62b6b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59528/0 (socket says 172.21.15.145:59528) 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.110+0000 7fb5275d9640 1 -- 172.21.15.145:0/2242507648 learned_addr learned my addr 172.21.15.145:0/2242507648 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.110+0000 7fb5275d9640 1 -- 172.21.15.145:0/2242507648 >> v1:172.21.15.98:6789/0 conn(0x55e62b6b7060 legacy=0x55e62b6b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.110+0000 7fb5275d9640 1 -- 172.21.15.145:0/2242507648 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b5446b0 con 0x55e62b6b4640 2024-09-10T04:51:33.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.112+0000 7fb5275d9640 1 --2- 172.21.15.145:0/2242507648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b6a30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb518005fd0 tx=0x7fb518045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c0f99e7589ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.112+0000 7fb5265d7640 1 -- 172.21.15.145:0/2242507648 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51804e600 con 0x55e62b6b4640 2024-09-10T04:51:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.112+0000 7fb5265d7640 1 -- 172.21.15.145:0/2242507648 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51804e7a0 con 0x55e62b6b4640 2024-09-10T04:51:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.112+0000 7fb5265d7640 1 -- 172.21.15.145:0/2242507648 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51804eaa0 con 0x55e62b6b4640 2024-09-10T04:51:33.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 -- 172.21.15.145:0/2242507648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 msgr2=0x55e62b6b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 --2- 172.21.15.145:0/2242507648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b6a30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb518005fd0 tx=0x7fb518045cf0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 -- 172.21.15.145:0/2242507648 shutdown_connections 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 --2- 172.21.15.145:0/2242507648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b6a30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 -- 172.21.15.145:0/2242507648 >> 172.21.15.145:0/2242507648 conn(0x55e62b6ae200 msgr2=0x55e62b6b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 -- 172.21.15.145:0/2242507648 shutdown_connections 2024-09-10T04:51:33.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.113+0000 7fb52b926800 1 -- 172.21.15.145:0/2242507648 wait complete. 2024-09-10T04:51:33.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.128+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb52b926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb52b926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e62b54cdd0 con 0x55e62b6b4640 2024-09-10T04:51:33.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59540/0 (socket says 172.21.15.145:59540) 2024-09-10T04:51:33.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb5275d9640 1 -- 172.21.15.145:0/3489768722 learned_addr learned my addr 172.21.15.145:0/3489768722 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.129+0000 7fb5275d9640 1 -- 172.21.15.145:0/3489768722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b565e10 con 0x55e62b6b4640 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.130+0000 7fb5275d9640 1 --2- 172.21.15.145:0/3489768722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb518005fd0 tx=0x7fb518050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1da63b00a279aae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.130+0000 7fb41560a640 1 -- 172.21.15.145:0/3489768722 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51804eb40 con 0x55e62b6b4640 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.130+0000 7fb41560a640 1 -- 172.21.15.145:0/3489768722 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518066070 con 0x55e62b6b4640 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.130+0000 7fb41560a640 1 -- 172.21.15.145:0/3489768722 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51804ee50 con 0x55e62b6b4640 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- 172.21.15.145:0/3489768722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 msgr2=0x55e62b6b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 --2- 172.21.15.145:0/3489768722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb518005fd0 tx=0x7fb518050000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- 172.21.15.145:0/3489768722 shutdown_connections 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 --2- 172.21.15.145:0/3489768722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b6b3dd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- 172.21.15.145:0/3489768722 >> 172.21.15.145:0/3489768722 conn(0x55e62b6ae200 msgr2=0x55e62b79f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- 172.21.15.145:0/3489768722 shutdown_connections 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- 172.21.15.145:0/3489768722 wait complete. 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b7ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb52b926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e62b6bb080 con 0x55e62b6b4640 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b7ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b7ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59548/0 (socket says 172.21.15.145:59548) 2024-09-10T04:51:33.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.131+0000 7fb5275d9640 1 -- 172.21.15.145:0/2756772198 learned_addr learned my addr 172.21.15.145:0/2756772198 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb5275d9640 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b7ad790 con 0x55e62b6b4640 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb5275d9640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b7ad230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb518063040 tx=0x7fb518003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb413e07640 1 -- 172.21.15.145:0/2756772198 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51806d550 con 0x55e62b6b4640 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb413e07640 1 -- 172.21.15.145:0/2756772198 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518071030 con 0x55e62b6b4640 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e62b7ada20 con 0x55e62b6b4640 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb413e07640 1 -- 172.21.15.145:0/2756772198 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51806d820 con 0x55e62b6b4640 2024-09-10T04:51:33.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.132+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e62b7ae420 con 0x55e62b6b4640 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb413e07640 1 -- 172.21.15.145:0/2756772198 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb51806d9c0 con 0x55e62b6b4640 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb413e07640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40c03c780 0x7fb40c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb413e07640 1 -- 172.21.15.145:0/2756772198 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb518098340 con 0x55e62b6b4640 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb526dd8640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40c03c780 0x7fb40c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b6b7060 0x55e62b7b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.133+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7b4dc0 con 0x55e62b6b7060 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb527dda640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b6b7060 0x55e62b7b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb526dd8640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40c03c780 0x7fb40c03ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb510001e50 tx=0x7fb5100013d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb527dda640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b6b7060 0x55e62b7b4880 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb527dda640 1 -- 172.21.15.145:0/2756772198 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b6b7060 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7b5670 0x55e62b7b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7b8280 con 0x55e62b7b5670 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.134+0000 7fb5275d9640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7b5670 0x55e62b7b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.135+0000 7fb5275d9640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7b5670 0x55e62b7b7b10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.135+0000 7fb5275d9640 1 -- 172.21.15.145:0/2756772198 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb51807d070 con 0x55e62b7b5670 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.135+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7b9b30 con 0x55e62b6b7060 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb527dda640 1 -- 172.21.15.145:0/2756772198 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b6b7060 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7b8d60 con 0x55e62b7b5670 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb5275d9640 1 -- 172.21.15.145:0/2756772198 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb51807d070 con 0x55e62b7b5670 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e62b7baee0 0x55e62b7bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7bd810 con 0x55e62b7baee0 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb526dd8640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e62b7baee0 0x55e62b7bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.136+0000 7fb526dd8640 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e62b7baee0 0x55e62b7bd2d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb526dd8640 1 -- 172.21.15.145:0/2756772198 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb510010600 con 0x55e62b7baee0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb52b926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb52b926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e62b5aaa00 con 0x55e62b7cb3a0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59550/0 (socket says 172.21.15.145:59550) 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.137+0000 7fb5275d9640 1 -- 172.21.15.145:0/664915548 learned_addr learned my addr 172.21.15.145:0/664915548 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb5275d9640 1 -- 172.21.15.145:0/664915548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b7cbe00 con 0x55e62b7cb3a0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb5275d9640 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb5180965d0 tx=0x7fb518058270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb411602640 1 -- 172.21.15.145:0/664915548 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51808f070 con 0x55e62b7cb3a0 2024-09-10T04:51:33.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb411602640 1 -- 172.21.15.145:0/664915548 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51805c040 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e62b7cc630 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb411602640 1 -- 172.21.15.145:0/664915548 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518061420 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.138+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e62b7cc630 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.139+0000 7fb411602640 1 -- 172.21.15.145:0/664915548 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb51806bb70 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.139+0000 7fb411602640 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 0x7fb40003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.139+0000 7fb411602640 1 -- 172.21.15.145:0/664915548 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb51807b060 con 0x55e62b7cb3a0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.139+0000 7fb526dd8640 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 0x7fb40003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb526dd8640 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 0x7fb40003ebf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e62b7af140 tx=0x7fb510006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb52b926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb52b926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e62b6b2670 con 0x55e62b7d7ae0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59556/0 (socket says 172.21.15.145:59556) 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb5275d9640 1 -- 172.21.15.145:0/2792915391 learned_addr learned my addr 172.21.15.145:0/2792915391 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb5275d9640 1 -- 172.21.15.145:0/2792915391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b7d84b0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.140+0000 7fb5275d9640 1 --2- 172.21.15.145:0/2792915391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb518096890 tx=0x7fb518052fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91b76ab8fade1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb40affd640 1 -- 172.21.15.145:0/2792915391 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5180615c0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb40affd640 1 -- 172.21.15.145:0/2792915391 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5180a6070 con 0x55e62b7d7ae0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb40affd640 1 -- 172.21.15.145:0/2792915391 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518076590 con 0x55e62b7d7ae0 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 -- 172.21.15.145:0/2792915391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 msgr2=0x55e62b7d7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 --2- 172.21.15.145:0/2792915391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb518096890 tx=0x7fb518052fc0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 -- 172.21.15.145:0/2792915391 shutdown_connections 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 --2- 172.21.15.145:0/2792915391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7d7ec0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 -- 172.21.15.145:0/2792915391 >> 172.21.15.145:0/2792915391 conn(0x55e62b7d3ee0 msgr2=0x55e62b7d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 -- 172.21.15.145:0/2792915391 shutdown_connections 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 -- 172.21.15.145:0/2792915391 wait complete. 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.141+0000 7fb52b926800 1 Processor -- start 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb52b926800 1 -- start start 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb52b926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7def50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb52b926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e62b7d8940 con 0x55e62b7d7ae0 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb5275d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7def50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59564/0 (socket says 172.21.15.145:59564) 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 learned_addr learned my addr 172.21.15.145:0/1568215189 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62b7df4b0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.142+0000 7fb5275d9640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7def50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb518080860 tx=0x7fb518073f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.143+0000 7fb4097fa640 1 -- 172.21.15.145:0/1568215189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5180615c0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.143+0000 7fb4097fa640 1 -- 172.21.15.145:0/1568215189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51806a890 con 0x55e62b7d7ae0 2024-09-10T04:51:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.143+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e62b7df4b0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.143+0000 7fb4097fa640 1 -- 172.21.15.145:0/1568215189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51806abb0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.143+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e62b7df4b0 con 0x55e62b7d7ae0 2024-09-10T04:51:33.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb4097fa640 1 -- 172.21.15.145:0/1568215189 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb5180bb060 con 0x55e62b7d7ae0 2024-09-10T04:51:33.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb4097fa640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3f003c780 0x7fb3f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb4097fa640 1 -- 172.21.15.145:0/1568215189 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb5180b1050 con 0x55e62b7d7ae0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb526dd8640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3f003c780 0x7fb3f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb526dd8640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3f003c780 0x7fb3f003ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb51000bf70 tx=0x7fb510011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.144+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b7ea4e0 0x55e62b7ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7ed0f0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb527dda640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b7ea4e0 0x55e62b7ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb527dda640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b7ea4e0 0x55e62b7ec9a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb52b926800 20 realm 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7e9810 con 0x55e62b7ea4e0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.145+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7edb80 con 0x55e62b7ea4e0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7ee960 0x55e62b7f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f13b0 con 0x55e62b7ee960 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb5275d9640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7ee960 0x55e62b7f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.146+0000 7fb5275d9640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7ee960 0x55e62b7f0d50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 20 searching for the correct realm 2024-09-10T04:51:33.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e62b7f3970 0x55e62b7f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f6430 con 0x55e62b7f3970 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb526dd8640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e62b7f3970 0x55e62b7f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.147+0000 7fb526dd8640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e62b7f3970 0x55e62b7f5d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f6430 con 0x55e62b7ee960 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb5275d9640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb5180bd070 0x7fb5180808d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f6430 con 0x7fb5180bd070 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb527dda640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb5180bd070 0x7fb5180808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.148+0000 7fb527dda640 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb5180bd070 0x7fb5180808d0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5200083e0 con 0x7fb5180bd070 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5200083e0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.149+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.150+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.151+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.152+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.153+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ea4e0 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.154+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x7fb5180bd070 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.155+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7f3970 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f1c00 con 0x55e62b7ee960 2024-09-10T04:51:33.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.156+0000 7fb52b926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f2450 con 0x55e62b7ea4e0 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f2840 con 0x55e62b7ee960 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f2c60 con 0x7fb5180bd070 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.157+0000 7fb52b926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 zone default found 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 4 Realm: () 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:33.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 zonegroup default 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f68b0 con 0x7fb5180bd070 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f83a0 con 0x55e62b7f3970 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f88c0 con 0x55e62b7f3970 2024-09-10T04:51:33.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 started sync module instance, tier type = 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.158+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7740 con 0x55e62b7ee960 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.160+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.160+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447060614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7740 con 0x55e62b7ee960 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.160+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f93f0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.161+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.161+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447060614208] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.161+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447060618944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7740 con 0x55e62b7ea4e0 2024-09-10T04:51:33.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.161+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f9ea0 con 0x55e62b7ee960 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.162+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447060618944] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.162+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.162+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447060621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7740 con 0x55e62b7ee960 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.162+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fa910 con 0x7fb5180bd070 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.163+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447060621696] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.164+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.164+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447060624384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fa8d0 con 0x7fb5180bd070 2024-09-10T04:51:33.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.164+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fb350 con 0x55e62b7ee960 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.165+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447060624384] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.165+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.165+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447060627040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fb350 con 0x55e62b7ee960 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.165+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fbd90 con 0x55e62b7f3970 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.166+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.166+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447060629600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fc630 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.166+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fd0f0 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.167+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447060629600] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.167+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.167+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447060634560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fd4e0 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.167+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fdf00 con 0x7fb5180bd070 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.167+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447060627040] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447060634560] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447060631936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7fdec0 con 0x7fb5180bd070 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=0 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=1 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=2 2024-09-10T04:51:33.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=3 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=4 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=5 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.168+0000 7fb52b926800 20 add_watcher() i=6 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.169+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447060631936] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.169+0000 7fb52b926800 20 add_watcher() i=7 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.169+0000 7fb52b926800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.169+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7290 con 0x55e62b7ea4e0 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.170+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.170+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447060638192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b7f7290 con 0x55e62b7ea4e0 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447060638192] v34'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb3ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb52b926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb52b926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb52b926800 5 note: GC not initialized 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb3dcfe1640 20 reqs_thread_entry: start 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.171+0000 7fb52b926800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 20 Filter name: none 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb3567fc640 20 reqs_thread_entry: start 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b833fc0 con 0x7fb5180bd070 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b832680 con 0x55e62b7f3970 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:51:33.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.172+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b832f50 con 0x7fb5180bd070 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb52b926800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb52b926800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb52b926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94447060855456 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b837900 con 0x55e62b7f3970 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== watch-notify(notify (1) cookie 94447060629600 notify 146028888082 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55e62b55de40 con 0x55e62b7f3970 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb40affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94447060629600 notifier 4741 bl.length()=556 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb40affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb40affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb40affd640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3ec003ea0 con 0x55e62b7f3970 2024-09-10T04:51:33.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(65 notify.5 [notify cookie 94447060855456 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== watch-notify(notify_complete (2) cookie 94447060855456 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb51002d550 con 0x55e62b7f3970 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.174+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b832aa0 con 0x55e62b7f3970 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'11 uv11 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb52b926800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb52b926800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb52b926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94447060855456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e62b837900 con 0x55e62b7ee960 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94447060621696 notify 146028888103 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e62b7cbe00 con 0x55e62b7ee960 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb40a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94447060621696 notifier 4741 bl.length()=177 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [notify cookie 94447060855456 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb40a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T04:51:33.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb40a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T04:51:33.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb40a7fc640 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb35c003400 con 0x55e62b7ee960 2024-09-10T04:51:33.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.176+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94447060855456 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb518095040 con 0x55e62b7ee960 2024-09-10T04:51:33.192 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T04:51:33.173683Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:51:33.173666Z","tags":[],"group_ids":[]} 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.177+0000 7fb3ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.177+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447060638192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.179+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94447060638192] v34'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.179+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447060614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7ee960 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.180+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94447060614208] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.180+0000 7fb52b926800 20 remove_watcher() i=0 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.180+0000 7fb52b926800 2 removed watcher, disabling cache 2024-09-10T04:51:33.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.180+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447060618944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7ea4e0 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.181+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94447060618944] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x55e62b7ea4e0 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.181+0000 7fb52b926800 20 remove_watcher() i=1 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.181+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447060621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7ee960 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.182+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94447060621696] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.182+0000 7fb52b926800 20 remove_watcher() i=2 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.182+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447060624384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x7fb5180bd070 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.183+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94447060624384] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.183+0000 7fb52b926800 20 remove_watcher() i=3 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.183+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447060627040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7ee960 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.184+0000 7fb5275d9640 1 -- 172.21.15.145:0/1568215189 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94447060627040] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51809f070 con 0x55e62b7ee960 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.184+0000 7fb52b926800 20 remove_watcher() i=4 2024-09-10T04:51:33.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.184+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447060629600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7f3970 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.185+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94447060629600] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.185+0000 7fb52b926800 20 remove_watcher() i=5 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.185+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447060634560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x55e62b7f3970 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.186+0000 7fb526dd8640 1 -- 172.21.15.145:0/1568215189 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94447060634560] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510036040 con 0x55e62b7f3970 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.186+0000 7fb52b926800 20 remove_watcher() i=6 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.186+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447060631936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e62b831df0 con 0x7fb5180bd070 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94447060631936] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb520025040 con 0x7fb5180bd070 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 20 remove_watcher() i=7 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7ee960 msgr2=0x55e62b7f0d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7ee960 0x55e62b7f0d50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b7ea4e0 msgr2=0x55e62b7ec9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b7ea4e0 0x55e62b7ec9a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb5180bd070 msgr2=0x7fb5180808d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.187+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb5180bd070 0x7fb5180808d0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e62b7f3970 msgr2=0x55e62b7f5d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e62b7f3970 0x55e62b7f5d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3f003c780 msgr2=0x7fb3f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3f003c780 0x7fb3f003ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb51000bf70 tx=0x7fb510011000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 msgr2=0x55e62b7def50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/1568215189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7d7ae0 0x55e62b7def50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb518080860 tx=0x7fb518073f50 comp rx=0 tx=0).stop 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 reap_dead start 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb527dda640 1 -- 172.21.15.145:0/1568215189 reap_dead start 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 shutdown_connections 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 >> 172.21.15.145:0/1568215189 conn(0x55e62b7d3ee0 msgr2=0x55e62b7d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 shutdown_connections 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/1568215189 wait complete. 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 msgr2=0x7fb40003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 0x7fb40003ebf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e62b7af140 tx=0x7fb510006000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 msgr2=0x55e62b7cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb5180965d0 tx=0x7fb518058270 comp rx=0 tx=0).stop 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 shutdown_connections 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40003c730 0x7fb40003ebf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 --2- 172.21.15.145:0/664915548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b7cb3a0 0x55e62b7cb7c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 >> 172.21.15.145:0/664915548 conn(0x55e62b7bf750 msgr2=0x55e62b7bfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 shutdown_connections 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.188+0000 7fb52b926800 1 -- 172.21.15.145:0/664915548 wait complete. 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7b5670 msgr2=0x55e62b7b7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e62b7b5670 0x55e62b7b7b10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b6b7060 msgr2=0x55e62b7b4880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e62b6b7060 0x55e62b7b4880 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e62b7baee0 msgr2=0x55e62b7bd2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e62b7baee0 0x55e62b7bd2d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40c03c780 msgr2=0x7fb40c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb40c03c780 0x7fb40c03ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb510001e50 tx=0x7fb5100013d0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 msgr2=0x55e62b7ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 --2- 172.21.15.145:0/2756772198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e62b6b4640 0x55e62b7ad230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb518063040 tx=0x7fb518003330 comp rx=0 tx=0).stop 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb527dda640 1 -- 172.21.15.145:0/2756772198 reap_dead start 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 shutdown_connections 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 >> 172.21.15.145:0/2756772198 conn(0x55e62b6ae200 msgr2=0x55e62b79ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 shutdown_connections 2024-09-10T04:51:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.189+0000 7fb52b926800 1 -- 172.21.15.145:0/2756772198 wait complete. 2024-09-10T04:51:33.203 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T04:51:33.173683Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:51:33.173666Z', 'tags': [], 'group_ids': []} 2024-09-10T04:51:33.218 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:51:33.224 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-10T04:51:33.225 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T04:51:33.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T04:51:33.225 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-10T04:51:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:33.271 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb2df26800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55994907a210 0x55994907fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb2df26800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559948f23e40 con 0x559949078e00 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb2df26800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x559948eee680 con 0x55994907a210 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb23fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55994907a210 0x55994907fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb23fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55994907a210 0x55994907fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59570/0 (socket says 172.21.15.145:59570) 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb23fff640 1 -- 172.21.15.145:0/1165521719 learned_addr learned my addr 172.21.15.145:0/1165521719 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.271+0000 7fcb23fff640 1 -- 172.21.15.145:0/1165521719 >> v1:172.21.15.98:6789/0 conn(0x559949078e00 legacy=0x559949079b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.272+0000 7fcb23fff640 1 -- 172.21.15.145:0/1165521719 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559948f0a6b0 con 0x55994907a210 2024-09-10T04:51:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.273+0000 7fcb23fff640 1 --2- 172.21.15.145:0/1165521719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994907a210 0x55994907fdb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400a520 tx=0x7fcb14045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f25dbcb4083dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.273+0000 7fcb2935c640 1 -- 172.21.15.145:0/1165521719 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb14055070 con 0x55994907a210 2024-09-10T04:51:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.273+0000 7fcb2935c640 1 -- 172.21.15.145:0/1165521719 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb140515b0 con 0x55994907a210 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.273+0000 7fcb2935c640 1 -- 172.21.15.145:0/1165521719 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb140518d0 con 0x55994907a210 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 -- 172.21.15.145:0/1165521719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994907a210 msgr2=0x55994907fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1165521719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994907a210 0x55994907fdb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400a520 tx=0x7fcb14045ba0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 -- 172.21.15.145:0/1165521719 shutdown_connections 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1165521719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994907a210 0x55994907fdb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 -- 172.21.15.145:0/1165521719 >> 172.21.15.145:0/1165521719 conn(0x5599490741d0 msgr2=0x559949076630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 -- 172.21.15.145:0/1165521719 shutdown_connections 2024-09-10T04:51:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.274+0000 7fcb2df26800 1 -- 172.21.15.145:0/1165521719 wait complete. 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb2df26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb2df26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559948f12dd0 con 0x559949078e00 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59574/0 (socket says 172.21.15.145:59574) 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.288+0000 7fcb29b5d640 1 -- 172.21.15.145:0/975496080 learned_addr learned my addr 172.21.15.145:0/975496080 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.289+0000 7fcb29b5d640 1 -- 172.21.15.145:0/975496080 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559948f2be10 con 0x559949078e00 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.289+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/975496080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c001d40 tx=0x7fcb1c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad633c79e6e233f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.289+0000 7fca17e07640 1 -- 172.21.15.145:0/975496080 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c00f400 con 0x559949078e00 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.289+0000 7fca17e07640 1 -- 172.21.15.145:0/975496080 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00f5a0 con 0x559949078e00 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.289+0000 7fca17e07640 1 -- 172.21.15.145:0/975496080 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c00f900 con 0x559949078e00 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- 172.21.15.145:0/975496080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 msgr2=0x559949168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 --2- 172.21.15.145:0/975496080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c001d40 tx=0x7fcb1c00b5b0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- 172.21.15.145:0/975496080 shutdown_connections 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 --2- 172.21.15.145:0/975496080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x559949168560 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- 172.21.15.145:0/975496080 >> 172.21.15.145:0/975496080 conn(0x5599490741d0 msgr2=0x559949163ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- 172.21.15.145:0/975496080 shutdown_connections 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- 172.21.15.145:0/975496080 wait complete. 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x55994916ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb2df26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55994907a900 con 0x559949078e00 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.290+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x55994916ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x55994916ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59582/0 (socket says 172.21.15.145:59582) 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb29b5d640 1 -- 172.21.15.145:0/108158667 learned_addr learned my addr 172.21.15.145:0/108158667 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb29b5d640 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559949170470 con 0x559949078e00 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x55994916ff10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x5599491694f0 tx=0x7fcb1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fca16604640 1 -- 172.21.15.145:0/108158667 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c01a690 con 0x559949078e00 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559949170700 con 0x559949078e00 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fca16604640 1 -- 172.21.15.145:0/108158667 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c01a830 con 0x559949078e00 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fca16604640 1 -- 172.21.15.145:0/108158667 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c01ab50 con 0x559949078e00 2024-09-10T04:51:33.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.291+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559949171310 con 0x559949078e00 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.292+0000 7fca16604640 1 -- 172.21.15.145:0/108158667 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb1c017070 con 0x559949078e00 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.292+0000 7fca16604640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca1003c730 0x7fca1003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.292+0000 7fca16604640 1 -- 172.21.15.145:0/108158667 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fcb1c015020 con 0x559949078e00 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb23fff640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca1003c730 0x7fca1003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55994907a210 0x559949177560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559949177aa0 con 0x55994907a210 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55994907a210 0x559949177560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb23fff640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca1003c730 0x7fca1003ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb14057000 tx=0x7fcb14052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55994907a210 0x559949177560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2a35e640 1 -- 172.21.15.145:0/108158667 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb2400a4d0 con 0x55994907a210 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559949178350 0x55994917a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.293+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55994917af30 con 0x559949178350 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.294+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559949178350 0x55994917a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.294+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559949178350 0x55994917a7c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.294+0000 7fcb29b5d640 1 -- 172.21.15.145:0/108158667 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb1c02e070 con 0x559949178350 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.294+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55994917c7e0 con 0x55994907a210 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.294+0000 7fcb2a35e640 1 -- 172.21.15.145:0/108158667 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb2400a4d0 con 0x55994907a210 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.295+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55994917ba10 con 0x559949178350 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.295+0000 7fcb29b5d640 1 -- 172.21.15.145:0/108158667 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb1c02e070 con 0x559949178350 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.295+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55994917db90 0x55994917ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.295+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491804c0 con 0x55994917db90 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.295+0000 7fcb23fff640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55994917db90 0x55994917ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb23fff640 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55994917db90 0x55994917ff80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb23fff640 1 -- 172.21.15.145:0/108158667 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb14057030 con 0x55994917db90 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb2df26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.296+0000 7fcb2df26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559948f70a00 con 0x55994918f150 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59592/0 (socket says 172.21.15.145:59592) 2024-09-10T04:51:33.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb29b5d640 1 -- 172.21.15.145:0/1821593988 learned_addr learned my addr 172.21.15.145:0/1821593988 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb29b5d640 1 -- 172.21.15.145:0/1821593988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994918fbb0 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0524a0 tx=0x7fcb1c017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fca0f7fe640 1 -- 172.21.15.145:0/1821593988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c017980 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fca0f7fe640 1 -- 172.21.15.145:0/1821593988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c035020 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599491903e0 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fca0f7fe640 1 -- 172.21.15.145:0/1821593988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c00ed00 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.297+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599491903e0 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.298+0000 7fca0f7fe640 1 -- 172.21.15.145:0/1821593988 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb1c00e070 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.298+0000 7fca0f7fe640 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 0x7fca0403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.298+0000 7fca0f7fe640 1 -- 172.21.15.145:0/1821593988 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fcb1c036030 con 0x55994918f150 2024-09-10T04:51:33.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.298+0000 7fcb23fff640 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 0x7fca0403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.298+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb23fff640 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 0x7fca0403ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x559949171df0 tx=0x7fcb14005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb2df26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb2df26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559949168db0 con 0x5599491824f0 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59604/0 (socket says 172.21.15.145:59604) 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb29b5d640 1 -- 172.21.15.145:0/1407079117 learned_addr learned my addr 172.21.15.145:0/1407079117 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb29b5d640 1 -- 172.21.15.145:0/1407079117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559949182ee0 con 0x5599491824f0 2024-09-10T04:51:33.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/1407079117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00ffd0 tx=0x7fcb1c046d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121745af236305cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fca0d7fa640 1 -- 172.21.15.145:0/1407079117 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c063070 con 0x5599491824f0 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fca0d7fa640 1 -- 172.21.15.145:0/1407079117 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c05a040 con 0x5599491824f0 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.299+0000 7fca0d7fa640 1 -- 172.21.15.145:0/1407079117 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c044410 con 0x5599491824f0 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- 172.21.15.145:0/1407079117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 msgr2=0x5599491828f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1407079117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00ffd0 tx=0x7fcb1c046d10 comp rx=0 tx=0).stop 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- 172.21.15.145:0/1407079117 shutdown_connections 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1407079117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491828f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- 172.21.15.145:0/1407079117 >> 172.21.15.145:0/1407079117 conn(0x559949197c20 msgr2=0x559949195e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- 172.21.15.145:0/1407079117 shutdown_connections 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- 172.21.15.145:0/1407079117 wait complete. 2024-09-10T04:51:33.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 Processor -- start 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- start start 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.300+0000 7fcb2df26800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5599491833d0 con 0x5599491824f0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb29b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59616/0 (socket says 172.21.15.145:59616) 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 learned_addr learned my addr 172.21.15.145:0/2669385128 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599491a5470 con 0x5599491824f0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00ffd0 tx=0x7fcb1c052c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fc9fb7fe640 1 -- 172.21.15.145:0/2669385128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c06e020 con 0x5599491824f0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fc9fb7fe640 1 -- 172.21.15.145:0/2669385128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0393c0 con 0x5599491824f0 2024-09-10T04:51:33.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fc9fb7fe640 1 -- 172.21.15.145:0/2669385128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c063040 con 0x5599491824f0 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599491a5470 con 0x5599491824f0 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.301+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599491a5470 con 0x5599491824f0 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.302+0000 7fc9fb7fe640 1 -- 172.21.15.145:0/2669385128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb1c071020 con 0x5599491824f0 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.302+0000 7fc9fb7fe640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc9f403c690 0x7fc9f403eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fc9fb7fe640 1 -- 172.21.15.145:0/2669385128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fcb1c074d60 con 0x5599491824f0 2024-09-10T04:51:33.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb23fff640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc9f403c690 0x7fc9f403eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5599491b04b0 0x5599491b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b30c0 con 0x5599491b04b0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb23fff640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc9f403c690 0x7fc9f403eb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcb14051580 tx=0x7fcb1406d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5599491b04b0 0x5599491b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.303+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5599491b04b0 0x5599491b2970 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 realm 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491af7e0 con 0x5599491b04b0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b3b50 con 0x5599491b04b0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5599491b4930 0x5599491b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b7380 con 0x5599491b4930 2024-09-10T04:51:33.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.304+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5599491b4930 0x5599491b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5599491b4930 0x5599491b6d20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b7bd0 con 0x5599491b04b0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 20 searching for the correct realm 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5599491b9940 0x5599491bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.305+0000 7fcb23fff640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5599491b9940 0x5599491bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb23fff640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5599491b9940 0x5599491bbd70 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb29b5d640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fcb1c073020 0x7fcb1c031810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.306+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fcb1c073020 0x7fcb1c031810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fcb1c073020 0x7fcb1c031810 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb2400a4d0 con 0x7fcb1c073020 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.307+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.308+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb2400a4d0 con 0x5599491b04b0 2024-09-10T04:51:33.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.309+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.310+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.311+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b04b0 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb24030040 con 0x7fcb1c073020 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.312+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b9940 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.313+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc440 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:33.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b8550 con 0x5599491b04b0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb24030040 con 0x5599491b04b0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.314+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b8df0 con 0x5599491b4930 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491b8190 con 0x7fcb1c073020 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 zone default found 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 4 Realm: () 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 zonegroup default 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491bc8e0 con 0x7fcb1c073020 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.315+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491be740 con 0x5599491b9940 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491bec20 con 0x5599491b9940 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 20 started sync module instance, tier type = 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.316+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491bdbb0 con 0x5599491b4930 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.317+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.317+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116844920784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491bd810 con 0x5599491b4930 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.317+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491bfb50 con 0x5599491b04b0 2024-09-10T04:51:33.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.318+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94116844920784] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.318+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.318+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116844925056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491bfb50 con 0x5599491b04b0 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.318+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c0550 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.319+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94116844925056] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.319+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.319+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116844929120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491bfb50 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.319+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c0fd0 con 0x7fcb1c073020 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.320+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94116844929120] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.320+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.320+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116844926624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c0f90 con 0x7fcb1c073020 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.320+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c19e0 con 0x5599491b4930 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.321+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94116844926624] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.322+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.322+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116844934352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c0f90 con 0x5599491b4930 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.322+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c2420 con 0x5599491b9940 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.323+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.323+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116844937072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c2cc0 con 0x5599491b9940 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.323+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c3740 con 0x5599491b9940 2024-09-10T04:51:33.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.323+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94116844934352] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.325+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94116844937072] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.325+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.325+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116844941872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c3b30 con 0x5599491b9940 2024-09-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.325+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c4380 con 0x7fcb1c073020 2024-09-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.326+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94116844941872] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116844945104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c42f0 con 0x7fcb1c073020 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=0 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=1 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=2 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=3 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=4 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=5 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.327+0000 7fcb2df26800 20 add_watcher() i=6 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94116844945104] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2df26800 20 add_watcher() i=7 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2df26800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491c7c50 con 0x5599491b04b0 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.328+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116844947232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491c5130 con 0x5599491b04b0 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.329+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94116844947232] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fc9dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 5 note: GC not initialized 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fc9defe5640 20 reqs_thread_entry: start 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 20 Filter name: none 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fc9dcfe1640 20 reqs_thread_entry: start 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T04:51:33.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.330+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599491fabf0 con 0x7fcb1c073020 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2df26800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2df26800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2df26800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2df26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.331+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491feda0 con 0x7fcb1c073020 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.332+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.333+0000 7fc9dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.333+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116844947232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b04b0 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.334+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94116844947232] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.334+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116844920784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b4930 2024-09-10T04:51:33.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.335+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94116844920784] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.335+0000 7fcb2df26800 20 remove_watcher() i=0 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.335+0000 7fcb2df26800 2 removed watcher, disabling cache 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.335+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116844925056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b04b0 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.336+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94116844925056] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x5599491b04b0 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.336+0000 7fcb2df26800 20 remove_watcher() i=1 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.336+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116844929120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b4930 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.337+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94116844929120] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.337+0000 7fcb2df26800 20 remove_watcher() i=2 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.337+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116844926624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x7fcb1c073020 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.338+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94116844926624] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.338+0000 7fcb2df26800 20 remove_watcher() i=3 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.338+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116844934352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b4930 2024-09-10T04:51:33.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.339+0000 7fcb29b5d640 1 -- 172.21.15.145:0/2669385128 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94116844934352] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb1c02e070 con 0x5599491b4930 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.339+0000 7fcb2df26800 20 remove_watcher() i=4 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.339+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116844937072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b9940 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.340+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94116844937072] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.340+0000 7fcb2df26800 20 remove_watcher() i=5 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.340+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116844941872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x5599491b9940 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.341+0000 7fcb23fff640 1 -- 172.21.15.145:0/2669385128 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94116844941872] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb14057030 con 0x5599491b9940 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.341+0000 7fcb2df26800 20 remove_watcher() i=6 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.341+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116844945104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599491f8a90 con 0x7fcb1c073020 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94116844945104] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb24041040 con 0x7fcb1c073020 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 20 remove_watcher() i=7 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5599491b4930 msgr2=0x5599491b6d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5599491b4930 0x5599491b6d20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5599491b04b0 msgr2=0x5599491b2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5599491b04b0 0x5599491b2970 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fcb1c073020 msgr2=0x7fcb1c031810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fcb1c073020 0x7fcb1c031810 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5599491b9940 msgr2=0x5599491bbd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5599491b9940 0x5599491bbd70 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc9f403c690 msgr2=0x7fc9f403eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc9f403c690 0x7fc9f403eb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcb14051580 tx=0x7fcb1406d040 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 msgr2=0x5599491a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2a35e640 1 -- 172.21.15.145:0/2669385128 reap_dead start 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00ffd0 tx=0x7fcb1c052c90 comp rx=0 tx=0).stop 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 shutdown_connections 2024-09-10T04:51:33.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 --2- 172.21.15.145:0/2669385128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5599491824f0 0x5599491a4f10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 >> 172.21.15.145:0/2669385128 conn(0x559949197c20 msgr2=0x559949195e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 shutdown_connections 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.342+0000 7fcb2df26800 1 -- 172.21.15.145:0/2669385128 wait complete. 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 msgr2=0x7fca0403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 0x7fca0403ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x559949171df0 tx=0x7fcb14005ac0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 msgr2=0x55994918f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0524a0 tx=0x7fcb1c017730 comp rx=0 tx=0).stop 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 shutdown_connections 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca0403c780 0x7fca0403ec40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/1821593988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55994918f150 0x55994918f570 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 >> 172.21.15.145:0/1821593988 conn(0x559949184700 msgr2=0x559949186af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 shutdown_connections 2024-09-10T04:51:33.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/1821593988 wait complete. 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559949178350 msgr2=0x55994917a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x559949178350 0x55994917a7c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55994907a210 msgr2=0x559949177560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55994907a210 0x559949177560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55994917db90 msgr2=0x55994917ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55994917db90 0x55994917ff80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca1003c730 msgr2=0x7fca1003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fca1003c730 0x7fca1003ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb14057000 tx=0x7fcb14052000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 msgr2=0x55994916ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 --2- 172.21.15.145:0/108158667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559949078e00 0x55994916ff10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x5599491694f0 tx=0x7fcb1c000bc0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2a35e640 1 -- 172.21.15.145:0/108158667 reap_dead start 2024-09-10T04:51:33.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 shutdown_connections 2024-09-10T04:51:33.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 >> 172.21.15.145:0/108158667 conn(0x5599490741d0 msgr2=0x559949169840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 shutdown_connections 2024-09-10T04:51:33.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.343+0000 7fcb2df26800 1 -- 172.21.15.145:0/108158667 wait complete. 2024-09-10T04:51:33.356 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T04:51:33.361 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:51:33.362 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T04:51:33.368 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T04:51:33.369 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-10T04:51:33.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T04:51:33.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T04:51:33.369 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-10T04:51:33.414 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:33.414 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eef39800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555595b1ffd0 0x555595b28af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eef39800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555959c9e40 con 0x555595b1e4b0 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eef39800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x555595994680 con 0x555595b1ffd0 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0ea3c6640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555595b1ffd0 0x555595b28af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eabc7640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x555595b1e4b0 0x555595b1e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36856/0 (socket says 172.21.15.145:36856) 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0eabc7640 1 -- 172.21.15.145:0/505470060 learned_addr learned my addr 172.21.15.145:0/505470060 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/505470060 >> v1:172.21.15.98:6789/0 conn(0x555595b1e4b0 legacy=0x555595b1e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.414+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/505470060 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555959b06b0 con 0x555595b1ffd0 2024-09-10T04:51:33.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.416+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/505470060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1ffd0 0x555595b28af0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000a470 tx=0x7fa0e0045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33443623b96cca4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0e9bc5640 1 -- 172.21.15.145:0/505470060 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e0059070 con 0x555595b1ffd0 2024-09-10T04:51:33.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0e9bc5640 1 -- 172.21.15.145:0/505470060 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0054570 con 0x555595b1ffd0 2024-09-10T04:51:33.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0e9bc5640 1 -- 172.21.15.145:0/505470060 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e0054870 con 0x555595b1ffd0 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 -- 172.21.15.145:0/505470060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1ffd0 msgr2=0x555595b28af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 --2- 172.21.15.145:0/505470060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1ffd0 0x555595b28af0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000a470 tx=0x7fa0e0045880 comp rx=0 tx=0).stop 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 -- 172.21.15.145:0/505470060 shutdown_connections 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 --2- 172.21.15.145:0/505470060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1ffd0 0x555595b28af0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 -- 172.21.15.145:0/505470060 >> 172.21.15.145:0/505470060 conn(0x555595b1a200 msgr2=0x555595b1c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 -- 172.21.15.145:0/505470060 shutdown_connections 2024-09-10T04:51:33.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.417+0000 7fa0eef39800 1 -- 172.21.15.145:0/505470060 wait complete. 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.431+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.431+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.431+0000 7fa0eef39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.431+0000 7fa0eef39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5555959b8dd0 con 0x555595b1e4b0 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59642/0 (socket says 172.21.15.145:59642) 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7fa0eabc7640 1 -- 172.21.15.145:0/3797215316 learned_addr learned my addr 172.21.15.145:0/3797215316 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7fa0eabc7640 1 -- 172.21.15.145:0/3797215316 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555959d1e10 con 0x555595b1e4b0 2024-09-10T04:51:33.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/3797215316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0065f0 tx=0x7fa0dc006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb905ad7b65d8f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7f9fd8e09640 1 -- 172.21.15.145:0/3797215316 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc003450 con 0x555595b1e4b0 2024-09-10T04:51:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7f9fd8e09640 1 -- 172.21.15.145:0/3797215316 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0035f0 con 0x555595b1e4b0 2024-09-10T04:51:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.432+0000 7f9fd8e09640 1 -- 172.21.15.145:0/3797215316 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0038f0 con 0x555595b1e4b0 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- 172.21.15.145:0/3797215316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 msgr2=0x555595c11880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 --2- 172.21.15.145:0/3797215316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0065f0 tx=0x7fa0dc006ab0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- 172.21.15.145:0/3797215316 shutdown_connections 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 --2- 172.21.15.145:0/3797215316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c11880 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- 172.21.15.145:0/3797215316 >> 172.21.15.145:0/3797215316 conn(0x555595b1a200 msgr2=0x555595c0d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- 172.21.15.145:0/3797215316 shutdown_connections 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- 172.21.15.145:0/3797215316 wait complete. 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.433+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eef39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c191e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eef39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555595b29300 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c191e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59654/0 (socket says 172.21.15.145:59654) 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eabc7640 1 -- 172.21.15.145:0/4200510397 learned_addr learned my addr 172.21.15.145:0/4200510397 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eabc7640 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555595c19740 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c191e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc000f80 tx=0x7fa0dc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7f9fd7606640 1 -- 172.21.15.145:0/4200510397 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc022020 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.434+0000 7f9fd7606640 1 -- 172.21.15.145:0/4200510397 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc001ab0 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.435+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555595c199d0 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.435+0000 7f9fd7606640 1 -- 172.21.15.145:0/4200510397 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc014b30 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.435+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555595c1a3d0 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7f9fd7606640 1 -- 172.21.15.145:0/4200510397 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0dc025020 con 0x555595b1e4b0 2024-09-10T04:51:33.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7f9fd7606640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fd003c780 0x7f9fd003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7f9fd7606640 1 -- 172.21.15.145:0/4200510397 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fa0dc018030 con 0x555595b1e4b0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fd003c780 0x7f9fd003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595b1ffd0 0x555595c20830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c20d70 con 0x555595b1ffd0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595b1ffd0 0x555595c20830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fd003c780 0x7f9fd003ec40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0056000 tx=0x7fa0e0050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.436+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595b1ffd0 0x555595c20830 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.437+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/4200510397 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595b1ffd0 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.437+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c21620 0x555595c23ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.437+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c24250 con 0x555595c21620 2024-09-10T04:51:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.437+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c21620 0x555595c23ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.437+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c21620 0x555595c23ae0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eabc7640 1 -- 172.21.15.145:0/4200510397 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0dc01b070 con 0x555595c21620 2024-09-10T04:51:33.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c25b00 con 0x555595b1ffd0 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/4200510397 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595b1ffd0 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c24d30 con 0x555595c21620 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eabc7640 1 -- 172.21.15.145:0/4200510397 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0dc01b070 con 0x555595c21620 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555595c26eb0 0x555595c292a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c297e0 con 0x555595c26eb0 2024-09-10T04:51:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.438+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555595c26eb0 0x555595c292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555595c26eb0 0x555595c292a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/4200510397 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0e005c040 con 0x555595c26eb0 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0eef39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.439+0000 7fa0eef39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555595a16a00 con 0x555595c37330 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59666/0 (socket says 172.21.15.145:59666) 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eabc7640 1 -- 172.21.15.145:0/1330440594 learned_addr learned my addr 172.21.15.145:0/1330440594 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eabc7640 1 -- 172.21.15.145:0/1330440594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555595c37d90 con 0x555595c37330 2024-09-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc052080 tx=0x7fa0dc010b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7f9fd4e01640 1 -- 172.21.15.145:0/1330440594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc026780 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7f9fd4e01640 1 -- 172.21.15.145:0/1330440594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc035020 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555595c385c0 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7f9fd4e01640 1 -- 172.21.15.145:0/1330440594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc01e3f0 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.440+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555595c38b60 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.441+0000 7f9fd4e01640 1 -- 172.21.15.145:0/1330440594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0dc010070 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.441+0000 7f9fd4e01640 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 0x7f9fc403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.441+0000 7f9fd4e01640 1 -- 172.21.15.145:0/1330440594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fa0dc036030 con 0x555595c37330 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.441+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 0x7f9fc403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.441+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 0x7f9fc403ec40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x555595c1b110 tx=0x7fa0e0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eef39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eef39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555595c120d0 con 0x555595c43e70 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59678/0 (socket says 172.21.15.145:59678) 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eabc7640 1 -- 172.21.15.145:0/337347050 learned_addr learned my addr 172.21.15.145:0/337347050 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eabc7640 1 -- 172.21.15.145:0/337347050 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555595c44840 con 0x555595c43e70 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/337347050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc014680 tx=0x7fa0dc04b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534c82c2bb08f169 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7f9fce7fc640 1 -- 172.21.15.145:0/337347050 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc052970 con 0x555595c43e70 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7f9fce7fc640 1 -- 172.21.15.145:0/337347050 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc052d10 con 0x555595c43e70 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.442+0000 7f9fce7fc640 1 -- 172.21.15.145:0/337347050 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0129e0 con 0x555595c43e70 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- 172.21.15.145:0/337347050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 msgr2=0x555595c44250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 --2- 172.21.15.145:0/337347050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc014680 tx=0x7fa0dc04b3f0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- 172.21.15.145:0/337347050 shutdown_connections 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 --2- 172.21.15.145:0/337347050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c44250 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- 172.21.15.145:0/337347050 >> 172.21.15.145:0/337347050 conn(0x555595c40270 msgr2=0x555595c3e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- 172.21.15.145:0/337347050 shutdown_connections 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- 172.21.15.145:0/337347050 wait complete. 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 Processor -- start 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 -- start start 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.443+0000 7fa0eef39800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eef39800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555595c44cd0 con 0x555595c43e70 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eabc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59680/0 (socket says 172.21.15.145:59680) 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 learned_addr learned my addr 172.21.15.145:0/2325165990 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555595c4b800 con 0x555595c43e70 2024-09-10T04:51:33.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc014680 tx=0x7fa0dc048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7f9fccff9640 1 -- 172.21.15.145:0/2325165990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc01e8c0 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7f9fccff9640 1 -- 172.21.15.145:0/2325165990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc011b20 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7f9fccff9640 1 -- 172.21.15.145:0/2325165990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc028840 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555595c4b800 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.444+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555595c4b800 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.445+0000 7f9fccff9640 1 -- 172.21.15.145:0/2325165990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0dc06b070 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.445+0000 7f9fccff9640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fb403c730 0x7f9fb403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.445+0000 7f9fccff9640 1 -- 172.21.15.145:0/2325165990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fa0dc06fd80 con 0x555595c43e70 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.445+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fb403c730 0x7f9fb403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fb403c730 0x7f9fb403ebf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0054fd0 tx=0x7fa0e0051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595c566c0 0x555595c58b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c592d0 con 0x555595c566c0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595c566c0 0x555595c58b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.446+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595c566c0 0x555595c58b80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595c566c0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 realm 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c559f0 con 0x555595c566c0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595c566c0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c59d60 con 0x555595c566c0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595c566c0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c5ab40 0x555595c5cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c5d590 con 0x555595c5ab40 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.447+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c5ab40 0x555595c5cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c5ab40 0x555595c5cf30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595c566c0 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 20 searching for the correct realm 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555595c5fb50 0x555595c61f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c62610 con 0x555595c5fb50 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.448+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555595c5fb50 0x555595c61f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0ea3c6640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555595c5fb50 0x555595c61f40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c62610 con 0x555595c5ab40 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0eabc7640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa0dc027020 0x7fa0dc025310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c62610 con 0x7fa0dc027020 2024-09-10T04:51:33.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.449+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa0dc027020 0x7fa0dc025310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa0dc027020 0x7fa0dc025310 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa0e40083e0 con 0x7fa0dc027020 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e40083e0 con 0x555595c566c0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.450+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.451+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.452+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.453+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.454+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c566c0 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x7fa0dc027020 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.455+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5fb50 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.456+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555595c5dde0 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:33.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c5e630 con 0x555595c566c0 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c5ea20 con 0x555595c5ab40 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.457+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c5ee40 con 0x7fa0dc027020 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 zone default found 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 4 Realm: () 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 zonegroup default 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c62a90 con 0x7fa0dc027020 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c645b0 con 0x555595c5fb50 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.458+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c64a80 con 0x555595c5fb50 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.459+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.459+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.459+0000 7fa0eef39800 20 started sync module instance, tier type = 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.459+0000 7fa0eef39800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.459+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c63920 con 0x555595c5ab40 2024-09-10T04:51:33.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.460+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.460+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826073378336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c63920 con 0x555595c5ab40 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.460+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c65500 con 0x555595c566c0 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.461+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826073378336] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc074020 con 0x555595c5ab40 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.461+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.461+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826073375856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c65500 con 0x555595c566c0 2024-09-10T04:51:33.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.461+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c65f80 con 0x555595c5ab40 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.462+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826073375856] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.462+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.462+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826073385584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c65f40 con 0x555595c5ab40 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.462+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c66a30 con 0x7fa0dc027020 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.463+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826073385584] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.464+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.464+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826073388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c669f0 con 0x7fa0dc027020 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.464+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c674a0 con 0x555595c5ab40 2024-09-10T04:51:33.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.465+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826073388288] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.465+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.465+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826073390992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c67460 con 0x555595c5ab40 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.465+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c67e60 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.466+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.466+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826073393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c686b0 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.466+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c69160 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.466+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826073390992] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.467+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826073393520] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.467+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.467+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826073382992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c69550 con 0x555595c5fb50 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.467+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c69da0 con 0x7fa0dc027020 2024-09-10T04:51:33.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826073382992] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826073401584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c69d10 con 0x7fa0dc027020 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=0 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=1 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=2 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=3 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=4 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=5 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.469+0000 7fa0eef39800 20 add_watcher() i=6 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826073401584] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eef39800 20 add_watcher() i=7 2024-09-10T04:51:33.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eef39800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595c6d670 con 0x555595c566c0 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.470+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826073403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c6aab0 con 0x555595c566c0 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.471+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826073403712] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.471+0000 7f9fa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.471+0000 7fa0eef39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.471+0000 7fa0eef39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.471+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75f10 con 0x555595c5ab40 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.473+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.473+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c76040 con 0x7fa0dc027020 2024-09-10T04:51:33.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.474+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.474+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c766a0 con 0x555595c5fb50 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.475+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.475+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c76b50 con 0x555595c566c0 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.476+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'225 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.476+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5ab40 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.477+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.477+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5fb50 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.478+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.478+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5ab40 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.479+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.479+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c566c0 2024-09-10T04:51:33.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.481+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.481+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c77880 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.482+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.482+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c77880 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.483+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.483+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c77880 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.484+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.484+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c77880 con 0x555595c5fb50 2024-09-10T04:51:33.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.485+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.485+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.486+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.486+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c566c0 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.488+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.488+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c566c0 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.489+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'226 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.489+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.490+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.490+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.491+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.491+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75580 con 0x555595c5fb50 2024-09-10T04:51:33.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.492+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.492+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.493+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.493+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c566c0 2024-09-10T04:51:33.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.495+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'227 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.495+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.496+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.496+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.497+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.497+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5fb50 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.498+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.498+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.499+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.499+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5fb50 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.500+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.500+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5fb50 2024-09-10T04:51:33.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.501+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.501+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5fb50 2024-09-10T04:51:33.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.502+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.502+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.503+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.503+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c566c0 2024-09-10T04:51:33.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.504+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.504+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c5ab40 2024-09-10T04:51:33.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.505+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.505+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x555595c566c0 2024-09-10T04:51:33.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.506+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.506+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595c75750 con 0x7fa0dc027020 2024-09-10T04:51:33.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.507+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.507+0000 7f9f1bfff640 20 reqs_thread_entry: start 2024-09-10T04:51:33.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:33.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 20 Filter name: none 2024-09-10T04:51:33.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7f9f19ffb640 20 reqs_thread_entry: start 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595ca2cb0 con 0x7fa0dc027020 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T04:51:33.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.508+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595ca5110 con 0x555595c5ab40 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 : miss 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:96 8.1 8:8747c80c:root::.bucket.meta.myfoo6%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595ca3820 con 0x555595c566c0 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv7 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x17 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T04:51:33.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.509+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:97 4.0 4:00d109ae:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c5fb50 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(97 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 4.5 4:a2a7b319:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c5ab40 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(98 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 4.1b 4:d92a389f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x7fa0dc027020 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(99 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.510+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 4.3 4:c0bcfcc7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x7fa0dc027020 2024-09-10T04:51:33.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.511+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(100 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.511+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 4.25 4:a73ef476:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c5ab40 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.511+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(101 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.511+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:102 4.3d 4:bd5ad4de:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c5ab40 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(102 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 4.34 4:2c557535:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x7fa0dc027020 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(103 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 4.5 4:a269b7c9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c5ab40 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(104 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.512+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 4.4 4:226b1684:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22aa0 con 0x555595c566c0 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(105 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:106 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22ac0 con 0x555595c566c0 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(106 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [call out=349b] v0'0 uv13 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eef39800 10 cls_bucket_list_unordered: got thirteen 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:107 4.21 4:868a1fc5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595d22ac0 con 0x555595c5fb50 2024-09-10T04:51:33.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(107 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.513+0000 7fa0eef39800 20 get_obj_state: octx=0x7fa0e4008cb0 obj=myfoo6:thirteen state=0x555595ca6458 s->prefetch_data=0 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 3.cs0 3:332be2a3:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595ca7280 con 0x555595c5ab40 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(108 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 10 manifest: total_size = 8 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 20 get_obj_state: setting s->obj_tag to _X24VmIPCrbRM4GOs6QkUIps06-f9bJi 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 20 get_obj_state: octx=0x7fa0e4008cb0 obj=myfoo6:thirteen state=0x555595ca6458 s->prefetch_data=0 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 20 prepare_atomic_modification: state is not atomic. state=0x555595ca6458 2024-09-10T04:51:33.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 2024-09-10T04:51:33.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.514+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:109 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cabb80 con 0x555595c566c0 2024-09-10T04:51:33.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.515+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(109 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.515+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:110 3.cs0 3:332be2a3:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595ca9b60 con 0x555595c5ab40 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(110 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9_thirteen [call] v34'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fa0dc060d70 con 0x555595c5ab40 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:111 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cac610 con 0x555595c566c0 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 20 list_objects_ordered: starting attempt 1 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:112 4.0 4:00d109ae:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cadf60 con 0x555595c5fb50 2024-09-10T04:51:33.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:113 4.5 4:a2a7b319:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cadf60 con 0x555595c5ab40 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:114 4.1b 4:d92a389f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb2cf0 con 0x7fa0dc027020 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:115 4.3 4:c0bcfcc7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cadf60 con 0x7fa0dc027020 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:116 4.25 4:a73ef476:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb7fa0 con 0x555595c5ab40 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:117 4.3d 4:bd5ad4de:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cbadc0 con 0x555595c5ab40 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:118 4.34 4:2c557535:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cbdc10 con 0x7fa0dc027020 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:119 4.5 4:a269b7c9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc0a40 con 0x555595c5ab40 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:120 4.4 4:226b1684:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc3870 con 0x555595c566c0 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:121 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc66a0 con 0x555595c566c0 2024-09-10T04:51:33.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:122 4.21 4:868a1fc5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc9520 con 0x555595c5fb50 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.517+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(113 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(114 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(112 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(122 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(117 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(116 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(115 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(119 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(118 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(111 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [stat,call,call] v34'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7f9fce7fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(120 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(121 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T04:51:33.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9])"; uploads.size()=0; is_truncated=0 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:123 4.0 4:00d109ae:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 4.5 4:a2a7b319:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc9520 con 0x555595c5ab40 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:125 4.1b 4:d92a389f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc0a40 con 0x7fa0dc027020 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:126 4.3 4:c0bcfcc7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cbadc0 con 0x7fa0dc027020 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:127 4.25 4:a73ef476:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc66a0 con 0x555595c5ab40 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:128 4.3d 4:bd5ad4de:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:129 4.34 4:2c557535:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cadf60 con 0x7fa0dc027020 2024-09-10T04:51:33.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:130 4.5 4:a269b7c9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc9520 con 0x555595c5ab40 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:131 4.4 4:226b1684:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cc66a0 con 0x555595c566c0 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:132 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.518+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:133 4.21 4:868a1fc5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cbadc0 con 0x555595c5fb50 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(133 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(125 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(124 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(123 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(126 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(127 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== osd_op_reply(129 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(131 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(130 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(132 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(128 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.519+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 20 rados_obj.operate() r=0 bl.length=166 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.520+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.521+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.521+0000 7fa0eef39800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.521+0000 7fa0eef39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.521+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93826073734592 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== watch-notify(notify (1) cookie 93826073388288 notify 146028888079 ret 0) ==== 192+0+0 (crc 0 0 0) 0x555595ca4c20 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7f9fcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 93826073388288 notifier 4755 bl.length()=150 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(137 notify.3 [notify cookie 93826073734592 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7f9fcdffb640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9f200032c0 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== watch-notify(notify_complete (2) cookie 93826073734592 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555595c776b0 con 0x7fa0dc027020 2024-09-10T04:51:33.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.522+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:139 8.1 8:8747c80c:root::.bucket.meta.myfoo6%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.523+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(139 .bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [call,call,delete] v34'9 uv9 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.523+0000 7fa0eef39800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 from cache 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.523+0000 7fa0eef39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9, ofs0, ns] 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.523+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 93826073734592 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== watch-notify(notify (1) cookie 93826073390992 notify 146028888104 ret 0) ==== 249+0+0 (crc 0 0 0) 0x555595c77880 con 0x555595c5ab40 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7f9fce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 93826073390992 notifier 4755 bl.length()=207 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(140 notify.4 [notify cookie 93826073734592 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7f9fce7fc640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9fb0003d60 con 0x555595c5ab40 2024-09-10T04:51:33.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== watch-notify(notify_complete (2) cookie 93826073734592 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555595c385c0 con 0x555595c5ab40 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:142 4.0 4:00d109ae:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:143 4.5 4:a2a7b319:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cbadc0 con 0x555595c5ab40 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:144 4.1b 4:d92a389f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cc3870 con 0x7fa0dc027020 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:145 4.3 4:c0bcfcc7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cc66a0 con 0x7fa0dc027020 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:146 4.25 4:a73ef476:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:147 4.3d 4:bd5ad4de:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cbf710 con 0x555595c5ab40 2024-09-10T04:51:33.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:148 4.34 4:2c557535:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cc3870 con 0x7fa0dc027020 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 4.5 4:a269b7c9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cbadc0 con 0x555595c5ab40 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:150 4.4 4:226b1684:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:151 4.2a 4:54298e22:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cc66a0 con 0x555595c566c0 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.524+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:152 4.21 4:868a1fc5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cbf710 con 0x555595c5fb50 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(148 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.6 [delete] v34'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(143 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.1 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(150 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.8 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(146 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 31 ==== osd_op_reply(145 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.3 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 32 ==== osd_op_reply(144 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.2 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.526+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(152 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.10 [delete] v34'13 uv13 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.528+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(147 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.5 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.528+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(149 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.528+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(151 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.9 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(142 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 : miss 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:153 6.a 6:5793f413:::pubsub..bucket.myfoo6%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(153 pubsub..bucket.myfoo6/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 info.flags=0x0 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 10 adding default.rgw.log++pubsub..bucket.myfoo6/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 to cache LRU end 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.529+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:154 6.a 6:5793f413:::pubsub..bucket.myfoo6%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.531+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 58 ==== osd_op_reply(154 pubsub..bucket.myfoo6/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.9 [delete] v34'43 uv37 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.531+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.533+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 59 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.533+0000 7fa0eef39800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.533+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eef39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93826073781856 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== watch-notify(notify (1) cookie 93826073393520 notify 146028888084 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555595c750d0 con 0x555595c5fb50 2024-09-10T04:51:33.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7f9fcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 93826073393520 notifier 4755 bl.length()=170 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7f9fcdffb640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9f200032a0 con 0x555595c5fb50 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(157 notify.5 [notify cookie 93826073781856 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== watch-notify(notify_complete (2) cookie 93826073781856 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555595c6f3c0 con 0x555595c5fb50 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eef39800 10 removing email index: 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eef39800 10 removing user buckets index 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.534+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.535+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 60 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.535+0000 7fa0eef39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.535+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93826073734592 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== watch-notify(notify (1) cookie 93826073382992 notify 146028888085 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555595c6f3c0 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7f9fce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 93826073382992 notifier 4755 bl.length()=160 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7f9fce7fc640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9fb0003d60 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(160 notify.6 [notify cookie 93826073734592 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== watch-notify(notify_complete (2) cookie 93826073734592 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555595c76210 con 0x555595c5fb50 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0eef39800 10 removing user index: bud 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.536+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x7fa0dc027020 2024-09-10T04:51:33.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 33 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0eef39800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0eef39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93826073720736 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== watch-notify(notify (1) cookie 93826073393520 notify 146028888086 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555595c76210 con 0x555595c5fb50 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7f9fcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 93826073393520 notifier 4755 bl.length()=152 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7f9fcdffb640 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9f200032a0 con 0x555595c5fb50 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.537+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(163 notify.5 [notify cookie 93826073720736 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.538+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== watch-notify(notify_complete (2) cookie 93826073720736 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555595c76040 con 0x555595c5fb50 2024-09-10T04:51:33.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.538+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.538+0000 7f9fa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.539+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826073403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.540+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93826073403712] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.540+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826073378336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.541+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 61 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93826073378336] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.541+0000 7fa0eef39800 20 remove_watcher() i=0 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.541+0000 7fa0eef39800 2 removed watcher, disabling cache 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.541+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826073375856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c566c0 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.542+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93826073375856] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x555595c566c0 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.542+0000 7fa0eef39800 20 remove_watcher() i=1 2024-09-10T04:51:33.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.542+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826073385584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.543+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 62 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93826073385584] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.543+0000 7fa0eef39800 20 remove_watcher() i=2 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.543+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826073388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x7fa0dc027020 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.544+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 34 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93826073388288] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.544+0000 7fa0eef39800 20 remove_watcher() i=3 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.544+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826073390992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5ab40 2024-09-10T04:51:33.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.545+0000 7fa0eabc7640 1 -- 172.21.15.145:0/2325165990 <== osd.0 v2:172.21.15.98:6800/733739603 63 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93826073390992] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc09a070 con 0x555595c5ab40 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.545+0000 7fa0eef39800 20 remove_watcher() i=4 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.545+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826073393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.546+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93826073393520] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.546+0000 7fa0eef39800 20 remove_watcher() i=5 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.546+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826073382992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x555595c5fb50 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.547+0000 7fa0ea3c6640 1 -- 172.21.15.145:0/2325165990 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93826073382992] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e0082070 con 0x555595c5fb50 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.547+0000 7fa0eef39800 20 remove_watcher() i=6 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.547+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826073401584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555595cb8000 con 0x7fa0dc027020 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 <== osd.2 v2:172.21.15.145:6816/1789112018 35 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93826073401584] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4025040 con 0x7fa0dc027020 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 20 remove_watcher() i=7 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c5ab40 msgr2=0x555595c5cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c5ab40 0x555595c5cf30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595c566c0 msgr2=0x555595c58b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595c566c0 0x555595c58b80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa0dc027020 msgr2=0x7fa0dc025310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fa0dc027020 0x7fa0dc025310 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555595c5fb50 msgr2=0x555595c61f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555595c5fb50 0x555595c61f40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fb403c730 msgr2=0x7f9fb403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fb403c730 0x7f9fb403ebf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0054fd0 tx=0x7fa0e0051000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 msgr2=0x555595c4b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/2325165990 reap_dead start 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc014680 tx=0x7fa0dc048f00 comp rx=0 tx=0).stop 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 shutdown_connections 2024-09-10T04:51:33.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 --2- 172.21.15.145:0/2325165990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c43e70 0x555595c4b2a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 >> 172.21.15.145:0/2325165990 conn(0x555595c40270 msgr2=0x555595c3e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 shutdown_connections 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.548+0000 7fa0eef39800 1 -- 172.21.15.145:0/2325165990 wait complete. 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 msgr2=0x7f9fc403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 0x7f9fc403ec40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x555595c1b110 tx=0x7fa0e0005a00 comp rx=0 tx=0).stop 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 msgr2=0x555595c37750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc052080 tx=0x7fa0dc010b90 comp rx=0 tx=0).stop 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 shutdown_connections 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fc403c780 0x7f9fc403ec40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/1330440594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595c37330 0x555595c37750 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 >> 172.21.15.145:0/1330440594 conn(0x555595c2b6e0 msgr2=0x555595c2bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 shutdown_connections 2024-09-10T04:51:33.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/1330440594 wait complete. 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c21620 msgr2=0x555595c23ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555595c21620 0x555595c23ae0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595b1ffd0 msgr2=0x555595c20830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555595b1ffd0 0x555595c20830 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555595c26eb0 msgr2=0x555595c292a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555595c26eb0 0x555595c292a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fd003c780 msgr2=0x7f9fd003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f9fd003c780 0x7f9fd003ec40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0056000 tx=0x7fa0e0050000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 msgr2=0x555595c191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 --2- 172.21.15.145:0/4200510397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555595b1e4b0 0x555595c191e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc000f80 tx=0x7fa0dc001250 comp rx=0 tx=0).stop 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eb3c8640 1 -- 172.21.15.145:0/4200510397 reap_dead start 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 shutdown_connections 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 >> 172.21.15.145:0/4200510397 conn(0x555595b1a200 msgr2=0x555595c12b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 shutdown_connections 2024-09-10T04:51:33.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.549+0000 7fa0eef39800 1 -- 172.21.15.145:0/4200510397 wait complete. 2024-09-10T04:51:33.572 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T04:51:33.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T04:51:33.572 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-10T04:51:33.617 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:51:33.618 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:51:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33cc320800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c51ee2c6c0 0x55c51ee2eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33cc320800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c51ecd5e40 con 0x55c51ee2f050 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33cc320800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55c51eca0680 con 0x55c51ee2c6c0 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33c8068640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c51ee2c6c0 0x55c51ee2eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33c8068640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c51ee2c6c0 0x55c51ee2eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59688/0 (socket says 172.21.15.145:59688) 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33c8068640 1 -- 172.21.15.145:0/1284868254 learned_addr learned my addr 172.21.15.145:0/1284868254 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.617+0000 7f33c7867640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55c51ee2f050 0x55c51ee314f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36872/0 (socket says 172.21.15.145:36872) 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.618+0000 7f33c8068640 1 -- 172.21.15.145:0/1284868254 >> v1:172.21.15.98:6789/0 conn(0x55c51ee2f050 legacy=0x55c51ee314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.618+0000 7f33c7066640 1 -- 172.21.15.145:0/1284868254 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913586997 0 0) 0x55c51ecd5e40 con 0x55c51ee2f050 2024-09-10T04:51:33.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.618+0000 7f33c8068640 1 -- 172.21.15.145:0/1284868254 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ecbc6b0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.619+0000 7f33c8068640 1 --2- 172.21.15.145:0/1284868254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ee2eab0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f33c000a520 tx=0x7f33c0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2efff6ea918b9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33c7066640 1 -- 172.21.15.145:0/1284868254 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c0055070 con 0x55c51ee2c6c0 2024-09-10T04:51:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33c7066640 1 -- 172.21.15.145:0/1284868254 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c00515b0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33c7066640 1 -- 172.21.15.145:0/1284868254 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c00518d0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 -- 172.21.15.145:0/1284868254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 msgr2=0x55c51ee2eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 --2- 172.21.15.145:0/1284868254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ee2eab0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f33c000a520 tx=0x7f33c0045ba0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 -- 172.21.15.145:0/1284868254 shutdown_connections 2024-09-10T04:51:33.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 --2- 172.21.15.145:0/1284868254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ee2eab0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 -- 172.21.15.145:0/1284868254 >> 172.21.15.145:0/1284868254 conn(0x55c51ee26200 msgr2=0x55c51ee28640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 -- 172.21.15.145:0/1284868254 shutdown_connections 2024-09-10T04:51:33.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.620+0000 7f33cc320800 1 -- 172.21.15.145:0/1284868254 wait complete. 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.634+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.634+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.634+0000 7f33cc320800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.634+0000 7f33cc320800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c51ecc4dd0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59690/0 (socket says 172.21.15.145:59690) 2024-09-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f33c8068640 1 -- 172.21.15.145:0/1616201638 learned_addr learned my addr 172.21.15.145:0/1616201638 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f33c8068640 1 -- 172.21.15.145:0/1616201638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ecdde10 con 0x55c51ee2c6c0 2024-09-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f33c8068640 1 --2- 172.21.15.145:0/1616201638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f33c0045be0 tx=0x7f33c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346bdd8d598e2c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f32b660c640 1 -- 172.21.15.145:0/1616201638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c0051ac0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f32b660c640 1 -- 172.21.15.145:0/1616201638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0051c60 con 0x55c51ee2c6c0 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.635+0000 7f32b660c640 1 -- 172.21.15.145:0/1616201638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c0066460 con 0x55c51ee2c6c0 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- 172.21.15.145:0/1616201638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 msgr2=0x55c51ef1b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 --2- 172.21.15.145:0/1616201638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f33c0045be0 tx=0x7f33c0051000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- 172.21.15.145:0/1616201638 shutdown_connections 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 --2- 172.21.15.145:0/1616201638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef1b450 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- 172.21.15.145:0/1616201638 >> 172.21.15.145:0/1616201638 conn(0x55c51ee26200 msgr2=0x55c51ef16dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- 172.21.15.145:0/1616201638 shutdown_connections 2024-09-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- 172.21.15.145:0/1616201638 wait complete. 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.636+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33cc320800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef22c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33cc320800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c51ee33050 con 0x55c51ee2c6c0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef22c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59706/0 (socket says 172.21.15.145:59706) 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33c8068640 1 -- 172.21.15.145:0/1530615330 learned_addr learned my addr 172.21.15.145:0/1530615330 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33c8068640 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ef23190 con 0x55c51ee2c6c0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33c8068640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef22c30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f33c0045be0 tx=0x7f33c0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f32b4e09640 1 -- 172.21.15.145:0/1530615330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c005a650 con 0x55c51ee2c6c0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f32b4e09640 1 -- 172.21.15.145:0/1530615330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c005a7f0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c51ef23420 con 0x55c51ee2c6c0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.637+0000 7f32b4e09640 1 -- 172.21.15.145:0/1530615330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c005aad0 con 0x55c51ee2c6c0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.638+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51ef23e20 con 0x55c51ee2c6c0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.638+0000 7f32b4e09640 1 -- 172.21.15.145:0/1530615330 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33c0079060 con 0x55c51ee2c6c0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f32b4e09640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32b003c780 0x7f32b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f32b4e09640 1 -- 172.21.15.145:0/1530615330 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f33c0062070 con 0x55c51ee2c6c0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33c7867640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32b003c780 0x7f32b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ee2f050 0x55c51ef2a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef2a7c0 con 0x55c51ee2f050 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33c8869640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ee2f050 0x55c51ef2a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33c7867640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32b003c780 0x7f32b003ec40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33c8869640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ee2f050 0x55c51ef2a280 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33c8869640 1 -- 172.21.15.145:0/1530615330 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ee2f050 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef2b070 0x55c51ef2d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.639+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef2dc80 con 0x55c51ef2b070 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.640+0000 7f33c8068640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef2b070 0x55c51ef2d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.640+0000 7f33c8068640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef2b070 0x55c51ef2d510 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.640+0000 7f33c8068640 1 -- 172.21.15.145:0/1530615330 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33c0057030 con 0x55c51ef2b070 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.640+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef2f530 con 0x55c51ee2f050 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33c8869640 1 -- 172.21.15.145:0/1530615330 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ee2f050 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef2e760 con 0x55c51ef2b070 2024-09-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33c8068640 1 -- 172.21.15.145:0/1530615330 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33c0057030 con 0x55c51ef2b070 2024-09-10T04:51:33.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c51ef308e0 0x55c51ef32cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef33210 con 0x55c51ef308e0 2024-09-10T04:51:33.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33c7867640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c51ef308e0 0x55c51ef32cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.641+0000 7f33c7867640 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c51ef308e0 0x55c51ef32cd0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33c7867640 1 -- 172.21.15.145:0/1530615330 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33b000f670 con 0x55c51ef308e0 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33cc320800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33cc320800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c51ed22a00 con 0x55c51ee2be60 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59714/0 (socket says 172.21.15.145:59714) 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.642+0000 7f33c8068640 1 -- 172.21.15.145:0/54232319 learned_addr learned my addr 172.21.15.145:0/54232319 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f33c8068640 1 -- 172.21.15.145:0/54232319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ee2c380 con 0x55c51ee2be60 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f33c8068640 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f33c00957b0 tx=0x7f33c0050520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f32adffb640 1 -- 172.21.15.145:0/54232319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c008b070 con 0x55c51ee2be60 2024-09-10T04:51:33.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f32adffb640 1 -- 172.21.15.145:0/54232319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c008e360 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f32adffb640 1 -- 172.21.15.145:0/54232319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c004f6e0 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c51ee2ac10 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.643+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51ee2ac10 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.644+0000 7f32adffb640 1 -- 172.21.15.145:0/54232319 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33c008e070 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.644+0000 7f32adffb640 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 0x7f32a003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.644+0000 7f32adffb640 1 -- 172.21.15.145:0/54232319 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f33c00073e0 con 0x55c51ee2be60 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.644+0000 7f33c7867640 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 0x7f32a003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33c7867640 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 0x7f32a003eba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c51ef24b60 tx=0x7f33b0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33cc320800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33cc320800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c51ef1bbe0 con 0x55c51ef4f6b0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59718/0 (socket says 172.21.15.145:59718) 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33c8068640 1 -- 172.21.15.145:0/2251657302 learned_addr learned my addr 172.21.15.145:0/2251657302 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.645+0000 7f33c8068640 1 -- 172.21.15.145:0/2251657302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ef50080 con 0x55c51ef4f6b0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33c8068640 1 --2- 172.21.15.145:0/2251657302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f33c004ffd0 tx=0x7f33c004eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fe75bf6fd069bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f329f7fe640 1 -- 172.21.15.145:0/2251657302 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c0065950 con 0x55c51ef4f6b0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f329f7fe640 1 -- 172.21.15.145:0/2251657302 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0067030 con 0x55c51ef4f6b0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f329f7fe640 1 -- 172.21.15.145:0/2251657302 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c004e680 con 0x55c51ef4f6b0 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 -- 172.21.15.145:0/2251657302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 msgr2=0x55c51ef4fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 --2- 172.21.15.145:0/2251657302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f33c004ffd0 tx=0x7f33c004eba0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 -- 172.21.15.145:0/2251657302 shutdown_connections 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 --2- 172.21.15.145:0/2251657302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef4fa90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 -- 172.21.15.145:0/2251657302 >> 172.21.15.145:0/2251657302 conn(0x55c51ef4bab0 msgr2=0x55c51ef49cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 -- 172.21.15.145:0/2251657302 shutdown_connections 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 -- 172.21.15.145:0/2251657302 wait complete. 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.646+0000 7f33cc320800 1 Processor -- start 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33cc320800 1 -- start start 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33cc320800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33cc320800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c51ef50510 con 0x55c51ef4f6b0 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33c8068640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:59728/0 (socket says 172.21.15.145:59728) 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 learned_addr learned my addr 172.21.15.145:0/1276584571 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ef57070 con 0x55c51ef4f6b0 2024-09-10T04:51:33.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f33c8068640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f33c00945b0 tx=0x7f33c0075fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.647+0000 7f329dffb640 1 -- 172.21.15.145:0/1276584571 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c00bc020 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f329dffb640 1 -- 172.21.15.145:0/1276584571 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c00715f0 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f329dffb640 1 -- 172.21.15.145:0/1276584571 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c0072430 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c51ef57070 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51ef57070 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f329dffb640 1 -- 172.21.15.145:0/1276584571 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33c00bf020 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.648+0000 7f329dffb640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f329003c780 0x7f329003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f329dffb640 1 -- 172.21.15.145:0/1276584571 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f33c00b2040 con 0x55c51ef4f6b0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33c7867640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f329003c780 0x7f329003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33c7867640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f329003c780 0x7f329003ec40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33b000ffd0 tx=0x7f33b0023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ef620d0 0x55c51ef64590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef64ce0 con 0x55c51ef620d0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33c8869640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ef620d0 0x55c51ef64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.649+0000 7f33c8869640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ef620d0 0x55c51ef64590 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 realm 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef61400 con 0x55c51ef620d0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:51:33.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef65770 con 0x55c51ef620d0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef66550 0x55c51ef68940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef68fa0 con 0x55c51ef66550 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.650+0000 7f33c8068640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef66550 0x55c51ef68940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33c8068640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef66550 0x55c51ef68940 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef697f0 con 0x55c51ef620d0 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 20 searching for the correct realm 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c51ef6b560 0x55c51ef6d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.651+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c7867640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c51ef6b560 0x55c51ef6d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c7867640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c51ef6b560 0x55c51ef6d990 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c8068640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33c00c1020 0x7f33c00b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:51:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.652+0000 7f33c8869640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33c00c1020 0x7f33c00b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33c00c1020 0x7f33c00b68d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33b800a4d0 con 0x7f33c00c1020 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.653+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.654+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b800a4d0 con 0x55c51ef620d0 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.655+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.656+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.657+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.658+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x7f33c00c1020 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b8030040 con 0x7f33c00c1020 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef6b560 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.659+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e060 con 0x55c51ef66550 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6a1a0 con 0x55c51ef620d0 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b8030040 con 0x55c51ef620d0 2024-09-10T04:51:33.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.660+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6aa40 con 0x55c51ef66550 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef69de0 con 0x7f33c00c1020 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 zone default found 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 4 Realm: () 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:51:33.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 zonegroup default 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6e540 con 0x7f33c00c1020 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef703a0 con 0x55c51ef6b560 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.661+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef70910 con 0x55c51ef6b560 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.662+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.662+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.662+0000 7f33cc320800 20 started sync module instance, tier type = 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.662+0000 7f33cc320800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.662+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6f810 con 0x55c51ef66550 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.663+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.663+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94305116421120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef71220 con 0x55c51ef66550 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.663+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef71a70 con 0x55c51ef620d0 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.664+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94305116421120] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.664+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.664+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94305116425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef71ab0 con 0x55c51ef620d0 2024-09-10T04:51:33.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.664+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef725c0 con 0x55c51ef66550 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.665+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94305116425584] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.665+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.665+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94305116430448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef72580 con 0x55c51ef66550 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.665+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef73070 con 0x7f33c00c1020 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.666+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94305116430448] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.666+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.666+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94305116433280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef73070 con 0x7f33c00c1020 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.666+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef73ac0 con 0x55c51ef66550 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.669+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94305116433280] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.669+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.669+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94305116427712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef73a80 con 0x55c51ef66550 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.669+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef74500 con 0x55c51ef6b560 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.670+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94305116427712] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.671+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.671+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94305116435920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef739f0 con 0x55c51ef6b560 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.671+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef75370 con 0x55c51ef6b560 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.672+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94305116435920] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.672+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.672+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94305116440736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef75bc0 con 0x55c51ef6b560 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.672+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef76470 con 0x7f33c00c1020 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94305116440736] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94305116444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef75fe0 con 0x7f33c00c1020 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=0 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=1 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=2 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=3 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=4 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=5 2024-09-10T04:51:33.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.673+0000 7f33cc320800 20 add_watcher() i=6 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94305116444432] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33cc320800 20 add_watcher() i=7 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33cc320800 2 all 8 watchers are set, enabling cache 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef79980 con 0x55c51ef620d0 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.674+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94305116445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef76ed0 con 0x55c51ef620d0 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.675+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94305116445952] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.676+0000 7f327efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.676+0000 7f33cc320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.676+0000 7f33cc320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.676+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef82270 con 0x55c51ef66550 2024-09-10T04:51:33.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.677+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.677+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef822b0 con 0x7f33c00c1020 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.678+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.678+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef829a0 con 0x55c51ef6b560 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.679+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.679+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef82dc0 con 0x55c51ef620d0 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.681+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'230 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.681+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef83330 con 0x55c51ef66550 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.682+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.682+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef82ce0 con 0x55c51ef6b560 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.683+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'60 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.683+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef839b0 con 0x55c51ef66550 2024-09-10T04:51:33.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.684+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.684+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef839b0 con 0x55c51ef620d0 2024-09-10T04:51:33.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.685+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.685+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef83f20 con 0x55c51ef66550 2024-09-10T04:51:33.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.687+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.687+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef83fb0 con 0x55c51ef66550 2024-09-10T04:51:33.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.688+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.688+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84040 con 0x55c51ef66550 2024-09-10T04:51:33.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.689+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.689+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84040 con 0x55c51ef6b560 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.690+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.690+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef845b0 con 0x55c51ef66550 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.691+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.691+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef845b0 con 0x55c51ef620d0 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.692+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.693+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84640 con 0x55c51ef620d0 2024-09-10T04:51:33.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.694+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'231 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.694+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84640 con 0x55c51ef66550 2024-09-10T04:51:33.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.695+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.695+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84640 con 0x55c51ef66550 2024-09-10T04:51:33.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.696+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.696+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef84640 con 0x55c51ef6b560 2024-09-10T04:51:33.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.697+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.697+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef846d0 con 0x55c51ef66550 2024-09-10T04:51:33.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.698+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.698+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef846d0 con 0x55c51ef620d0 2024-09-10T04:51:33.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.699+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'232 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.699+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef846d0 con 0x55c51ef66550 2024-09-10T04:51:33.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.700+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.700+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef846d0 con 0x55c51ef66550 2024-09-10T04:51:33.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.701+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.701+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef846d0 con 0x55c51ef6b560 2024-09-10T04:51:33.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.702+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.702+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef66550 2024-09-10T04:51:33.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.703+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.703+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.704+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.704+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.705+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.705+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.707+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.707+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef66550 2024-09-10T04:51:33.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.708+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.708+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef620d0 2024-09-10T04:51:33.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.709+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.709+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef66550 2024-09-10T04:51:33.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.710+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.710+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x55c51ef620d0 2024-09-10T04:51:33.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.711+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.711+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef847a0 con 0x7f33c00c1020 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.712+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.712+0000 7f327dfdb640 20 reqs_thread_entry: start 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.712+0000 7f33cc320800 20 init_complete bucket index max shards: 11 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 20 Filter name: none 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f31ef7fe640 20 reqs_thread_entry: start 2024-09-10T04:51:33.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T04:51:33.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaf9a0 con 0x7f33c00c1020 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.713+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb1e60 con 0x55c51ef620d0 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv8 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 : miss 2024-09-10T04:51:33.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 8.10 8:0a22b7c3:root::.bucket.meta.myfoo7%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb0490 con 0x55c51ef66550 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(96 .bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=390 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 info.flags=0x17 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 to cache LRU end 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.714+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:97 4.23 4:c4a5e5d0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02f380 con 0x55c51ef6b560 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(97 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:98 4.16 4:6acd2fa5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02f3c0 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(98 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:99 4.16 4:69e84dc2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02f3c0 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(99 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.715+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 4.16 4:694497f0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(100 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:101 4.f 4:f15d56b1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef620d0 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(101 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:102 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(102 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [call out=381b] v0'0 uv11 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33cc320800 10 cls_bucket_list_unordered: got fourteen 2024-09-10T04:51:33.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.716+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:103 4.3e 4:7f5c47ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef66550 2024-09-10T04:51:33.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.717+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(103 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.717+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:104 4.34 4:2d1865c6:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x7f33c00c1020 2024-09-10T04:51:33.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.717+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(104 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.717+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:105 4.3a 4:5e08faa4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x7f33c00c1020 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(105 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b8041040 con 0x7f33c00c1020 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:106 4.36 4:6d256782:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef620d0 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(106 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:107 4.21 4:8765625f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02edb0 con 0x55c51ef6b560 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(107 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10 [call out=89b] v0'0 uv12 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33cc320800 20 get_obj_state: octx=0x7f33b800ab10 obj=myfoo7:fourteen state=0x55c51f02d408 s->prefetch_data=0 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.718+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:108 3.13s0 3:cbd715f8:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02dd80 con 0x55c51ef6b560 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(108 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 10 manifest: total_size = 8 2024-09-10T04:51:33.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.3683431554626900371 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 20 get_obj_state: octx=0x7f33b800ab10 obj=myfoo7:fourteen state=0x55c51f02d408 s->prefetch_data=0 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 20 prepare_atomic_modification: state is not atomic. state=0x55c51f02d408 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.719+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02e650 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.720+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(109 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.720+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 3.13s0 3:cbd715f8:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02e650 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(110 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb6550 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33cc320800 20 list_objects_ordered: starting attempt 1 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33cc320800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:112 4.23 4:c4a5e5d0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb6550 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.721+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:113 4.16 4:6acd2fa5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb6550 con 0x55c51ef6b560 2024-09-10T04:51:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:114 4.16 4:69e84dc2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbcc80 con 0x55c51ef6b560 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:115 4.16 4:694497f0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbfa50 con 0x55c51ef6b560 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:116 4.f 4:f15d56b1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc28a0 con 0x55c51ef620d0 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(112 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(116 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b8041040 con 0x55c51ef620d0 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:117 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbcc80 con 0x55c51ef6b560 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(113 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:118 4.3e 4:7f5c47ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc28a0 con 0x55c51ef66550 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:119 4.34 4:2d1865c6:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc31c0 con 0x7f33c00c1020 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:120 4.3a 4:5e08faa4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc31c0 con 0x7f33c00c1020 2024-09-10T04:51:33.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:121 4.36 4:6d256782:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc7f40 con 0x55c51ef620d0 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:122 4.21 4:8765625f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efca830 con 0x55c51ef6b560 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.722+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(114 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(120 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(119 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(118 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(115 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(121 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(111 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f329f7fe640 20 handle_completion(): completion ok for obj=fourteen 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(122 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10 [call out=89b] v0'0 uv12 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(117 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10])"; uploads.size()=0; is_truncated=0 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:123 4.23 4:c4a5e5d0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02e0f0 con 0x55c51ef6b560 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:124 4.16 4:6acd2fa5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x55c51ef6b560 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:125 4.16 4:69e84dc2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbf5f0 con 0x55c51ef6b560 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:126 4.16 4:694497f0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efca810 con 0x55c51ef6b560 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:127 4.f 4:f15d56b1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51f02e0f0 con 0x55c51ef620d0 2024-09-10T04:51:33.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:128 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbf5f0 con 0x55c51ef6b560 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:129 4.3e 4:7f5c47ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efca810 con 0x55c51ef66550 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:130 4.34 4:2d1865c6:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x7f33c00c1020 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:131 4.3a 4:5e08faa4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbf5f0 con 0x7f33c00c1020 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:132 4.36 4:6d256782:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc7d20 con 0x55c51ef620d0 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:133 4.21 4:8765625f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efcf350 con 0x55c51ef6b560 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(123 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.723+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(124 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(127 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(129 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(130 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(133 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10 [call out=89b] v0'0 uv12 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(125 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(132 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(131 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(126 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(128 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.724+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x55c51ef620d0 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(134 fud.buckets [call] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33cc320800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x7f33c00c1020 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.725+0000 7f33cc320800 20 rados_obj.operate() r=0 bl.length=168 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.726+0000 7f33cc320800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.726+0000 7f33cc320800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.726+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x7f33c00c1020 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.726+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.726+0000 7f33cc320800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33cc320800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94305116780240 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x7f33c00c1020 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== watch-notify(notify (1) cookie 94305116433280 notify 146028888080 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c51ef84210 con 0x7f33c00c1020 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f329f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94305116433280 notifier 4762 bl.length()=150 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f329f7fe640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3294003d60 con 0x7f33c00c1020 2024-09-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(137 notify.3 [notify cookie 94305116780240 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== watch-notify(notify_complete (2) cookie 94305116780240 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c51ef83d50 con 0x7f33c00c1020 2024-09-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.727+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:139 8.10 8:0a22b7c3:root::.bucket.meta.myfoo7%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2cd0 con 0x55c51ef66550 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(139 .bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 from cache 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10, ofs0, ns] 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94305116735792 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef6b560 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 44 ==== watch-notify(notify (1) cookie 94305116435920 notify 146028888087 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55c51ef843e0 con 0x55c51ef6b560 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f329effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94305116435920 notifier 4762 bl.length()=208 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 45 ==== osd_op_reply(140 notify.5 [notify cookie 94305116735792 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f329effd640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f31fc0032c0 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 46 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 47 ==== watch-notify(notify_complete (2) cookie 94305116735792 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c51ef839b0 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:142 4.23 4:c4a5e5d0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:143 4.16 4:6acd2fa5:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc76d0 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:144 4.16 4:69e84dc2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb0de0 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:145 4.16 4:694497f0:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:146 4.f 4:f15d56b1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc76d0 con 0x55c51ef620d0 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:147 4.16 4:6b4799ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb0de0 con 0x55c51ef6b560 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:148 4.3e 4:7f5c47ad:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef66550 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:149 4.34 4:2d1865c6:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbba50 con 0x7f33c00c1020 2024-09-10T04:51:33.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:150 4.3a 4:5e08faa4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efb0de0 con 0x7f33c00c1020 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:151 4.36 4:6d256782:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efbd120 con 0x55c51ef620d0 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.729+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:152 4.21 4:8765625f:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef6b560 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.731+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(148 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.6 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.731+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(149 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.7 [delete] v34'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.731+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 48 ==== osd_op_reply(142 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.0 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.731+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 49 ==== osd_op_reply(143 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.1 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(150 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.8 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 50 ==== osd_op_reply(152 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.10 [delete] v34'14 uv14 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 51 ==== osd_op_reply(144 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.2 [delete] v34'15 uv15 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(146 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.4 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(151 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.9 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 52 ==== osd_op_reply(145 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.3 [delete] v34'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 53 ==== osd_op_reply(147 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10.5 [delete] v34'17 uv17 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 : miss 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 20 rados->read ofs=0 len=0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:153 6.10 6:0dee365f:::pubsub..bucket.myfoo7%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef620d0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 info.flags=0x0 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 10 adding default.rgw.log++pubsub..bucket.myfoo7/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 to cache LRU end 2024-09-10T04:51:33.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.732+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:154 6.10 6:0dee365f:::pubsub..bucket.myfoo7%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef620d0 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.733+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(154 pubsub..bucket.myfoo7/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.10 [delete] v34'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.733+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efaff50 con 0x55c51ef620d0 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.734+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(155 fud.buckets [call] v34'11 uv11 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.734+0000 7f33cc320800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.734+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc76d0 con 0x55c51ef6b560 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.735+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 54 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.735+0000 7f33cc320800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.735+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94305116735760 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2b70 con 0x55c51ef66550 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== watch-notify(notify (1) cookie 94305116430448 notify 146028888105 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c51efb1940 con 0x55c51ef66550 2024-09-10T04:51:33.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f329effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94305116430448 notifier 4762 bl.length()=170 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(157 notify.2 [notify cookie 94305116735760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f329effd640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f31fc0032a0 con 0x55c51ef66550 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== watch-notify(notify_complete (2) cookie 94305116735760 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c51ef23e20 con 0x55c51ef66550 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33cc320800 10 removing email index: 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33cc320800 10 removing user buckets index 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.736+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc76d0 con 0x55c51ef620d0 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(159 fud.buckets [delete] v34'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33cc320800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94305116735760 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2b70 con 0x55c51ef6b560 2024-09-10T04:51:33.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 55 ==== watch-notify(notify (1) cookie 94305116440736 notify 146028888088 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c51ef839b0 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f329f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94305116440736 notifier 4762 bl.length()=160 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f329f7fe640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3294003d60 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 56 ==== osd_op_reply(160 notify.6 [notify cookie 94305116735760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 57 ==== watch-notify(notify_complete (2) cookie 94305116735760 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c51ef837e0 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33cc320800 10 removing user index: fud 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 58 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.737+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc76d0 con 0x7f33c00c1020 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.738+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 31 ==== osd_op_reply(162 fud [call,call,delete] v34'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.738+0000 7f33cc320800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33cc320800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94305116735760 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c51efc2b70 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 59 ==== watch-notify(notify (1) cookie 94305116435920 notify 146028888089 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c51ef837e0 con 0x55c51ef6b560 2024-09-10T04:51:33.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f329effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94305116435920 notifier 4762 bl.length()=152 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f329effd640 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f31fc0032a0 con 0x55c51ef6b560 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 60 ==== osd_op_reply(163 notify.5 [notify cookie 94305116735760 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 61 ==== watch-notify(notify_complete (2) cookie 94305116735760 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c51ef81da0 con 0x55c51ef6b560 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.739+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 62 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.740+0000 7f327efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.740+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94305116445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef80b70 con 0x55c51ef620d0 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.741+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94305116445952] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.741+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94305116421120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef75cd0 con 0x55c51ef66550 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.742+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94305116421120] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.742+0000 7f33cc320800 20 remove_watcher() i=0 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.742+0000 7f33cc320800 2 removed watcher, disabling cache 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.742+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94305116425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef6fc00 con 0x55c51ef620d0 2024-09-10T04:51:33.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.743+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94305116425584] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x55c51ef620d0 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.743+0000 7f33cc320800 20 remove_watcher() i=1 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.743+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94305116430448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef70d70 con 0x55c51ef66550 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.744+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94305116430448] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.744+0000 7f33cc320800 20 remove_watcher() i=2 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.744+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94305116433280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef70d70 con 0x7f33c00c1020 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.745+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94305116433280] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.745+0000 7f33cc320800 20 remove_watcher() i=3 2024-09-10T04:51:33.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.745+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94305116427712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef70d70 con 0x55c51ef66550 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.746+0000 7f33c8068640 1 -- 172.21.15.145:0/1276584571 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94305116427712] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c008d030 con 0x55c51ef66550 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.746+0000 7f33cc320800 20 remove_watcher() i=4 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.746+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94305116435920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef715c0 con 0x55c51ef6b560 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.747+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 63 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94305116435920] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.747+0000 7f33cc320800 20 remove_watcher() i=5 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.747+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94305116440736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef735d0 con 0x55c51ef6b560 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.748+0000 7f33c7867640 1 -- 172.21.15.145:0/1276584571 <== osd.3 v2:172.21.15.145:6800/4228232102 64 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94305116440736] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0037040 con 0x55c51ef6b560 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.748+0000 7f33cc320800 20 remove_watcher() i=6 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.748+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94305116444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c51ef748a0 con 0x7f33c00c1020 2024-09-10T04:51:33.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 <== osd.2 v2:172.21.15.145:6816/1789112018 33 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94305116444432] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b804e040 con 0x7f33c00c1020 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 20 remove_watcher() i=7 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef66550 msgr2=0x55c51ef68940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef66550 0x55c51ef68940 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ef620d0 msgr2=0x55c51ef64590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ef620d0 0x55c51ef64590 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33c00c1020 msgr2=0x7f33c00b68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33c00c1020 0x7f33c00b68d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c51ef6b560 msgr2=0x55c51ef6d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c51ef6b560 0x55c51ef6d990 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f329003c780 msgr2=0x7f329003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f329003c780 0x7f329003ec40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33b000ffd0 tx=0x7f33b0023040 comp rx=0 tx=0).stop 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 msgr2=0x55c51ef56b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33c8869640 1 -- 172.21.15.145:0/1276584571 reap_dead start 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.749+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f33c00945b0 tx=0x7f33c0075fb0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 shutdown_connections 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1276584571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ef4f6b0 0x55c51ef56b10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 >> 172.21.15.145:0/1276584571 conn(0x55c51ef4bab0 msgr2=0x55c51ef49cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 shutdown_connections 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1276584571 wait complete. 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 msgr2=0x7f32a003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 0x7f32a003eba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c51ef24b60 tx=0x7f33b0006000 comp rx=0 tx=0).stop 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 msgr2=0x55c51ee2a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f33c00957b0 tx=0x7f33c0050520 comp rx=0 tx=0).stop 2024-09-10T04:51:33.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 shutdown_connections 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32a003c6e0 0x7f32a003eba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/54232319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2be60 0x55c51ee2a6d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 >> 172.21.15.145:0/54232319 conn(0x55c51ef35140 msgr2=0x55c51ef35520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 shutdown_connections 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/54232319 wait complete. 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef2b070 msgr2=0x55c51ef2d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c51ef2b070 0x55c51ef2d510 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ee2f050 msgr2=0x55c51ef2a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c51ee2f050 0x55c51ef2a280 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c51ef308e0 msgr2=0x55c51ef32cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c51ef308e0 0x55c51ef32cd0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32b003c780 msgr2=0x7f32b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f32b003c780 0x7f32b003ec40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b00013b0 comp rx=0 tx=0).stop 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 msgr2=0x55c51ef22c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33cc320800 1 --2- 172.21.15.145:0/1530615330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c51ee2c6c0 0x55c51ef22c30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f33c0045be0 tx=0x7f33c0003020 comp rx=0 tx=0).stop 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.750+0000 7f33c8869640 1 -- 172.21.15.145:0/1530615330 reap_dead start 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.751+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 shutdown_connections 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.751+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 >> 172.21.15.145:0/1530615330 conn(0x55c51ee26200 msgr2=0x55c51ef1c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.751+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 shutdown_connections 2024-09-10T04:51:33.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:51:33.751+0000 7f33cc320800 1 -- 172.21.15.145:0/1530615330 wait complete. 2024-09-10T04:52:13.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-10T04:52:13.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-10T04:52:13.768 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-10T04:52:13.821 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:13.821 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.820+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.820+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b77525800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561341fbb560 0x561341fc0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b77525800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561341e63e40 con 0x561341fb8440 2024-09-10T04:52:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b77525800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x561341e2e680 con 0x561341fbb560 2024-09-10T04:52:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b72932640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x561341fbb560 0x561341fc0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b73133640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x561341fb8440 0x561341fbae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36816/0 (socket says 172.21.15.145:36816) 2024-09-10T04:52:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b73133640 1 -- 172.21.15.145:0/366391816 learned_addr learned my addr 172.21.15.145:0/366391816 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b72932640 1 -- 172.21.15.145:0/366391816 >> v1:172.21.15.98:6789/0 conn(0x561341fb8440 legacy=0x561341fbae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.821+0000 7f4b72932640 1 -- 172.21.15.145:0/366391816 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561341e4a6b0 con 0x561341fbb560 2024-09-10T04:52:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.823+0000 7f4b72932640 1 --2- 172.21.15.145:0/366391816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fbb560 0x561341fc0eb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800a470 tx=0x7f4b68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a352a003fdc701e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b72131640 1 -- 172.21.15.145:0/366391816 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b68053570 con 0x561341fbb560 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b72131640 1 -- 172.21.15.145:0/366391816 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b68058070 con 0x561341fbb560 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b72131640 1 -- 172.21.15.145:0/366391816 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b68053880 con 0x561341fbb560 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 -- 172.21.15.145:0/366391816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fbb560 msgr2=0x561341fc0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 --2- 172.21.15.145:0/366391816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fbb560 0x561341fc0eb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800a470 tx=0x7f4b68045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 -- 172.21.15.145:0/366391816 shutdown_connections 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 --2- 172.21.15.145:0/366391816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fbb560 0x561341fc0eb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 -- 172.21.15.145:0/366391816 >> 172.21.15.145:0/366391816 conn(0x561341fb3920 msgr2=0x561341fb5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 -- 172.21.15.145:0/366391816 shutdown_connections 2024-09-10T04:52:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.824+0000 7f4b77525800 1 -- 172.21.15.145:0/366391816 wait complete. 2024-09-10T04:52:13.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.840+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.840+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.840+0000 7f4b77525800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.840+0000 7f4b77525800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561341e52dd0 con 0x561341fb8440 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.841+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.841+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46814/0 (socket says 172.21.15.145:46814) 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.841+0000 7f4b73133640 1 -- 172.21.15.145:0/2958922019 learned_addr learned my addr 172.21.15.145:0/2958922019 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.841+0000 7f4b73133640 1 -- 172.21.15.145:0/2958922019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561341e6be10 con 0x561341fb8440 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.841+0000 7f4b73133640 1 --2- 172.21.15.145:0/2958922019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4b64001800 tx=0x7f4b64001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3280c5d4824ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4a6160a640 1 -- 172.21.15.145:0/2958922019 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b64004520 con 0x561341fb8440 2024-09-10T04:52:13.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4a6160a640 1 -- 172.21.15.145:0/2958922019 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b640046c0 con 0x561341fb8440 2024-09-10T04:52:13.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4a6160a640 1 -- 172.21.15.145:0/2958922019 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b640049e0 con 0x561341fb8440 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 -- 172.21.15.145:0/2958922019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 msgr2=0x5613420a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 --2- 172.21.15.145:0/2958922019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4b64001800 tx=0x7f4b64001cc0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 -- 172.21.15.145:0/2958922019 shutdown_connections 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 --2- 172.21.15.145:0/2958922019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420a9890 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 -- 172.21.15.145:0/2958922019 >> 172.21.15.145:0/2958922019 conn(0x561341fb3920 msgr2=0x5613420a5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 -- 172.21.15.145:0/2958922019 shutdown_connections 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.842+0000 7f4b77525800 1 -- 172.21.15.145:0/2958922019 wait complete. 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b77525800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b77525800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561341fc13f0 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46828/0 (socket says 172.21.15.145:46828) 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b73133640 1 -- 172.21.15.145:0/2014336921 learned_addr learned my addr 172.21.15.145:0/2014336921 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.843+0000 7f4b73133640 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613420b17a0 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4b73133640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420b1240 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4b64000f80 tx=0x7f4b64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4a5fe07640 1 -- 172.21.15.145:0/2014336921 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b64022020 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4a5fe07640 1 -- 172.21.15.145:0/2014336921 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64014890 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4a5fe07640 1 -- 172.21.15.145:0/2014336921 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b64014bb0 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613420b1a30 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.844+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613420b2430 con 0x561341fb8440 2024-09-10T04:52:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4a5fe07640 1 -- 172.21.15.145:0/2014336921 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4b64025020 con 0x561341fb8440 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4a5fe07640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a5803c730 0x7f4a5803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4a5fe07640 1 -- 172.21.15.145:0/2014336921 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4b64018030 con 0x561341fb8440 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4b72932640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a5803c730 0x7f4a5803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561341fbb560 0x5613420b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.845+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420b8dd0 con 0x561341fbb560 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b73934640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561341fbb560 0x5613420b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b72932640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a5803c730 0x7f4a5803ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4b68057000 tx=0x7f4b68052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b73934640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561341fbb560 0x5613420b8890 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b73934640 1 -- 172.21.15.145:0/2014336921 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0083e0 con 0x561341fbb560 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420b9680 0x5613420bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420bc2b0 con 0x5613420b9680 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.846+0000 7f4b73133640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420b9680 0x5613420bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.847+0000 7f4b73133640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420b9680 0x5613420bbb40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.847+0000 7f4b73133640 1 -- 172.21.15.145:0/2014336921 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b64046040 con 0x5613420b9680 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.847+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420bdb60 con 0x561341fbb560 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b73934640 1 -- 172.21.15.145:0/2014336921 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b6c0083e0 con 0x561341fbb560 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420bcd90 con 0x5613420b9680 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b73133640 1 -- 172.21.15.145:0/2014336921 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b64046040 con 0x5613420b9680 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5613420bef10 0x5613420c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420c1840 con 0x5613420bef10 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b72932640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5613420bef10 0x5613420c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.848+0000 7f4b72932640 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5613420bef10 0x5613420c1300 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.849+0000 7f4b72932640 1 -- 172.21.15.145:0/2014336921 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b68051070 con 0x5613420bef10 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.849+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.849+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.849+0000 7f4b77525800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.849+0000 7f4b77525800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561341eb0a00 con 0x561341fba5f0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46832/0 (socket says 172.21.15.145:46832) 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b73133640 1 -- 172.21.15.145:0/1338057724 learned_addr learned my addr 172.21.15.145:0/1338057724 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b73133640 1 -- 172.21.15.145:0/1338057724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561341fbab10 con 0x561341fba5f0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b73133640 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4b64051fc0 tx=0x7f4b64010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4a5d602640 1 -- 172.21.15.145:0/1338057724 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b6401e730 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4a5d602640 1 -- 172.21.15.145:0/1338057724 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6401e8d0 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561341fb93a0 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4a5d602640 1 -- 172.21.15.145:0/1338057724 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b6404af60 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.850+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561341fb98f0 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.851+0000 7f4a5d602640 1 -- 172.21.15.145:0/1338057724 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4b64010070 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.851+0000 7f4a5d602640 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 0x7f4a4c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.851+0000 7f4a5d602640 1 -- 172.21.15.145:0/1338057724 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4b6403dd90 con 0x561341fba5f0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.851+0000 7f4b72932640 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 0x7f4a4c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b72932640 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 0x7f4a4c03ebf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5613420b3170 tx=0x7f4b68005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b77525800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b77525800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5613420aa0e0 con 0x5613420ddf00 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46846/0 (socket says 172.21.15.145:46846) 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b73133640 1 -- 172.21.15.145:0/2156759857 learned_addr learned my addr 172.21.15.145:0/2156759857 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.852+0000 7f4b73133640 1 -- 172.21.15.145:0/2156759857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613420de8f0 con 0x5613420ddf00 2024-09-10T04:52:13.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b73133640 1 --2- 172.21.15.145:0/2156759857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400a010 tx=0x7f4b64053500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b874ceb5186c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4a56ffd640 1 -- 172.21.15.145:0/2156759857 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b64059040 con 0x5613420ddf00 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4a56ffd640 1 -- 172.21.15.145:0/2156759857 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64053e50 con 0x5613420ddf00 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4a56ffd640 1 -- 172.21.15.145:0/2156759857 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b64030ce0 con 0x5613420ddf00 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 -- 172.21.15.145:0/2156759857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 msgr2=0x5613420de300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 --2- 172.21.15.145:0/2156759857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400a010 tx=0x7f4b64053500 comp rx=0 tx=0).stop 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 -- 172.21.15.145:0/2156759857 shutdown_connections 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 --2- 172.21.15.145:0/2156759857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420de300 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 -- 172.21.15.145:0/2156759857 >> 172.21.15.145:0/2156759857 conn(0x5613420da300 msgr2=0x5613420d8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 -- 172.21.15.145:0/2156759857 shutdown_connections 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.853+0000 7f4b77525800 1 -- 172.21.15.145:0/2156759857 wait complete. 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b77525800 1 Processor -- start 2024-09-10T04:52:13.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b77525800 1 -- start start 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b77525800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b77525800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5613420ded60 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b73133640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46860/0 (socket says 172.21.15.145:46860) 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 learned_addr learned my addr 172.21.15.145:0/240876499 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613420e58e0 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.854+0000 7f4b73133640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4b6401ea80 tx=0x7f4b6404bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.855+0000 7f4a557fa640 1 -- 172.21.15.145:0/240876499 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b6406d070 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.855+0000 7f4a557fa640 1 -- 172.21.15.145:0/240876499 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64026830 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.855+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613420e58e0 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.855+0000 7f4a557fa640 1 -- 172.21.15.145:0/240876499 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b6404b920 con 0x5613420ddf00 2024-09-10T04:52:13.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.855+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613420e58e0 con 0x5613420ddf00 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.856+0000 7f4a557fa640 1 -- 172.21.15.145:0/240876499 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4b64065070 con 0x5613420ddf00 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.856+0000 7f4a557fa640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a3c03c780 0x7f4a3c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.856+0000 7f4a557fa640 1 -- 172.21.15.145:0/240876499 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4b64063020 con 0x5613420ddf00 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.856+0000 7f4b72932640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a3c03c780 0x7f4a3c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b72932640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a3c03c780 0x7f4a3c03ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000c00 tx=0x7f4b68053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5613420f0700 0x5613420f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f3310 con 0x5613420f0700 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b73934640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5613420f0700 0x5613420f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b73934640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5613420f0700 0x5613420f2bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0083e0 con 0x5613420f0700 2024-09-10T04:52:13.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 20 realm 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.857+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420efa30 con 0x5613420f0700 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0083e0 con 0x5613420f0700 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f3da0 con 0x5613420f0700 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0083e0 con 0x5613420f0700 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420f4b80 0x5613420f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f75d0 con 0x5613420f4b80 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.858+0000 7f4b73133640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420f4b80 0x5613420f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b73133640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420f4b80 0x5613420f6f70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b6c0083e0 con 0x5613420f0700 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 20 searching for the correct realm 2024-09-10T04:52:13.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5613420f9b90 0x5613420fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420fc690 con 0x5613420f9b90 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.859+0000 7f4b72932640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5613420f9b90 0x5613420fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b72932640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5613420f9b90 0x5613420fbfc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420fc690 con 0x5613420f4b80 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b73133640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4b64049050 0x7f4b64015400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f4b64086040 con 0x7f4b64049050 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.860+0000 7f4b73934640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4b64049050 0x7f4b64015400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4b64049050 0x7f4b64015400 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b6c0083e0 con 0x7f4b64049050 2024-09-10T04:52:13.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0083e0 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.861+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.862+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.863+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.864+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.864+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.864+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.864+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.864+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.865+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.866+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f0700 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x7f4b64049050 2024-09-10T04:52:13.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.867+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f9b90 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.868+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613420f7e20 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:13.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.869+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f8670 con 0x5613420f0700 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f8a60 con 0x5613420f4b80 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:13.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f8a60 con 0x7f4b64049050 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.870+0000 7f4b77525800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 zone default found 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 4 Realm: () 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 zonegroup default 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f8e80 con 0x7f4b64049050 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420f8e80 con 0x5613420f9b90 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613420fe560 con 0x5613420f9b90 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 started sync module instance, tier type = 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.871+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fd9a0 con 0x5613420f4b80 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.873+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.873+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94640712703648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fd9a0 con 0x5613420f4b80 2024-09-10T04:52:13.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.873+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fefe0 con 0x5613420f0700 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.874+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.874+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94640712706864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fefb0 con 0x5613420f0700 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.874+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fffd0 con 0x5613420f4b80 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.874+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94640712703648] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.875+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94640712706864] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.875+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.875+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94640712709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420fff90 con 0x5613420f4b80 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.875+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342100870 con 0x7f4b64049050 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.876+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.876+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94640712713152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342100c90 con 0x7f4b64049050 2024-09-10T04:52:13.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.876+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613421014e0 con 0x5613420f4b80 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.877+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94640712709072] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.877+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.878+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94640712715408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613421018d0 con 0x5613420f4b80 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.878+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342102120 con 0x5613420f9b90 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.879+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94640712713152] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.879+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94640712715408] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.882+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.882+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94640712714208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613421011c0 con 0x5613420f9b90 2024-09-10T04:52:13.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.882+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342101d80 con 0x5613420f9b90 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.883+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94640712714208] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.883+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.883+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94640712718544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342101cf0 con 0x5613420f9b90 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.883+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342103600 con 0x7f4b64049050 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94640712718544] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94640712723248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342103600 con 0x7f4b64049050 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=0 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=1 2024-09-10T04:52:13.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=2 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=3 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=4 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=5 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.884+0000 7f4b77525800 20 add_watcher() i=6 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.885+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94640712723248] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.885+0000 7f4b77525800 20 add_watcher() i=7 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.885+0000 7f4b77525800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.885+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613421069d0 con 0x5613420f0700 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.886+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.886+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94640712737632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342103770 con 0x5613420f0700 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.887+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94640712737632] v34'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.887+0000 7f4a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.887+0000 7f4b77525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.887+0000 7f4b77525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.887+0000 7f4b77525800 5 note: GC not initialized 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4a28fe1640 20 reqs_thread_entry: start 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 20 Filter name: none 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f49a27fc640 20 reqs_thread_entry: start 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 20 rados->read ofs=0 len=0 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561342139ae0 con 0x5613420f0700 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.888+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342139500 con 0x5613420f9b90 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.889+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.889+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342139500 con 0x5613420f9b90 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.890+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.891+0000 7f4a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:13.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.891+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94640712737632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342139500 con 0x5613420f0700 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.892+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94640712737632] v34'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.892+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94640712703648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342139500 con 0x5613420f4b80 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.893+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94640712703648] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.894+0000 7f4b77525800 20 remove_watcher() i=0 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.894+0000 7f4b77525800 2 removed watcher, disabling cache 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.894+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94640712706864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342139500 con 0x5613420f0700 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.895+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94640712706864] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x5613420f0700 2024-09-10T04:52:13.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.895+0000 7f4b77525800 20 remove_watcher() i=1 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.895+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94640712709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420feb30 con 0x5613420f4b80 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.896+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94640712709072] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.896+0000 7f4b77525800 20 remove_watcher() i=2 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.896+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94640712713152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420feb30 con 0x7f4b64049050 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.897+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94640712713152] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.897+0000 7f4b77525800 20 remove_watcher() i=3 2024-09-10T04:52:13.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.897+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94640712715408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420feb30 con 0x5613420f4b80 2024-09-10T04:52:13.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.898+0000 7f4b73133640 1 -- 172.21.15.145:0/240876499 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94640712715408] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6405c040 con 0x5613420f4b80 2024-09-10T04:52:13.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.898+0000 7f4b77525800 20 remove_watcher() i=4 2024-09-10T04:52:13.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.898+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94640712714208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561342100c90 con 0x5613420f9b90 2024-09-10T04:52:13.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.899+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94640712714208] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.899+0000 7f4b77525800 20 remove_watcher() i=5 2024-09-10T04:52:13.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.899+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94640712718544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613420feb30 con 0x5613420f9b90 2024-09-10T04:52:13.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.900+0000 7f4b72932640 1 -- 172.21.15.145:0/240876499 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94640712718544] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6807c040 con 0x5613420f9b90 2024-09-10T04:52:13.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.900+0000 7f4b77525800 20 remove_watcher() i=6 2024-09-10T04:52:13.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.900+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94640712723248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613421018d0 con 0x7f4b64049050 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94640712723248] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b6c025040 con 0x7f4b64049050 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 20 remove_watcher() i=7 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420f4b80 msgr2=0x5613420f6f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420f4b80 0x5613420f6f70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5613420f0700 msgr2=0x5613420f2bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5613420f0700 0x5613420f2bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4b64049050 msgr2=0x7f4b64015400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4b64049050 0x7f4b64015400 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5613420f9b90 msgr2=0x5613420fbfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5613420f9b90 0x5613420fbfc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a3c03c780 msgr2=0x7f4a3c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a3c03c780 0x7f4a3c03ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000c00 tx=0x7f4b68053000 comp rx=0 tx=0).stop 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 msgr2=0x5613420e5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4b6401ea80 tx=0x7f4b6404bf60 comp rx=0 tx=0).stop 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b73934640 1 -- 172.21.15.145:0/240876499 reap_dead start 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 shutdown_connections 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 --2- 172.21.15.145:0/240876499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5613420ddf00 0x5613420e5380 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 >> 172.21.15.145:0/240876499 conn(0x5613420da300 msgr2=0x5613420d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.901+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 shutdown_connections 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/240876499 wait complete. 2024-09-10T04:52:13.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 msgr2=0x7f4a4c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 0x7f4a4c03ebf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5613420b3170 tx=0x7f4b68005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 msgr2=0x561341fb8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4b64051fc0 tx=0x7f4b64010e80 comp rx=0 tx=0).stop 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 shutdown_connections 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a4c03c730 0x7f4a4c03ebf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/1338057724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fba5f0 0x561341fb8e60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 >> 172.21.15.145:0/1338057724 conn(0x5613420c3740 msgr2=0x5613420c3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 shutdown_connections 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/1338057724 wait complete. 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420b9680 msgr2=0x5613420bbb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5613420b9680 0x5613420bbb40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561341fbb560 msgr2=0x5613420b8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x561341fbb560 0x5613420b8890 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5613420bef10 msgr2=0x5613420c1300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5613420bef10 0x5613420c1300 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a5803c730 msgr2=0x7f4a5803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4a5803c730 0x7f4a5803ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4b68057000 tx=0x7f4b68052000 comp rx=0 tx=0).stop 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 msgr2=0x5613420b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 --2- 172.21.15.145:0/2014336921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561341fb8440 0x5613420b1240 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4b64000f80 tx=0x7f4b64001250 comp rx=0 tx=0).stop 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b73934640 1 -- 172.21.15.145:0/2014336921 reap_dead start 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 shutdown_connections 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 >> 172.21.15.145:0/2014336921 conn(0x561341fb3920 msgr2=0x5613420aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.902+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 shutdown_connections 2024-09-10T04:52:13.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.903+0000 7f4b77525800 1 -- 172.21.15.145:0/2014336921 wait complete. 2024-09-10T04:52:13.912 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T04:52:13.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T04:52:13.913 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T04:52:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:13.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:13.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:13.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbf040800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f0e71912c0 0x55f0e7196e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbf040800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0e7039e40 con 0x55f0e718fff0 2024-09-10T04:52:13.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbf040800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f0e7004680 con 0x55f0e71912c0 2024-09-10T04:52:13.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3db4329640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f0e71912c0 0x55f0e7196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbcb2a640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f0e718fff0 0x55f0e7190bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36820/0 (socket says 172.21.15.145:36820) 2024-09-10T04:52:13.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3db4329640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f0e71912c0 0x55f0e7196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46866/0 (socket says 172.21.15.145:46866) 2024-09-10T04:52:13.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1427246885 learned_addr learned my addr 172.21.15.145:0/1427246885 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:13.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3db4329640 1 -- 172.21.15.145:0/1427246885 >> v1:172.21.15.98:6789/0 conn(0x55f0e718fff0 legacy=0x55f0e7190bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.957+0000 7f3db4329640 1 -- 172.21.15.145:0/1427246885 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e70206b0 con 0x55f0e71912c0 2024-09-10T04:52:13.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.959+0000 7f3db4329640 1 --2- 172.21.15.145:0/1427246885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e71912c0 0x55f0e7196e60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3da400a470 tx=0x7f3da4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16aa02858cacefa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.959+0000 7f3db7fff640 1 -- 172.21.15.145:0/1427246885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4053570 con 0x55f0e71912c0 2024-09-10T04:52:13.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3db7fff640 1 -- 172.21.15.145:0/1427246885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4058070 con 0x55f0e71912c0 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3db7fff640 1 -- 172.21.15.145:0/1427246885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4053880 con 0x55f0e71912c0 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 -- 172.21.15.145:0/1427246885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e71912c0 msgr2=0x55f0e7196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1427246885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e71912c0 0x55f0e7196e60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3da400a470 tx=0x7f3da4045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 -- 172.21.15.145:0/1427246885 shutdown_connections 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1427246885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e71912c0 0x55f0e7196e60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 -- 172.21.15.145:0/1427246885 >> 172.21.15.145:0/1427246885 conn(0x55f0e718b3c0 msgr2=0x55f0e718d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 -- 172.21.15.145:0/1427246885 shutdown_connections 2024-09-10T04:52:13.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.960+0000 7f3dbf040800 1 -- 172.21.15.145:0/1427246885 wait complete. 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbf040800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbf040800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0e7028dd0 con 0x55f0e718fff0 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.974+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46872/0 (socket says 172.21.15.145:46872) 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1843938143 learned_addr learned my addr 172.21.15.145:0/1843938143 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1843938143 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e7041e10 con 0x55f0e718fff0 2024-09-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/1843938143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001e40 tx=0x7f3dac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a119a4f8b0eac77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3caae0d640 1 -- 172.21.15.145:0/1843938143 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac012020 con 0x55f0e718fff0 2024-09-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3caae0d640 1 -- 172.21.15.145:0/1843938143 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac00e5a0 con 0x55f0e718fff0 2024-09-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.975+0000 7f3caae0d640 1 -- 172.21.15.145:0/1843938143 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac00e8a0 con 0x55f0e718fff0 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- 172.21.15.145:0/1843938143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 msgr2=0x55f0e71056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1843938143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001e40 tx=0x7f3dac001e70 comp rx=0 tx=0).stop 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- 172.21.15.145:0/1843938143 shutdown_connections 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1843938143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e71056b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- 172.21.15.145:0/1843938143 >> 172.21.15.145:0/1843938143 conn(0x55f0e718b3c0 msgr2=0x55f0e727af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- 172.21.15.145:0/1843938143 shutdown_connections 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- 172.21.15.145:0/1843938143 wait complete. 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e7289110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.976+0000 7f3dbf040800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0e71919b0 con 0x55f0e718fff0 2024-09-10T04:52:13.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e7289110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e7289110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46876/0 (socket says 172.21.15.145:46876) 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/2824255441 learned_addr learned my addr 172.21.15.145:0/2824255441 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e7289670 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e7289110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0012b0 tx=0x7f3dac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3ca960a640 1 -- 172.21.15.145:0/2824255441 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac012030 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3ca960a640 1 -- 172.21.15.145:0/2824255441 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac01a750 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e7289900 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3ca960a640 1 -- 172.21.15.145:0/2824255441 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac01aa70 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.977+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e728a300 con 0x55f0e718fff0 2024-09-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.978+0000 7f3ca960a640 1 -- 172.21.15.145:0/2824255441 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3dac015020 con 0x55f0e718fff0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.978+0000 7f3ca960a640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3ca403c730 0x7f3ca403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3ca960a640 1 -- 172.21.15.145:0/2824255441 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3dac020030 con 0x55f0e718fff0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3db4329640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3ca403c730 0x7f3ca403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e71912c0 0x55f0e7290760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e728aee0 con 0x55f0e71912c0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e71912c0 0x55f0e7290760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3db4329640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3ca403c730 0x7f3ca403ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3da4057000 tx=0x7f3da4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e71912c0 0x55f0e7290760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbd32b640 1 -- 172.21.15.145:0/2824255441 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e71912c0 2024-09-10T04:52:13.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72916d0 0x55f0e7293ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.979+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e7294100 con 0x55f0e72916d0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.980+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72916d0 0x55f0e7293ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.980+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72916d0 0x55f0e7293ac0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.980+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/2824255441 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3dac018ce0 con 0x55f0e72916d0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.980+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72959b0 con 0x55f0e71912c0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3dbd32b640 1 -- 172.21.15.145:0/2824255441 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e71912c0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e7294be0 con 0x55f0e72916d0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/2824255441 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3dac018ce0 con 0x55f0e72916d0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f0e7296d60 0x55f0e7299150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e7299690 con 0x55f0e7296d60 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3db4329640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f0e7296d60 0x55f0e7299150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.981+0000 7f3db4329640 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f0e7296d60 0x55f0e7299150 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3db4329640 1 -- 172.21.15.145:0/2824255441 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3da4051070 con 0x55f0e7296d60 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3dbf040800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3dbf040800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0e7086a00 con 0x55f0e72a71e0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.982+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46888/0 (socket says 172.21.15.145:46888) 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/3856941807 learned_addr learned my addr 172.21.15.145:0/3856941807 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/3856941807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e72a7c40 con 0x55f0e72a71e0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3dac018f90 tx=0x7f3dac04b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3ca27fc640 1 -- 172.21.15.145:0/3856941807 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac00da30 con 0x55f0e72a71e0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3ca27fc640 1 -- 172.21.15.145:0/3856941807 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac0167e0 con 0x55f0e72a71e0 2024-09-10T04:52:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3ca27fc640 1 -- 172.21.15.145:0/3856941807 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac016b00 con 0x55f0e72a71e0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e72a8470 con 0x55f0e72a71e0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.983+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e72a8a10 con 0x55f0e72a71e0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.984+0000 7f3ca27fc640 1 -- 172.21.15.145:0/3856941807 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3dac03c060 con 0x55f0e72a71e0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.984+0000 7f3ca27fc640 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 0x7f3c9403ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.984+0000 7f3ca27fc640 1 -- 172.21.15.145:0/3856941807 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3dac036d50 con 0x55f0e72a71e0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.984+0000 7f3db4329640 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 0x7f3c9403ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.984+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3db4329640 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 0x7f3c9403ed90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55f0e728a700 tx=0x7f3da4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbf040800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbf040800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0e7103f50 con 0x55f0e72b3ac0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46890/0 (socket says 172.21.15.145:46890) 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/3743724082 learned_addr learned my addr 172.21.15.145:0/3743724082 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/3743724082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e72b44b0 con 0x55f0e72b3ac0 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/3743724082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3dac04b720 tx=0x7f3dac047710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f945d61bcac409ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3c93fff640 1 -- 172.21.15.145:0/3743724082 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac061020 con 0x55f0e72b3ac0 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3c93fff640 1 -- 172.21.15.145:0/3743724082 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac052ce0 con 0x55f0e72b3ac0 2024-09-10T04:52:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.985+0000 7f3c93fff640 1 -- 172.21.15.145:0/3743724082 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac04d0b0 con 0x55f0e72b3ac0 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- 172.21.15.145:0/3743724082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 msgr2=0x55f0e72b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3743724082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3dac04b720 tx=0x7f3dac047710 comp rx=0 tx=0).stop 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- 172.21.15.145:0/3743724082 shutdown_connections 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3743724082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72b3ec0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- 172.21.15.145:0/3743724082 >> 172.21.15.145:0/3743724082 conn(0x55f0e72afec0 msgr2=0x55f0e72ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- 172.21.15.145:0/3743724082 shutdown_connections 2024-09-10T04:52:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- 172.21.15.145:0/3743724082 wait complete. 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 Processor -- start 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- start start 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.986+0000 7f3dbf040800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0e72b4920 con 0x55f0e72b3ac0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbcb2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46892/0 (socket says 172.21.15.145:46892) 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 learned_addr learned my addr 172.21.15.145:0/1932043240 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e72bb420 con 0x55f0e72b3ac0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00e550 tx=0x7f3dac024f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3c927fc640 1 -- 172.21.15.145:0/1932043240 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac076070 con 0x55f0e72b3ac0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3c927fc640 1 -- 172.21.15.145:0/1932043240 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac016ca0 con 0x55f0e72b3ac0 2024-09-10T04:52:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e72bb420 con 0x55f0e72b3ac0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3c927fc640 1 -- 172.21.15.145:0/1932043240 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac02d610 con 0x55f0e72b3ac0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.987+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e72bb420 con 0x55f0e72b3ac0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.988+0000 7f3c927fc640 1 -- 172.21.15.145:0/1932043240 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3dac079070 con 0x55f0e72b3ac0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.988+0000 7f3c927fc640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c8803c730 0x7f3c8803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.988+0000 7f3c927fc640 1 -- 172.21.15.145:0/1932043240 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3dac06c030 con 0x55f0e72b3ac0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3db4329640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c8803c730 0x7f3c8803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e72c64d0 0x55f0e72c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72c90b0 con 0x55f0e72c64d0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e72c64d0 0x55f0e72c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3db4329640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c8803c730 0x7f3c8803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3da4053fd0 tx=0x7f3da4053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e72c64d0 0x55f0e72c8960 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 20 realm 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.989+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72c5860 con 0x55f0e72c64d0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72c9b40 con 0x55f0e72c64d0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72ca700 0x55f0e72ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72cd330 con 0x55f0e72ca700 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72ca700 0x55f0e72ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.990+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72ca700 0x55f0e72ccbc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72cdbd0 con 0x55f0e72c64d0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:14.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 20 searching for the correct realm 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f0e72cf940 0x55f0e72d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3db4329640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f0e72cf940 0x55f0e72d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.991+0000 7f3db4329640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f0e72cf940 0x55f0e72d1d70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3dbcb2a640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3dac07b060 0x7f3dac0254f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3dac07b060 0x7f3dac0254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.992+0000 7f3dbd32b640 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3dac07b060 0x7f3dac0254f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3db800a4d0 con 0x7f3dac07b060 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.993+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db800a4d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.994+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.995+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.996+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.997+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x7f3dac07b060 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.998+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3db8030040 con 0x7f3dac07b060 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72cf940 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:13.999+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d2440 con 0x55f0e72ca700 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72ce580 con 0x55f0e72c64d0 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3db8030040 con 0x55f0e72c64d0 2024-09-10T04:52:14.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.000+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72cea00 con 0x55f0e72ca700 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72ceea0 con 0x7f3dac07b060 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 zone default found 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 4 Realm: () 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:14.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 zonegroup default 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72ce1b0 con 0x7f3dac07b060 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d4860 con 0x55f0e72cf940 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.001+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d4d50 con 0x55f0e72cf940 2024-09-10T04:52:14.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.002+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.002+0000 7f3dbf040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.002+0000 7f3dbf040800 20 started sync module instance, tier type = 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.002+0000 7f3dbf040800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.002+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d3cd0 con 0x55f0e72ca700 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.003+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.003+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493159014592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d5660 con 0x55f0e72ca700 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.003+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d5eb0 con 0x55f0e72c64d0 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.004+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94493159014592] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.004+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.004+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493159018928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d5b60 con 0x55f0e72c64d0 2024-09-10T04:52:14.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.004+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d6680 con 0x55f0e72ca700 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.005+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94493159018928] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.005+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.005+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493159022928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d6640 con 0x55f0e72ca700 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.005+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d70d0 con 0x7f3dac07b060 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.006+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.006+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493159025632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d7550 con 0x7f3dac07b060 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.006+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d8050 con 0x55f0e72ca700 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.007+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94493159022928] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.007+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94493159025632] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.008+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.008+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493159026688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d8010 con 0x55f0e72ca700 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.008+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d84f0 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.009+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.009+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493159019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d8d90 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.009+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d9850 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.009+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94493159026688] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.010+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94493159019984] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.010+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.010+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493159033056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d7b40 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.010+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72da150 con 0x7f3dac07b060 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94493159033056] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493159035680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72da110 con 0x7f3dac07b060 2024-09-10T04:52:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=0 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=1 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=2 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=3 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=4 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=5 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.011+0000 7f3dbf040800 20 add_watcher() i=6 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.013+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94493159035680] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.013+0000 7f3dbf040800 20 add_watcher() i=7 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.013+0000 7f3dbf040800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.013+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72dd5d0 con 0x55f0e72c64d0 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.014+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.014+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493159038016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72daaf0 con 0x55f0e72c64d0 2024-09-10T04:52:14.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94493159038016] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3dbf040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3dbf040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3dbf040800 5 note: GC not initialized 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3c727e4640 20 reqs_thread_entry: start 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.020+0000 7f3dbf040800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbf040800 20 Filter name: none 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3c6bfff640 20 reqs_thread_entry: start 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbf040800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e7310180 con 0x55f0e72c64d0 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbf040800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0e7311570 con 0x55f0e72cf940 2024-09-10T04:52:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.021+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.022+0000 7f3c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.022+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493159038016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72dc240 con 0x55f0e72c64d0 2024-09-10T04:52:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.024+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94493159038016] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.024+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493159014592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d9c40 con 0x55f0e72ca700 2024-09-10T04:52:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.025+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94493159014592] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.025+0000 7f3dbf040800 20 remove_watcher() i=0 2024-09-10T04:52:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.025+0000 7f3dbf040800 2 removed watcher, disabling cache 2024-09-10T04:52:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.025+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493159018928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x55f0e72c64d0 2024-09-10T04:52:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.026+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94493159018928] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x55f0e72c64d0 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.026+0000 7f3dbf040800 20 remove_watcher() i=1 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.026+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493159022928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x55f0e72ca700 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.027+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94493159022928] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.027+0000 7f3dbf040800 20 remove_watcher() i=2 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.027+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493159025632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x7f3dac07b060 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.028+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94493159025632] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.028+0000 7f3dbf040800 20 remove_watcher() i=3 2024-09-10T04:52:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.028+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493159026688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d6be0 con 0x55f0e72ca700 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.029+0000 7f3dbcb2a640 1 -- 172.21.15.145:0/1932043240 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94493159026688] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac078030 con 0x55f0e72ca700 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.029+0000 7f3dbf040800 20 remove_watcher() i=4 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.029+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493159019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x55f0e72cf940 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.031+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94493159019984] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.031+0000 7f3dbf040800 20 remove_watcher() i=5 2024-09-10T04:52:14.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.031+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493159033056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x55f0e72cf940 2024-09-10T04:52:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.032+0000 7f3db4329640 1 -- 172.21.15.145:0/1932043240 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94493159033056] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da407c040 con 0x55f0e72cf940 2024-09-10T04:52:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.032+0000 7f3dbf040800 20 remove_watcher() i=6 2024-09-10T04:52:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.032+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493159035680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0e72d40c0 con 0x7f3dac07b060 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94493159035680] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3db8041040 con 0x7f3dac07b060 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 20 remove_watcher() i=7 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72ca700 msgr2=0x55f0e72ccbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72ca700 0x55f0e72ccbc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e72c64d0 msgr2=0x55f0e72c8960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e72c64d0 0x55f0e72c8960 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3dac07b060 msgr2=0x7f3dac0254f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f3dac07b060 0x7f3dac0254f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f0e72cf940 msgr2=0x55f0e72d1d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f0e72cf940 0x55f0e72d1d70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c8803c730 msgr2=0x7f3c8803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c8803c730 0x7f3c8803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3da4053fd0 tx=0x7f3da4053000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 msgr2=0x55f0e72baec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbd32b640 1 -- 172.21.15.145:0/1932043240 reap_dead start 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00e550 tx=0x7f3dac024f70 comp rx=0 tx=0).stop 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 shutdown_connections 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/1932043240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72b3ac0 0x55f0e72baec0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 >> 172.21.15.145:0/1932043240 conn(0x55f0e72afec0 msgr2=0x55f0e72ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 shutdown_connections 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/1932043240 wait complete. 2024-09-10T04:52:14.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 msgr2=0x7f3c9403ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 0x7f3c9403ed90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55f0e728a700 tx=0x7f3da4005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 msgr2=0x55f0e72a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3dac018f90 tx=0x7f3dac04b2c0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 shutdown_connections 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3c9403c8d0 0x7f3c9403ed90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.033+0000 7f3dbf040800 1 --2- 172.21.15.145:0/3856941807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e72a71e0 0x55f0e72a7600 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 >> 172.21.15.145:0/3856941807 conn(0x55f0e729b590 msgr2=0x55f0e729b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 shutdown_connections 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/3856941807 wait complete. 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72916d0 msgr2=0x55f0e7293ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f0e72916d0 0x55f0e7293ac0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e71912c0 msgr2=0x55f0e7290760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f0e71912c0 0x55f0e7290760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f0e7296d60 msgr2=0x55f0e7299150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f0e7296d60 0x55f0e7299150 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3ca403c730 msgr2=0x7f3ca403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3ca403c730 0x7f3ca403ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3da4057000 tx=0x7f3da4052000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 msgr2=0x55f0e7289110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 --2- 172.21.15.145:0/2824255441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0e718fff0 0x55f0e7289110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0012b0 tx=0x7f3dac000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbd32b640 1 -- 172.21.15.145:0/2824255441 reap_dead start 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 shutdown_connections 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 >> 172.21.15.145:0/2824255441 conn(0x55f0e718b3c0 msgr2=0x55f0e727aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 shutdown_connections 2024-09-10T04:52:14.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.034+0000 7f3dbf040800 1 -- 172.21.15.145:0/2824255441 wait complete. 2024-09-10T04:52:14.044 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[],"summary":[]} 2024-09-10T04:52:14.044 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T04:52:14.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T04:52:14.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T04:52:14.045 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-10T04:52:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb509632800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562d1399c2d0 0x562d139a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb509632800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d13844e40 con 0x562d1399b000 2024-09-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb509632800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x562d1380f680 con 0x562d1399c2d0 2024-09-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb4fffff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562d1399c2d0 0x562d139a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb4fffff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x562d1399c2d0 0x562d139a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46898/0 (socket says 172.21.15.145:46898) 2024-09-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb4fffff640 1 -- 172.21.15.145:0/1334026674 learned_addr learned my addr 172.21.15.145:0/1334026674 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb4fffff640 1 -- 172.21.15.145:0/1334026674 >> v1:172.21.15.98:6789/0 conn(0x562d1399b000 legacy=0x562d1399bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.090+0000 7fb4fffff640 1 -- 172.21.15.145:0/1334026674 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1382b6b0 con 0x562d1399c2d0 2024-09-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.092+0000 7fb4fffff640 1 --2- 172.21.15.145:0/1334026674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399c2d0 0x562d139a1e70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000a520 tx=0x7fb4f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1ca5361d039f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.092+0000 7fb4ff7fe640 1 -- 172.21.15.145:0/1334026674 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f0055070 con 0x562d1399c2d0 2024-09-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.092+0000 7fb4ff7fe640 1 -- 172.21.15.145:0/1334026674 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f00515b0 con 0x562d1399c2d0 2024-09-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.092+0000 7fb4ff7fe640 1 -- 172.21.15.145:0/1334026674 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f00518d0 con 0x562d1399c2d0 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 -- 172.21.15.145:0/1334026674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399c2d0 msgr2=0x562d139a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 --2- 172.21.15.145:0/1334026674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399c2d0 0x562d139a1e70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000a520 tx=0x7fb4f0045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 -- 172.21.15.145:0/1334026674 shutdown_connections 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 --2- 172.21.15.145:0/1334026674 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399c2d0 0x562d139a1e70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 -- 172.21.15.145:0/1334026674 >> 172.21.15.145:0/1334026674 conn(0x562d139963d0 msgr2=0x562d13998830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 -- 172.21.15.145:0/1334026674 shutdown_connections 2024-09-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.093+0000 7fb509632800 1 -- 172.21.15.145:0/1334026674 wait complete. 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb509632800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb509632800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562d13833dd0 con 0x562d1399b000 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46910/0 (socket says 172.21.15.145:46910) 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.107+0000 7fb504953640 1 -- 172.21.15.145:0/3345183793 learned_addr learned my addr 172.21.15.145:0/3345183793 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.108+0000 7fb504953640 1 -- 172.21.15.145:0/3345183793 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1384ce10 con 0x562d1399b000 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.108+0000 7fb504953640 1 --2- 172.21.15.145:0/3345183793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8001d40 tx=0x7fb4f800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17daad11cc01d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.108+0000 7fb3f2e05640 1 -- 172.21.15.145:0/3345183793 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f800f400 con 0x562d1399b000 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.108+0000 7fb3f2e05640 1 -- 172.21.15.145:0/3345183793 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f800f5a0 con 0x562d1399b000 2024-09-10T04:52:14.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.108+0000 7fb3f2e05640 1 -- 172.21.15.145:0/3345183793 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f800f900 con 0x562d1399b000 2024-09-10T04:52:14.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- 172.21.15.145:0/3345183793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 msgr2=0x562d13a8a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 --2- 172.21.15.145:0/3345183793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8001d40 tx=0x7fb4f800b5b0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- 172.21.15.145:0/3345183793 shutdown_connections 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 --2- 172.21.15.145:0/3345183793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13a8a5f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- 172.21.15.145:0/3345183793 >> 172.21.15.145:0/3345183793 conn(0x562d139963d0 msgr2=0x562d13a85f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- 172.21.15.145:0/3345183793 shutdown_connections 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- 172.21.15.145:0/3345183793 wait complete. 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13910670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb509632800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562d1399c9c0 con 0x562d1399b000 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13910670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13910670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46914/0 (socket says 172.21.15.145:46914) 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.109+0000 7fb504953640 1 -- 172.21.15.145:0/906519596 learned_addr learned my addr 172.21.15.145:0/906519596 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb504953640 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13910bd0 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb504953640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13910670 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x562d13a8b580 tx=0x7fb4f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb3f1602640 1 -- 172.21.15.145:0/906519596 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f801a7c0 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb3f1602640 1 -- 172.21.15.145:0/906519596 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f801a980 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d1390ef80 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb3f1602640 1 -- 172.21.15.145:0/906519596 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f801aca0 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.110+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1390f5a0 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb3f1602640 1 -- 172.21.15.145:0/906519596 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4f8017070 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb3f1602640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3ec03c730 0x7fb3ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb3f1602640 1 -- 172.21.15.145:0/906519596 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb4f8015020 con 0x562d1399b000 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb4fffff640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3ec03c730 0x7fb3ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d1399c2d0 0x562d13a9b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13a9b9b0 con 0x562d1399c2d0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.111+0000 7fb505154640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d1399c2d0 0x562d13a9b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb4fffff640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3ec03c730 0x7fb3ec03ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0057000 tx=0x7fb4f0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb505154640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d1399c2d0 0x562d13a9b470 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb505154640 1 -- 172.21.15.145:0/906519596 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d1399c2d0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13a9c7a0 0x562d13a9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13a9f1d0 con 0x562d13a9c7a0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.112+0000 7fb504953640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13a9c7a0 0x562d13a9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.113+0000 7fb504953640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13a9c7a0 0x562d13a9eb90 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.113+0000 7fb504953640 1 -- 172.21.15.145:0/906519596 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4f802e070 con 0x562d13a9c7a0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.113+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13aa0a80 con 0x562d1399c2d0 2024-09-10T04:52:14.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.113+0000 7fb505154640 1 -- 172.21.15.145:0/906519596 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d1399c2d0 2024-09-10T04:52:14.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.113+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13a9fcb0 con 0x562d13a9c7a0 2024-09-10T04:52:14.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb504953640 1 -- 172.21.15.145:0/906519596 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4f802e070 con 0x562d13a9c7a0 2024-09-10T04:52:14.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562d13aa1e30 0x562d13aa4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13aa4760 con 0x562d13aa1e30 2024-09-10T04:52:14.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb4fffff640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562d13aa1e30 0x562d13aa4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb4fffff640 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562d13aa1e30 0x562d13aa4220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.114+0000 7fb4fffff640 1 -- 172.21.15.145:0/906519596 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13aa1e30 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb509632800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb509632800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562d13891a00 con 0x562d13ab2310 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46930/0 (socket says 172.21.15.145:46930) 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb504953640 1 -- 172.21.15.145:0/4081251257 learned_addr learned my addr 172.21.15.145:0/4081251257 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb504953640 1 -- 172.21.15.145:0/4081251257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13ab2d70 con 0x562d13ab2310 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb504953640 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8007fd0 tx=0x7fb4f801be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.115+0000 7fb3ea7fc640 1 -- 172.21.15.145:0/4081251257 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f8017c80 con 0x562d13ab2310 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb3ea7fc640 1 -- 172.21.15.145:0/4081251257 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f8017e20 con 0x562d13ab2310 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb3ea7fc640 1 -- 172.21.15.145:0/4081251257 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f801c580 con 0x562d13ab2310 2024-09-10T04:52:14.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d13ab35a0 con 0x562d13ab2310 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d13ab35a0 con 0x562d13ab2310 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb3ea7fc640 1 -- 172.21.15.145:0/4081251257 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4f800e070 con 0x562d13ab2310 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.116+0000 7fb3ea7fc640 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 0x7fb3dc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb3ea7fc640 1 -- 172.21.15.145:0/4081251257 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb4f803cd50 con 0x562d13ab2310 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb4fffff640 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 0x7fb3dc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb4fffff640 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 0x7fb3dc03ec40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562d1390fa20 tx=0x7fb4f0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb509632800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb509632800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562d13a8ae40 con 0x562d13abe9e0 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46938/0 (socket says 172.21.15.145:46938) 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.117+0000 7fb504953640 1 -- 172.21.15.145:0/3635068803 learned_addr learned my addr 172.21.15.145:0/3635068803 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb504953640 1 -- 172.21.15.145:0/3635068803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13abf3b0 con 0x562d13abe9e0 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb504953640 1 --2- 172.21.15.145:0/3635068803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb4f801aee0 tx=0x7fb4f8027be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d192edd6c449cae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb3dbfff640 1 -- 172.21.15.145:0/3635068803 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f8060020 con 0x562d13abe9e0 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb3dbfff640 1 -- 172.21.15.145:0/3635068803 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f8027e10 con 0x562d13abe9e0 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb3dbfff640 1 -- 172.21.15.145:0/3635068803 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f8055040 con 0x562d13abe9e0 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 -- 172.21.15.145:0/3635068803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 msgr2=0x562d13abedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 --2- 172.21.15.145:0/3635068803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb4f801aee0 tx=0x7fb4f8027be0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 -- 172.21.15.145:0/3635068803 shutdown_connections 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 --2- 172.21.15.145:0/3635068803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13abedc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 -- 172.21.15.145:0/3635068803 >> 172.21.15.145:0/3635068803 conn(0x562d13abade0 msgr2=0x562d13ab9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 -- 172.21.15.145:0/3635068803 shutdown_connections 2024-09-10T04:52:14.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.118+0000 7fb509632800 1 -- 172.21.15.145:0/3635068803 wait complete. 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb509632800 1 Processor -- start 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb509632800 1 -- start start 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb509632800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13ac5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb509632800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562d13abf840 con 0x562d13abe9e0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13ac5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb504953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13ac5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46952/0 (socket says 172.21.15.145:46952) 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 learned_addr learned my addr 172.21.15.145:0/52967478 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d13ac6340 con 0x562d13abe9e0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.119+0000 7fb504953640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13ac5de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb4f804fed0 tx=0x7fb4f8036f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.120+0000 7fb3da7fc640 1 -- 172.21.15.145:0/52967478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f8055040 con 0x562d13abe9e0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.120+0000 7fb3da7fc640 1 -- 172.21.15.145:0/52967478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f804b660 con 0x562d13abe9e0 2024-09-10T04:52:14.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.120+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d13ac6340 con 0x562d13abe9e0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.120+0000 7fb3da7fc640 1 -- 172.21.15.145:0/52967478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f8031900 con 0x562d13abe9e0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.120+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d13ac6340 con 0x562d13abe9e0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb3da7fc640 1 -- 172.21.15.145:0/52967478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4f8063020 con 0x562d13abe9e0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb3da7fc640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3d003c780 0x7fb3d003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb3da7fc640 1 -- 172.21.15.145:0/52967478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb4f8072da0 con 0x562d13abe9e0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb4fffff640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3d003c780 0x7fb3d003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb4fffff640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3d003c780 0x7fb3d003ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0051fd0 tx=0x7fb4f006d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d13ad13b0 0x562d13ad3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.121+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad3fc0 con 0x562d13ad13b0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb505154640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d13ad13b0 0x562d13ad3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb505154640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d13ad13b0 0x562d13ad3870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 20 realm 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad06e0 con 0x562d13ad13b0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.122+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad4a50 con 0x562d13ad13b0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13ad5830 0x562d13ad7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad8280 con 0x562d13ad5830 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb504953640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13ad5830 0x562d13ad7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb504953640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13ad5830 0x562d13ad7c20 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.123+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad8ad0 con 0x562d13ad13b0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb509632800 20 searching for the correct realm 2024-09-10T04:52:14.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562d13ada840 0x562d13adcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb4fffff640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562d13ada840 0x562d13adcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb4fffff640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562d13ada840 0x562d13adcc70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.124+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb504953640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb4f8065030 0x7fb4f805c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb505154640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb4f8065030 0x7fb4f805c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb505154640 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb4f8065030 0x7fb4f805c5c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb50000a4d0 con 0x7fb4f8065030 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.125+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.126+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000a4d0 con 0x562d13ad13b0 2024-09-10T04:52:14.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.127+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.128+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.129+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad13b0 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.130+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x7fb4f8065030 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb500030040 con 0x7fb4f8065030 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.131+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ada840 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.132+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d13add340 con 0x562d13ad5830 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:14.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad9450 con 0x562d13ad13b0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb500030040 con 0x562d13ad13b0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad9cf0 con 0x562d13ad5830 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ad9090 con 0x7fb4f8065030 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:14.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 zone default found 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 4 Realm: () 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.133+0000 7fb509632800 20 zonegroup default 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13add800 con 0x7fb4f8065030 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13adf660 con 0x562d13ada840 2024-09-10T04:52:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13adfb20 con 0x562d13ada840 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 started sync module instance, tier type = 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.134+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13adead0 con 0x562d13ad5830 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.136+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.136+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751603683056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae0430 con 0x562d13ad5830 2024-09-10T04:52:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.136+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae0c80 con 0x562d13ad13b0 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.137+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751603683056] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.137+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.137+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751603687296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae0ce0 con 0x562d13ad13b0 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.137+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae17f0 con 0x562d13ad5830 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.138+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751603687296] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.138+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.138+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751603692192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae17b0 con 0x562d13ad5830 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.138+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae2280 con 0x7fb4f8065030 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.139+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751603692192] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.139+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.139+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751603695024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae2280 con 0x7fb4f8065030 2024-09-10T04:52:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.139+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae2cd0 con 0x562d13ad5830 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.140+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751603695024] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.141+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.141+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751603689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae2c90 con 0x562d13ad5830 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.141+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae36e0 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.142+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.142+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751603689424] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.142+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751603700272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae3f80 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.142+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae2800 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.143+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751603700272] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.143+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.143+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751603705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae4dc0 con 0x562d13ada840 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.143+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae5650 con 0x7fb4f8065030 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751603705072] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751603706128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae5a40 con 0x7fb4f8065030 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=0 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=1 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=2 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=3 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=4 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=5 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.144+0000 7fb509632800 20 add_watcher() i=6 2024-09-10T04:52:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751603706128] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb509632800 20 add_watcher() i=7 2024-09-10T04:52:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb509632800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae8e70 con 0x562d13ad13b0 2024-09-10T04:52:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.146+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751603708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae6390 con 0x562d13ad13b0 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.147+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751603708256] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.147+0000 7fb3bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.148+0000 7fb509632800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.148+0000 7fb509632800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.148+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af16c0 con 0x562d13ad5830 2024-09-10T04:52:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.149+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.149+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af1770 con 0x7fb4f8065030 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.150+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.150+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af1f40 con 0x562d13ada840 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.151+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.151+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af23f0 con 0x562d13ad13b0 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.152+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'239 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.152+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13aef5c0 con 0x562d13ad5830 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.153+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.153+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13aef530 con 0x562d13ada840 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.154+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'62 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.154+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13aef530 con 0x562d13ad5830 2024-09-10T04:52:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.155+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.155+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13aef530 con 0x562d13ad13b0 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.156+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.156+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3170 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.157+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.157+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3170 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.158+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.158+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3170 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.159+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.159+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3170 con 0x562d13ada840 2024-09-10T04:52:14.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.160+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.160+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af36e0 con 0x562d13ad5830 2024-09-10T04:52:14.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.161+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.161+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af36e0 con 0x562d13ad13b0 2024-09-10T04:52:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.162+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.162+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b90 con 0x562d13ad13b0 2024-09-10T04:52:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.164+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'240 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.164+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b90 con 0x562d13ad5830 2024-09-10T04:52:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.165+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.165+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b90 con 0x562d13ad5830 2024-09-10T04:52:14.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.166+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.166+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b90 con 0x562d13ada840 2024-09-10T04:52:14.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.167+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.167+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af39c0 con 0x562d13ad5830 2024-09-10T04:52:14.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.168+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.168+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af39c0 con 0x562d13ad13b0 2024-09-10T04:52:14.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.169+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'241 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.169+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af39c0 con 0x562d13ad5830 2024-09-10T04:52:14.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.170+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.170+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af39c0 con 0x562d13ad5830 2024-09-10T04:52:14.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.171+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.171+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af39c0 con 0x562d13ada840 2024-09-10T04:52:14.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.172+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.172+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3af0 con 0x562d13ad5830 2024-09-10T04:52:14.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.173+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.173+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3af0 con 0x562d13ada840 2024-09-10T04:52:14.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.174+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.174+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3bb0 con 0x562d13ada840 2024-09-10T04:52:14.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.175+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'63 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.175+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3bb0 con 0x562d13ada840 2024-09-10T04:52:14.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.176+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.176+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b80 con 0x562d13ad5830 2024-09-10T04:52:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.178+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.178+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b80 con 0x562d13ad13b0 2024-09-10T04:52:14.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.179+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.179+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b80 con 0x562d13ad5830 2024-09-10T04:52:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.180+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.180+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b80 con 0x562d13ad13b0 2024-09-10T04:52:14.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.181+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.181+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13af3b80 con 0x7fb4f8065030 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.182+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.182+0000 7fb3b9fe3640 20 reqs_thread_entry: start 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 20 Filter name: none 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb32b7fe640 20 reqs_thread_entry: start 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b1ea60 con 0x562d13ad13b0 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b20e80 con 0x7fb4f8065030 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.183+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 : miss 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 8.1a 8:5b7a1782:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b20a60 con 0x562d13ada840 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(96 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 info.flags=0x17 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 to cache LRU end 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T04:52:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 2024-09-10T04:52:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 4.24 4:252ba2d7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9e6f0 con 0x562d13ad13b0 2024-09-10T04:52:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(97 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.184+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 4.3d 4:bef85ab2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9e6f0 con 0x562d13ad5830 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.185+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(98 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.185+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:99 4.3b 4:deea8164:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9e6f0 con 0x7fb4f8065030 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.185+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(99 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.185+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:100 4.1b 4:d9bbeb69:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9e6f0 con 0x7fb4f8065030 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(100 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:101 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9e6f0 con 0x562d13ada840 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(101 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb509632800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T04:52:14.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:102 4.28 4:14ddebf4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ead0 con 0x562d13ad5830 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(102 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.186+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:103 4.1c 4:3b6cb1e1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ead0 con 0x7fb4f8065030 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(103 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 4.30 4:0f14e997:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ead0 con 0x562d13ad5830 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(104 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8077020 con 0x562d13ad5830 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:105 4.3f 4:fee159fe:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9eab0 con 0x7fb4f8065030 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(105 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.187+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:106 4.26 4:643c023d:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9eab0 con 0x562d13ad13b0 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(106 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:107 4.22 4:4744992a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9eab0 con 0x562d13ad13b0 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(107 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb509632800 20 get_obj_state: octx=0x7fb50000aac0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562d13b9cae8 s->prefetch_data=0 2024-09-10T04:52:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:108 3.22s0 3:4702ea4f:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9d9d0 con 0x562d13ada840 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.188+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(108 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 10 manifest: total_size = 6 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 20 get_obj_state: setting s->obj_tag to df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.17968344732040560417 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 20 get_obj_state: octx=0x7fb50000aac0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562d13b9cae8 s->prefetch_data=0 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 20 prepare_atomic_modification: state is not atomic. state=0x562d13b9cae8 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 20 bucket index object: :.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.189+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25af0 con 0x562d13ada840 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.190+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(109 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [stat,call,call] v34'18 uv18 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.190+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 3.22s0 3:4702ea4f:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b23ad0 con 0x562d13ada840 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(110 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:111 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b24f00 con 0x562d13ada840 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb509632800 20 list_objects_ordered: starting attempt 1 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb509632800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:112 4.24 4:252ba2d7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b24f00 con 0x562d13ad13b0 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.191+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:113 4.3d 4:bef85ab2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b24f00 con 0x562d13ad5830 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:114 4.3b 4:deea8164:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b2ca90 con 0x7fb4f8065030 2024-09-10T04:52:14.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:115 4.1b 4:d9bbeb69:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b2ca90 con 0x7fb4f8065030 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:116 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b2ca90 con 0x562d13ada840 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:117 4.28 4:14ddebf4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b342d0 con 0x562d13ad5830 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:118 4.1c 4:3b6cb1e1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b37090 con 0x7fb4f8065030 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:119 4.30 4:0f14e997:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b39ea0 con 0x562d13ad5830 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:120 4.3f 4:fee159fe:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3c890 con 0x7fb4f8065030 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:121 4.26 4:643c023d:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:122 4.22 4:4744992a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.192+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(112 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(113 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(117 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(119 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(114 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(115 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(118 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(120 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(121 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(122 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(111 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb3db7fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(116 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [call out=128b] v0'0 uv19 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7])"; uploads.size()=0; is_truncated=0 2024-09-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:123 4.24 4:252ba2d7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 4.3d 4:bef85ab2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b342d0 con 0x562d13ad5830 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:125 4.3b 4:deea8164:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b33c80 con 0x7fb4f8065030 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:126 4.1b 4:d9bbeb69:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b36ef0 con 0x7fb4f8065030 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:127 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ada840 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:128 4.28 4:14ddebf4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b342d0 con 0x562d13ad5830 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:129 4.1c 4:3b6cb1e1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b33c80 con 0x7fb4f8065030 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.193+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:130 4.30 4:0f14e997:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b36ef0 con 0x562d13ad5830 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:131 4.3f 4:fee159fe:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b33c80 con 0x7fb4f8065030 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(127 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [call out=128b] v0'0 uv19 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:132 4.26 4:643c023d:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(128 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:133 4.22 4:4744992a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b342d0 con 0x562d13ad13b0 2024-09-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(124 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== osd_op_reply(125 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(126 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(129 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(123 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(130 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(132 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(133 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== osd_op_reply(131 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.194+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x7fb4f8065030 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.195+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x7fb4f8065030 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.196+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 31 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.196+0000 7fb509632800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.196+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.196+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94751604465360 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ada840 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== watch-notify(notify (1) cookie 94751603705072 notify 146028888090 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562d13b1fff0 con 0x562d13ada840 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb3db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94751603705072 notifier 4783 bl.length()=149 2024-09-10T04:52:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb3db7fe640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3380032c0 con 0x562d13ada840 2024-09-10T04:52:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(137 notify.6 [notify cookie 94751604465360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== watch-notify(notify_complete (2) cookie 94751604465360 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d13af0df0 con 0x562d13ada840 2024-09-10T04:52:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.197+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:139 8.1a 8:5b7a1782:root::.bucket.meta.myfoo%3adf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ada840 2024-09-10T04:52:14.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(139 .bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 [call,call,delete] v34'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb509632800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 from cache 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7, ofs0, ns] 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94751604465360 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== watch-notify(notify (1) cookie 94751603687296 notify 146028888079 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562d13aef080 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb3dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94751603687296 notifier 4783 bl.length()=206 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb3dbfff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3c8003d60 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.198+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(140 notify.1 [notify cookie 94751604465360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== watch-notify(notify_complete (2) cookie 94751604465360 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d13af2f50 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:142 4.24 4:252ba2d7:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x562d13ad13b0 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:143 4.3d 4:bef85ab2:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b365c0 con 0x562d13ad5830 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:144 4.3b 4:deea8164:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b31980 con 0x7fb4f8065030 2024-09-10T04:52:14.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:145 4.1b 4:d9bbeb69:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b32210 con 0x7fb4f8065030 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:146 4.16 4:683544f9:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b325f0 con 0x562d13ada840 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:147 4.28 4:14ddebf4:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b365c0 con 0x562d13ad5830 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:148 4.1c 4:3b6cb1e1:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b3f690 con 0x7fb4f8065030 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 4.30 4:0f14e997:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b31980 con 0x562d13ad5830 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:150 4.3f 4:fee159fe:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b365c0 con 0x7fb4f8065030 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:151 4.26 4:643c023d:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b32210 con 0x562d13ad13b0 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.199+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:152 4.22 4:4744992a:::.dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b325f0 con 0x562d13ad13b0 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.200+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 32 ==== osd_op_reply(144 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.2 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.200+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(149 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.202+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(152 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.10 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(146 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.4 [delete] v34'20 uv20 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 33 ==== osd_op_reply(145 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.3 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(147 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(143 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.1 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 34 ==== osd_op_reply(148 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 35 ==== osd_op_reply(150 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(142 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.0 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(151 .dir.df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 : miss 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:153 6.15 6:ac33b494:::pubsub..bucket.myfoo%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x562d13ad5830 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(153 pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 info.flags=0x0 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 10 adding default.rgw.log++pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 to cache LRU end 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.203+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:154 6.15 6:ac33b494:::pubsub..bucket.myfoo%2fdf93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x562d13ad5830 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.205+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(154 pubsub..bucket.myfoo/df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.7 [delete] v34'37 uv28 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.205+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ded0 con 0x7fb4f8065030 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.206+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 36 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.206+0000 7fb509632800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.206+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ded0 con 0x562d13ad13b0 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94751604078000 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x7fb4f8065030 2024-09-10T04:52:14.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 37 ==== watch-notify(notify (1) cookie 94751603695024 notify 146028888081 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562d13af2f50 con 0x7fb4f8065030 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb3dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94751603695024 notifier 4783 bl.length()=170 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb3dbfff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3c8003d60 con 0x7fb4f8065030 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 38 ==== osd_op_reply(157 notify.3 [notify cookie 94751604078000 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 39 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.207+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 40 ==== watch-notify(notify_complete (2) cookie 94751604078000 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d13aeeeb0 con 0x7fb4f8065030 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.208+0000 7fb509632800 10 removing email index: foo@foo.com 2024-09-10T04:52:14.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.208+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ded0 con 0x562d13ad13b0 2024-09-10T04:52:14.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94751604078000 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 41 ==== watch-notify(notify (1) cookie 94751603695024 notify 146028888082 ret 0) ==== 204+0+0 (crc 0 0 0) 0x562d13aeeeb0 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb3db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94751603695024 notifier 4783 bl.length()=162 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 42 ==== osd_op_reply(160 notify.3 [notify cookie 94751604078000 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb3db7fe640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3380032c0 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 43 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 44 ==== watch-notify(notify_complete (2) cookie 94751604078000 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d13af1270 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb509632800 10 removing user buckets index 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.209+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b9ded0 con 0x7fb4f8065030 2024-09-10T04:52:14.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 45 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94751604078000 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== watch-notify(notify (1) cookie 94751603700272 notify 146028888091 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562d13af0df0 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb3dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94751603700272 notifier 4783 bl.length()=160 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb3dbfff640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3c8003d60 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.210+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(163 notify.5 [notify cookie 94751604078000 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.211+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.211+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== watch-notify(notify_complete (2) cookie 94751604078000 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d13aef8d0 con 0x562d13ada840 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.211+0000 7fb509632800 10 removing user index: foo 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.211+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13b24eb0 con 0x562d13ad13b0 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.212+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.212+0000 7fb509632800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.212+0000 7fb509632800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.212+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94751604078000 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d13b25860 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== watch-notify(notify (1) cookie 94751603689424 notify 146028888106 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562d13af3120 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb3db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94751603689424 notifier 4783 bl.length()=152 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(166 notify.4 [notify cookie 94751604078000 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb3db7fe640 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3380032c0 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.213+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== watch-notify(notify_complete (2) cookie 94751604078000 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d1390f5a0 con 0x562d13ad5830 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.214+0000 7fb3bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.214+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751603708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13aee180 con 0x562d13ad13b0 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.215+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94751603708256] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.215+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751603683056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae5160 con 0x562d13ad5830 2024-09-10T04:52:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.216+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94751603683056] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.216+0000 7fb509632800 20 remove_watcher() i=0 2024-09-10T04:52:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.216+0000 7fb509632800 2 removed watcher, disabling cache 2024-09-10T04:52:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.216+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751603687296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13adeef0 con 0x562d13ad13b0 2024-09-10T04:52:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.217+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94751603687296] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x562d13ad13b0 2024-09-10T04:52:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.217+0000 7fb509632800 20 remove_watcher() i=1 2024-09-10T04:52:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.217+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751603692192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13adff80 con 0x562d13ad5830 2024-09-10T04:52:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.218+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94751603692192] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.219+0000 7fb509632800 20 remove_watcher() i=2 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.219+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751603695024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae12a0 con 0x7fb4f8065030 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.219+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 46 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94751603695024] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.219+0000 7fb509632800 20 remove_watcher() i=3 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.219+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751603689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae12a0 con 0x562d13ad5830 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.221+0000 7fb504953640 1 -- 172.21.15.145:0/52967478 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94751603689424] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f8097040 con 0x562d13ad5830 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.221+0000 7fb509632800 20 remove_watcher() i=4 2024-09-10T04:52:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.221+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751603700272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae07d0 con 0x562d13ada840 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.222+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94751603700272] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.222+0000 7fb509632800 20 remove_watcher() i=5 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.222+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751603705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae12a0 con 0x562d13ada840 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.223+0000 7fb4fffff640 1 -- 172.21.15.145:0/52967478 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94751603705072] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4f0057030 con 0x562d13ada840 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.223+0000 7fb509632800 20 remove_watcher() i=6 2024-09-10T04:52:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.223+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751603706128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d13ae44f0 con 0x7fb4f8065030 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 <== osd.2 v2:172.21.15.145:6816/1789112018 47 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94751603706128] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb500041040 con 0x7fb4f8065030 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 20 remove_watcher() i=7 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13ad5830 msgr2=0x562d13ad7c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13ad5830 0x562d13ad7c20 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d13ad13b0 msgr2=0x562d13ad3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d13ad13b0 0x562d13ad3870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb4f8065030 msgr2=0x7fb4f805c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fb4f8065030 0x7fb4f805c5c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562d13ada840 msgr2=0x562d13adcc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x562d13ada840 0x562d13adcc70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3d003c780 msgr2=0x7fb3d003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3d003c780 0x7fb3d003ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0051fd0 tx=0x7fb4f006d040 comp rx=0 tx=0).stop 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 msgr2=0x562d13ac5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 --2- 172.21.15.145:0/52967478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13abe9e0 0x562d13ac5de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb4f804fed0 tx=0x7fb4f8036f60 comp rx=0 tx=0).stop 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 reap_dead start 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb505154640 1 -- 172.21.15.145:0/52967478 reap_dead start 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 shutdown_connections 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 >> 172.21.15.145:0/52967478 conn(0x562d13abade0 msgr2=0x562d13ab8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 shutdown_connections 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.224+0000 7fb509632800 1 -- 172.21.15.145:0/52967478 wait complete. 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 msgr2=0x7fb3dc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 0x7fb3dc03ec40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562d1390fa20 tx=0x7fb4f0005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 msgr2=0x562d13ab2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8007fd0 tx=0x7fb4f801be50 comp rx=0 tx=0).stop 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 shutdown_connections 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3dc03c780 0x7fb3dc03ec40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/4081251257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d13ab2310 0x562d13ab2730 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 >> 172.21.15.145:0/4081251257 conn(0x562d13aa66c0 msgr2=0x562d13aa6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 shutdown_connections 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/4081251257 wait complete. 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13a9c7a0 msgr2=0x562d13a9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x562d13a9c7a0 0x562d13a9eb90 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d1399c2d0 msgr2=0x562d13a9b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x562d1399c2d0 0x562d13a9b470 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562d13aa1e30 msgr2=0x562d13aa4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x562d13aa1e30 0x562d13aa4220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3ec03c730 msgr2=0x7fb3ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb3ec03c730 0x7fb3ec03ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0057000 tx=0x7fb4f0052000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 msgr2=0x562d13910670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 --2- 172.21.15.145:0/906519596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d1399b000 0x562d13910670 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x562d13a8b580 tx=0x7fb4f8000bc0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb505154640 1 -- 172.21.15.145:0/906519596 reap_dead start 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 shutdown_connections 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 >> 172.21.15.145:0/906519596 conn(0x562d139963d0 msgr2=0x562d13a8b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 shutdown_connections 2024-09-10T04:52:14.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.225+0000 7fb509632800 1 -- 172.21.15.145:0/906519596 wait complete. 2024-09-10T04:52:14.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T04:52:14.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T04:52:14.235 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T04:52:14.280 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.280 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.279+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.279+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.279+0000 7f6475720800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55db0ddc95f0 0x55db0ddcb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.279+0000 7f6475720800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db0dc72e40 con 0x55db0ddcc010 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.279+0000 7f6475720800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55db0dc3d680 con 0x55db0ddc95f0 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f6471302640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55db0ddc95f0 0x55db0ddcb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f6471302640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55db0ddc95f0 0x55db0ddcb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46960/0 (socket says 172.21.15.145:46960) 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f6471302640 1 -- 172.21.15.145:0/643321242 learned_addr learned my addr 172.21.15.145:0/643321242 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f646bfff640 1 --1- 172.21.15.145:0/643321242 >> v1:172.21.15.98:6789/0 conn(0x55db0ddcc010 0x55db0ddce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36846/0 (socket says 172.21.15.145:36846) 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f6471302640 1 -- 172.21.15.145:0/643321242 >> v1:172.21.15.98:6789/0 conn(0x55db0ddcc010 legacy=0x55db0ddce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.280+0000 7f6471302640 1 -- 172.21.15.145:0/643321242 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0dc596b0 con 0x55db0ddc95f0 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6471302640 1 --2- 172.21.15.145:0/643321242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0ddcb9e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f646400a520 tx=0x7f6464045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a1e69bf7cfde9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6470b01640 1 -- 172.21.15.145:0/643321242 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464055070 con 0x55db0ddc95f0 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6470b01640 1 -- 172.21.15.145:0/643321242 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64640515b0 con 0x55db0ddc95f0 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6470b01640 1 -- 172.21.15.145:0/643321242 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64640518d0 con 0x55db0ddc95f0 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 -- 172.21.15.145:0/643321242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 msgr2=0x55db0ddcb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 --2- 172.21.15.145:0/643321242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0ddcb9e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f646400a520 tx=0x7f6464045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 -- 172.21.15.145:0/643321242 shutdown_connections 2024-09-10T04:52:14.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 --2- 172.21.15.145:0/643321242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0ddcb9e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 -- 172.21.15.145:0/643321242 >> 172.21.15.145:0/643321242 conn(0x55db0ddc31b0 msgr2=0x55db0ddc5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 -- 172.21.15.145:0/643321242 shutdown_connections 2024-09-10T04:52:14.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.282+0000 7f6475720800 1 -- 172.21.15.145:0/643321242 wait complete. 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6475720800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6475720800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db0dc61dd0 con 0x55db0ddc95f0 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46964/0 (socket says 172.21.15.145:46964) 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.296+0000 7f6471302640 1 -- 172.21.15.145:0/3774942186 learned_addr learned my addr 172.21.15.145:0/3774942186 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.297+0000 7f6471302640 1 -- 172.21.15.145:0/3774942186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0dc7ae10 con 0x55db0ddc95f0 2024-09-10T04:52:14.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.297+0000 7f6471302640 1 --2- 172.21.15.145:0/3774942186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6464025da0 tx=0x7f6464051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffae0f69fa3cedb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.297+0000 7f635f606640 1 -- 172.21.15.145:0/3774942186 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464051ac0 con 0x55db0ddc95f0 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.297+0000 7f635f606640 1 -- 172.21.15.145:0/3774942186 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464051c60 con 0x55db0ddc95f0 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.297+0000 7f635f606640 1 -- 172.21.15.145:0/3774942186 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646405a450 con 0x55db0ddc95f0 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- 172.21.15.145:0/3774942186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 msgr2=0x55db0deb8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 --2- 172.21.15.145:0/3774942186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6464025da0 tx=0x7f6464051000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- 172.21.15.145:0/3774942186 shutdown_connections 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 --2- 172.21.15.145:0/3774942186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0deb8680 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- 172.21.15.145:0/3774942186 >> 172.21.15.145:0/3774942186 conn(0x55db0ddc31b0 msgr2=0x55db0deb4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- 172.21.15.145:0/3774942186 shutdown_connections 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- 172.21.15.145:0/3774942186 wait complete. 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0debfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.298+0000 7f6475720800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db0ddd0030 con 0x55db0ddc95f0 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0debfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0debfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46976/0 (socket says 172.21.15.145:46976) 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6471302640 1 -- 172.21.15.145:0/1353919502 learned_addr learned my addr 172.21.15.145:0/1353919502 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6471302640 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0dec0330 con 0x55db0ddc95f0 2024-09-10T04:52:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6471302640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0debfdd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6464025da0 tx=0x7f6464002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f635de03640 1 -- 172.21.15.145:0/1353919502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464073070 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f635de03640 1 -- 172.21.15.145:0/1353919502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646405a640 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0dec05c0 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f635de03640 1 -- 172.21.15.145:0/1353919502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646405a920 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.299+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0dec11d0 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.300+0000 7f635de03640 1 -- 172.21.15.145:0/1353919502 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6464076070 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.300+0000 7f635de03640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f635803c730 0x7f635803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.300+0000 7f635de03640 1 -- 172.21.15.145:0/1353919502 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f6464062070 con 0x55db0ddc95f0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.300+0000 7f646bfff640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f635803c730 0x7f635803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0ddcc010 0x55db0dec7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0dec7960 con 0x55db0ddcc010 2024-09-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6471b03640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0ddcc010 0x55db0dec7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f646bfff640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f635803c730 0x7f635803ebf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f645c001e30 tx=0x7f645c001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6471b03640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0ddcc010 0x55db0dec7420 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6471b03640 1 -- 172.21.15.145:0/1353919502 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0ddcc010 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0dec82a0 0x55db0deca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.301+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0decaed0 con 0x55db0dec82a0 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6471302640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0dec82a0 0x55db0deca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6471302640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0dec82a0 0x55db0deca760 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6471302640 1 -- 172.21.15.145:0/1353919502 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f646407f070 con 0x55db0dec82a0 2024-09-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0decc780 con 0x55db0ddcc010 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6471b03640 1 -- 172.21.15.145:0/1353919502 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0ddcc010 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.302+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0decb9b0 con 0x55db0dec82a0 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f6471302640 1 -- 172.21.15.145:0/1353919502 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f646407f070 con 0x55db0dec82a0 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55db0decdb30 0x55db0decff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0ded0460 con 0x55db0decdb30 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f646bfff640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55db0decdb30 0x55db0decff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f646bfff640 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55db0decdb30 0x55db0decff20 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.303+0000 7f646bfff640 1 -- 172.21.15.145:0/1353919502 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f645c00bd50 con 0x55db0decdb30 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6475720800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6475720800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db0dcbfa00 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:46992/0 (socket says 172.21.15.145:46992) 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.304+0000 7f6471302640 1 -- 172.21.15.145:0/4249431448 learned_addr learned my addr 172.21.15.145:0/4249431448 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6471302640 1 -- 172.21.15.145:0/4249431448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0dedea40 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6471302640 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6464065dc0 tx=0x7f646405ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6356ffd640 1 -- 172.21.15.145:0/4249431448 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464094030 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6356ffd640 1 -- 172.21.15.145:0/4249431448 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464096740 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0dedf270 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6356ffd640 1 -- 172.21.15.145:0/4249431448 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464096a20 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.305+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0dedf810 con 0x55db0deddfe0 2024-09-10T04:52:14.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6356ffd640 1 -- 172.21.15.145:0/4249431448 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6464058070 con 0x55db0deddfe0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6356ffd640 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 0x7f634c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6356ffd640 1 -- 172.21.15.145:0/4249431448 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f6464095070 con 0x55db0deddfe0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f646bfff640 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 0x7f634c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f646bfff640 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 0x7f634c03ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55db0decc6f0 tx=0x7f645c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6475720800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.306+0000 7f6475720800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db0deb8e10 con 0x55db0deea8e0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47004/0 (socket says 172.21.15.145:47004) 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6471302640 1 -- 172.21.15.145:0/691621668 learned_addr learned my addr 172.21.15.145:0/691621668 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6471302640 1 -- 172.21.15.145:0/691621668 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0deeb2d0 con 0x55db0deea8e0 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6471302640 1 --2- 172.21.15.145:0/691621668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6464076750 tx=0x7f6464096f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1735e9d34c769c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6354ff9640 1 -- 172.21.15.145:0/691621668 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464093e40 con 0x55db0deea8e0 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6354ff9640 1 -- 172.21.15.145:0/691621668 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464078610 con 0x55db0deea8e0 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.307+0000 7f6354ff9640 1 -- 172.21.15.145:0/691621668 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464064af0 con 0x55db0deea8e0 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- 172.21.15.145:0/691621668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 msgr2=0x55db0deeace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 --2- 172.21.15.145:0/691621668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6464076750 tx=0x7f6464096f90 comp rx=0 tx=0).stop 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- 172.21.15.145:0/691621668 shutdown_connections 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 --2- 172.21.15.145:0/691621668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0deeace0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- 172.21.15.145:0/691621668 >> 172.21.15.145:0/691621668 conn(0x55db0dee6ce0 msgr2=0x55db0dee4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- 172.21.15.145:0/691621668 shutdown_connections 2024-09-10T04:52:14.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- 172.21.15.145:0/691621668 wait complete. 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 Processor -- start 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- start start 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6475720800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db0deeb740 con 0x55db0deea8e0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6471302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47016/0 (socket says 172.21.15.145:47016) 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.308+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 learned_addr learned my addr 172.21.15.145:0/3667326102 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0def22a0 con 0x55db0deea8e0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6471302640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6464076750 tx=0x7f6464090ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6342ffd640 1 -- 172.21.15.145:0/3667326102 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64640be020 con 0x55db0deea8e0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6342ffd640 1 -- 172.21.15.145:0/3667326102 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464090c70 con 0x55db0deea8e0 2024-09-10T04:52:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0def22a0 con 0x55db0deea8e0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6342ffd640 1 -- 172.21.15.145:0/3667326102 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464090540 con 0x55db0deea8e0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.309+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0def22a0 con 0x55db0deea8e0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f6342ffd640 1 -- 172.21.15.145:0/3667326102 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f64640c1020 con 0x55db0deea8e0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f6342ffd640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f633c03c780 0x7f633c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f6342ffd640 1 -- 172.21.15.145:0/3667326102 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f64640b5050 con 0x55db0deea8e0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f646bfff640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f633c03c780 0x7f633c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.310+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0defd280 0x55db0deff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0deffe90 con 0x55db0defd280 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6471b03640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0defd280 0x55db0deff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f646bfff640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f633c03c780 0x7f633c03ec40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f645c00fe70 tx=0x7f645c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6471b03640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0defd280 0x55db0deff740 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 20 realm 2024-09-10T04:52:14.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0defc5b0 con 0x55db0defd280 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.311+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df00920 con 0x55db0defd280 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0df01700 0x55db0df03af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df04120 con 0x55db0df01700 2024-09-10T04:52:14.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6471302640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0df01700 0x55db0df03af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6471302640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0df01700 0x55db0df03af0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.312+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df049c0 con 0x55db0defd280 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f6475720800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f6475720800 20 searching for the correct realm 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55db0df06730 0x55db0df08b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f646bfff640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55db0df06730 0x55db0df08b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f646bfff640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55db0df06730 0x55db0df08b60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.313+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471302640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f64640c3020 0x7f646408d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471b03640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f64640c3020 0x7f646408d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471b03640 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f64640c3020 0x7f646408d8c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f646c00a4d0 con 0x7f64640c3020 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.314+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.315+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c00a4d0 con 0x55db0defd280 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.316+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.317+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.318+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0defd280 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.319+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x7f64640c3020 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c030040 con 0x7f64640c3020 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.320+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df06730 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db0df09230 con 0x55db0df01700 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:14.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.321+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df05340 con 0x55db0defd280 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c030040 con 0x55db0defd280 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df04f50 con 0x55db0df01700 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df05c30 con 0x7f64640c3020 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 zone default found 2024-09-10T04:52:14.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 4 Realm: () 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 zonegroup default 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.322+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df05c30 con 0x7f64640c3020 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0b0f0 con 0x55db0df06730 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0b4c0 con 0x55db0df06730 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 started sync module instance, tier type = 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.323+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0a590 con 0x55db0df01700 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.324+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.324+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94399320074928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0a590 con 0x55db0df01700 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.324+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0bf80 con 0x55db0defd280 2024-09-10T04:52:14.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.325+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94399320074928] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.325+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.325+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94399320078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0a590 con 0x55db0defd280 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.325+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0ca10 con 0x55db0df01700 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.326+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94399320078960] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.326+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.326+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94399320081632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0a590 con 0x55db0df01700 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.327+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0d4a0 con 0x7f64640c3020 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.327+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.328+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94399320084336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0d460 con 0x7f64640c3020 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.328+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0e460 con 0x55db0df01700 2024-09-10T04:52:14.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.328+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94399320081632] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.328+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94399320084336] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.329+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.329+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94399320086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0e460 con 0x55db0df01700 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.329+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0ed00 con 0x55db0df06730 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.330+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.330+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94399320086672] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.330+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94399320088464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0e460 con 0x55db0df06730 2024-09-10T04:52:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.330+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0f700 con 0x55db0df06730 2024-09-10T04:52:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.331+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94399320088464] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.331+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.331+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94399320090704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df0ffa0 con 0x55db0df06730 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.331+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df10960 con 0x7f64640c3020 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94399320090704] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94399320095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df10960 con 0x7f64640c3020 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=0 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=1 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=2 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=3 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=4 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=5 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.332+0000 7f6475720800 20 add_watcher() i=6 2024-09-10T04:52:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94399320095952] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6475720800 20 add_watcher() i=7 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6475720800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df13d60 con 0x55db0defd280 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.333+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94399320098432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df112b0 con 0x55db0defd280 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94399320098432] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f63277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 5 note: GC not initialized 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f63267e4640 20 reqs_thread_entry: start 2024-09-10T04:52:14.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 20 Filter name: none 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6297fff640 20 reqs_thread_entry: start 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 20 rados->read ofs=0 len=0 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.335+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db0df46910 con 0x55db0defd280 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.336+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.336+0000 7f6475720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:could not fetch user info: no user info saved 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.336+0000 7f63277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.336+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94399320098432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0defd280 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.338+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94399320098432] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.338+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94399320074928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0df01700 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.339+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94399320074928] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.339+0000 7f6475720800 20 remove_watcher() i=0 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.339+0000 7f6475720800 2 removed watcher, disabling cache 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.339+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94399320078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0defd280 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.340+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94399320078960] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x55db0defd280 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.340+0000 7f6475720800 20 remove_watcher() i=1 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.340+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94399320081632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0df01700 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.341+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94399320081632] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.341+0000 7f6475720800 20 remove_watcher() i=2 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.341+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94399320084336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x7f64640c3020 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.342+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94399320084336] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.342+0000 7f6475720800 20 remove_watcher() i=3 2024-09-10T04:52:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.342+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94399320086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0df01700 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.343+0000 7f6471302640 1 -- 172.21.15.145:0/3667326102 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94399320086672] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64640a3070 con 0x55db0df01700 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.344+0000 7f6475720800 20 remove_watcher() i=4 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.344+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94399320088464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0df06730 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.344+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94399320088464] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.344+0000 7f6475720800 20 remove_watcher() i=5 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.344+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94399320090704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x55db0df06730 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.345+0000 7f646bfff640 1 -- 172.21.15.145:0/3667326102 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94399320090704] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c037040 con 0x55db0df06730 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.346+0000 7f6475720800 20 remove_watcher() i=6 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.346+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94399320095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db0df468d0 con 0x7f64640c3020 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.346+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94399320095952] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c041040 con 0x7f64640c3020 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 20 remove_watcher() i=7 2024-09-10T04:52:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0df01700 msgr2=0x55db0df03af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0df01700 0x55db0df03af0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0defd280 msgr2=0x55db0deff740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0defd280 0x55db0deff740 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f64640c3020 msgr2=0x7f646408d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f64640c3020 0x7f646408d8c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55db0df06730 msgr2=0x55db0df08b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55db0df06730 0x55db0df08b60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f633c03c780 msgr2=0x7f633c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f633c03c780 0x7f633c03ec40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f645c00fe70 tx=0x7f645c010000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 msgr2=0x55db0def1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6471b03640 1 -- 172.21.15.145:0/3667326102 reap_dead start 2024-09-10T04:52:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6464076750 tx=0x7f6464090ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 shutdown_connections 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/3667326102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deea8e0 0x55db0def1d40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 >> 172.21.15.145:0/3667326102 conn(0x55db0dee6ce0 msgr2=0x55db0dee4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 shutdown_connections 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/3667326102 wait complete. 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 msgr2=0x7f634c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 0x7f634c03ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55db0decc6f0 tx=0x7f645c00f000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 msgr2=0x55db0dede400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6464065dc0 tx=0x7f646405ae90 comp rx=0 tx=0).stop 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 shutdown_connections 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f634c03c780 0x7f634c03ec40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 --2- 172.21.15.145:0/4249431448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0deddfe0 0x55db0dede400 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 >> 172.21.15.145:0/4249431448 conn(0x55db0ded2390 msgr2=0x55db0ded2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 shutdown_connections 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.347+0000 7f6475720800 1 -- 172.21.15.145:0/4249431448 wait complete. 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0dec82a0 msgr2=0x55db0deca760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55db0dec82a0 0x55db0deca760 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0ddcc010 msgr2=0x55db0dec7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55db0ddcc010 0x55db0dec7420 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55db0decdb30 msgr2=0x55db0decff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55db0decdb30 0x55db0decff20 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f635803c730 msgr2=0x7f635803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f635803c730 0x7f635803ebf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f645c001e30 tx=0x7f645c001390 comp rx=0 tx=0).stop 2024-09-10T04:52:14.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 msgr2=0x55db0debfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 --2- 172.21.15.145:0/1353919502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db0ddc95f0 0x55db0debfdd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6464025da0 tx=0x7f6464002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6471b03640 1 -- 172.21.15.145:0/1353919502 reap_dead start 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 shutdown_connections 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 >> 172.21.15.145:0/1353919502 conn(0x55db0ddc31b0 msgr2=0x55db0deb27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 shutdown_connections 2024-09-10T04:52:14.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.348+0000 7f6475720800 1 -- 172.21.15.145:0/1353919502 wait complete. 2024-09-10T04:52:14.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T04:52:14.361 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-10T04:52:14.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-10T04:52:14.362 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-10T04:52:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.404+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.404+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf33922800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x564e60656f20 0x564e60657c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf33922800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e60501e40 con 0x564e60658160 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf33922800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x564e604cc680 con 0x564e60656f20 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf2f668640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x564e60656f20 0x564e60657c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf2ee67640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x564e60658160 0x564e6065cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36862/0 (socket says 172.21.15.145:36862) 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf2ee67640 1 -- 172.21.15.145:0/3807854725 learned_addr learned my addr 172.21.15.145:0/3807854725 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf2f668640 1 -- 172.21.15.145:0/3807854725 >> v1:172.21.15.98:6789/0 conn(0x564e60658160 legacy=0x564e6065cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.405+0000 7fdf2f668640 1 -- 172.21.15.145:0/3807854725 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e604e86b0 con 0x564e60656f20 2024-09-10T04:52:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.407+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3807854725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60657c20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000a470 tx=0x7fdf20045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91aacecd03350f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.407+0000 7fdf2e666640 1 -- 172.21.15.145:0/3807854725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20053570 con 0x564e60656f20 2024-09-10T04:52:14.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.407+0000 7fdf2e666640 1 -- 172.21.15.145:0/3807854725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf20058070 con 0x564e60656f20 2024-09-10T04:52:14.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.407+0000 7fdf2e666640 1 -- 172.21.15.145:0/3807854725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20053880 con 0x564e60656f20 2024-09-10T04:52:14.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 -- 172.21.15.145:0/3807854725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 msgr2=0x564e60657c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 --2- 172.21.15.145:0/3807854725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60657c20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000a470 tx=0x7fdf20045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 -- 172.21.15.145:0/3807854725 shutdown_connections 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 --2- 172.21.15.145:0/3807854725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60657c20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 -- 172.21.15.145:0/3807854725 >> 172.21.15.145:0/3807854725 conn(0x564e60652310 msgr2=0x564e60654750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 -- 172.21.15.145:0/3807854725 shutdown_connections 2024-09-10T04:52:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.408+0000 7fdf33922800 1 -- 172.21.15.145:0/3807854725 wait complete. 2024-09-10T04:52:14.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.421+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf33922800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf33922800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e604f0dd0 con 0x564e60656f20 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47046/0 (socket says 172.21.15.145:47046) 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf2f668640 1 -- 172.21.15.145:0/1958330050 learned_addr learned my addr 172.21.15.145:0/1958330050 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.422+0000 7fdf2f668640 1 -- 172.21.15.145:0/1958330050 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e60509e10 con 0x564e60656f20 2024-09-10T04:52:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf2f668640 1 --2- 172.21.15.145:0/1958330050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdf20025c20 tx=0x7fdf20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48574a1b9428cf40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fde1d60a640 1 -- 172.21.15.145:0/1958330050 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20053a20 con 0x564e60656f20 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fde1d60a640 1 -- 172.21.15.145:0/1958330050 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf20063070 con 0x564e60656f20 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fde1d60a640 1 -- 172.21.15.145:0/1958330050 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20053cf0 con 0x564e60656f20 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 -- 172.21.15.145:0/1958330050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 msgr2=0x564e60746610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 --2- 172.21.15.145:0/1958330050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdf20025c20 tx=0x7fdf20051000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 -- 172.21.15.145:0/1958330050 shutdown_connections 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 --2- 172.21.15.145:0/1958330050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60656f20 0x564e60746610 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 -- 172.21.15.145:0/1958330050 >> 172.21.15.145:0/1958330050 conn(0x564e60652310 msgr2=0x564e60741f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 -- 172.21.15.145:0/1958330050 shutdown_connections 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.423+0000 7fdf33922800 1 -- 172.21.15.145:0/1958330050 wait complete. 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf33922800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf33922800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e60658850 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47052/0 (socket says 172.21.15.145:47052) 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf2f668640 1 -- 172.21.15.145:0/3471276156 learned_addr learned my addr 172.21.15.145:0/3471276156 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.424+0000 7fdf2f668640 1 -- 172.21.15.145:0/3471276156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6074f7d0 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdf20025c20 tx=0x7fdf20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fde1be07640 1 -- 172.21.15.145:0/3471276156 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf200745b0 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fde1be07640 1 -- 172.21.15.145:0/3471276156 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf20074750 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e6074fa60 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fde1be07640 1 -- 172.21.15.145:0/3471276156 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20074a30 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e60750670 con 0x564e60658160 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.425+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde1be07640 1 -- 172.21.15.145:0/3471276156 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdf20074bd0 con 0x564e60658160 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf33922800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf33922800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e6054ea00 con 0x564e6074ba50 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2fe69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde1be07640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 0x7fde1403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2fe69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47064/0 (socket says 172.21.15.145:47064) 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2fe69640 1 -- 172.21.15.145:0/461821858 learned_addr learned my addr 172.21.15.145:0/461821858 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde1be07640 1 -- 172.21.15.145:0/3471276156 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdf200981f0 con 0x564e60658160 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 0x7fde1403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2fe69640 1 -- 172.21.15.145:0/461821858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6074c390 con 0x564e6074ba50 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2fe69640 1 --2- 172.21.15.145:0/461821858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800a3e0 tx=0x7fdf2800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac0642b2ee09ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 0x7fde1403ec40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdf2005ffd0 tx=0x7fdf2005f690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde19e03640 1 -- 172.21.15.145:0/461821858 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf28015070 con 0x564e6074ba50 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde19e03640 1 -- 172.21.15.145:0/461821858 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28001670 con 0x564e6074ba50 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.426+0000 7fde19e03640 1 -- 172.21.15.145:0/461821858 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf28001990 con 0x564e6074ba50 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- 172.21.15.145:0/461821858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 msgr2=0x564e6074be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 --2- 172.21.15.145:0/461821858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800a3e0 tx=0x7fdf2800a8a0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- 172.21.15.145:0/461821858 shutdown_connections 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 --2- 172.21.15.145:0/461821858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e6074be50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- 172.21.15.145:0/461821858 >> 172.21.15.145:0/461821858 conn(0x564e60758e40 msgr2=0x564e60757080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- 172.21.15.145:0/461821858 shutdown_connections 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- 172.21.15.145:0/461821858 wait complete. 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf33922800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e6074a790 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf2fe69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf2fe69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47074/0 (socket says 172.21.15.145:47074) 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.427+0000 7fdf2fe69640 1 -- 172.21.15.145:0/2169712225 learned_addr learned my addr 172.21.15.145:0/2169712225 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fdf2fe69640 1 -- 172.21.15.145:0/2169712225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e60766260 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fdf2fe69640 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdf28013040 tx=0x7fdf28003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fde0bfff640 1 -- 172.21.15.145:0/2169712225 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf28020020 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fde0bfff640 1 -- 172.21.15.145:0/2169712225 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28010780 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e607664f0 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fde0bfff640 1 -- 172.21.15.145:0/2169712225 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf28015040 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.428+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e60766e70 con 0x564e6074ba50 2024-09-10T04:52:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.429+0000 7fde0bfff640 1 -- 172.21.15.145:0/2169712225 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdf28023020 con 0x564e6074ba50 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.429+0000 7fde0bfff640 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 0x7fde1003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.429+0000 7fde0bfff640 1 -- 172.21.15.145:0/2169712225 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdf280533d0 con 0x564e6074ba50 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.429+0000 7fdf2ee67640 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 0x7fde1003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf2ee67640 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 0x7fde1003ec90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdf18001cf0 tx=0x7fdf18001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 1 Processor -- start 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 1 -- start start 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf33922800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e60746e00 con 0x564e6077fb30 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf2f668640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47088/0 (socket says 172.21.15.145:47088) 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.430+0000 7fdf2f668640 1 -- 172.21.15.145:0/2760749594 learned_addr learned my addr 172.21.15.145:0/2760749594 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdf2f668640 1 -- 172.21.15.145:0/2760749594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e60780590 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdf2f668640 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdf20096510 tx=0x7fdf20096470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdd97fff640 1 -- 172.21.15.145:0/2760749594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf20082030 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdd97fff640 1 -- 172.21.15.145:0/2760749594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf20084070 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdd97fff640 1 -- 172.21.15.145:0/2760749594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf200688a0 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e60780dc0 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.431+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e60781360 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdd97fff640 1 -- 172.21.15.145:0/2760749594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdf20086030 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdd97fff640 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 0x7fdd7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdd97fff640 1 -- 172.21.15.145:0/2760749594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fdf20083070 con 0x564e6077fb30 2024-09-10T04:52:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdf2ee67640 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 0x7fdd7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdd95ffb640 20 reqs_thread_entry: start 2024-09-10T04:52:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdf2ee67640 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 0x7fdd7003ec40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000f60 tx=0x7fdf1800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 0x564e6078f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e60790050 con 0x564e6078d4e0 2024-09-10T04:52:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.432+0000 7fdf2fe69640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 0x564e6078f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.433+0000 7fdf2fe69640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 0x564e6078f980 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.433+0000 7fdf2fe69640 1 -- 172.21.15.145:0/3471276156 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf2800e070 con 0x564e6078d4e0 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.433+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 0x564e60794210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.433+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e60794900 con 0x564e60791e20 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.433+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 0x564e60794210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.434+0000 7fdf2f668640 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 0x564e60794210 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.434+0000 7fdf2f668640 1 -- 172.21.15.145:0/3471276156 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(2 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdf20051070 con 0x564e60791e20 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 msgr2=0x7fde1003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 0x7fde1003ec90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdf18001cf0 tx=0x7fdf18001250 comp rx=0 tx=0).stop 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 msgr2=0x564e60765d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdf28013040 tx=0x7fdf28003370 comp rx=0 tx=0).stop 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 shutdown_connections 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1003c7d0 0x7fde1003ec90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2169712225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6074ba50 0x564e60765d00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 >> 172.21.15.145:0/2169712225 conn(0x564e60758e40 msgr2=0x564e60757050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 shutdown_connections 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2169712225 wait complete. 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 msgr2=0x7fdd7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 0x7fdd7003ec40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000f60 tx=0x7fdf1800f000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 msgr2=0x564e6077ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdf20096510 tx=0x7fdf20096470 comp rx=0 tx=0).stop 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 shutdown_connections 2024-09-10T04:52:14.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd7003c780 0x7fdd7003ec40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/2760749594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6077fb30 0x564e6077ff50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 >> 172.21.15.145:0/2760749594 conn(0x564e60775070 msgr2=0x564e60775450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 shutdown_connections 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/2760749594 wait complete. 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 msgr2=0x564e6078f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 0x564e6078f980 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 msgr2=0x564e60794210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 0x564e60794210 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 msgr2=0x7fde1403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 0x7fde1403ec40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdf2005ffd0 tx=0x7fdf2005f690 comp rx=0 tx=0).stop 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 msgr2=0x564e6074f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.435+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdf20025c20 tx=0x7fdf20002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 shutdown_connections 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x564e60791e20 0x564e60794210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x564e6078d4e0 0x564e6078f980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fde1403c780 0x7fde1403ec40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 --2- 172.21.15.145:0/3471276156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e60658160 0x564e6074f270 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 >> 172.21.15.145:0/3471276156 conn(0x564e60652310 msgr2=0x564e60740780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 shutdown_connections 2024-09-10T04:52:14.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.436+0000 7fdf33922800 1 -- 172.21.15.145:0/3471276156 wait complete. 2024-09-10T04:52:14.448 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T04:52:14.448 DEBUG:tasks.util.rgw: json result: {'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T04:52:14.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-10T04:52:14.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-10T04:52:14.449 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-10T04:52:14.491 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.491 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5815744800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563cbd1f4510 0x563cbd1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5815744800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563cbd09de40 con 0x563cbd1f9330 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5815744800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x563cbd068680 con 0x563cbd1f4510 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f58114f4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563cbd1f4510 0x563cbd1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f58114f4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563cbd1f4510 0x563cbd1f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47092/0 (socket says 172.21.15.145:47092) 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5810cf3640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x563cbd1f9330 0x563cbd1fb720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36866/0 (socket says 172.21.15.145:36866) 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f58114f4640 1 -- 172.21.15.145:0/3480071979 learned_addr learned my addr 172.21.15.145:0/3480071979 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f58114f4640 1 -- 172.21.15.145:0/3480071979 >> v1:172.21.15.98:6789/0 conn(0x563cbd1f9330 legacy=0x563cbd1fb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f58114f4640 1 -- 172.21.15.145:0/3480071979 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd0846b0 con 0x563cbd1f4510 2024-09-10T04:52:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.491+0000 7f5803fff640 1 -- 172.21.15.145:0/3480071979 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789682248 0 0) 0x563cbd09de40 con 0x563cbd1f9330 2024-09-10T04:52:14.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.493+0000 7f58114f4640 1 --2- 172.21.15.145:0/3480071979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd1f4910 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f580400a520 tx=0x7f5804045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80921f9070661f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.493+0000 7f5803fff640 1 -- 172.21.15.145:0/3480071979 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5804055070 con 0x563cbd1f4510 2024-09-10T04:52:14.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.493+0000 7f5803fff640 1 -- 172.21.15.145:0/3480071979 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58040515b0 con 0x563cbd1f4510 2024-09-10T04:52:14.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.493+0000 7f5803fff640 1 -- 172.21.15.145:0/3480071979 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040518d0 con 0x563cbd1f4510 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 -- 172.21.15.145:0/3480071979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 msgr2=0x563cbd1f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 --2- 172.21.15.145:0/3480071979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd1f4910 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f580400a520 tx=0x7f5804045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 -- 172.21.15.145:0/3480071979 shutdown_connections 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 --2- 172.21.15.145:0/3480071979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd1f4910 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 -- 172.21.15.145:0/3480071979 >> 172.21.15.145:0/3480071979 conn(0x563cbd1ed910 msgr2=0x563cbd1efd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 -- 172.21.15.145:0/3480071979 shutdown_connections 2024-09-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.494+0000 7f5815744800 1 -- 172.21.15.145:0/3480071979 wait complete. 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f5815744800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f5815744800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563cbd08cdd0 con 0x563cbd1f4510 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47098/0 (socket says 172.21.15.145:47098) 2024-09-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f58114f4640 1 -- 172.21.15.145:0/1112310461 learned_addr learned my addr 172.21.15.145:0/1112310461 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.508+0000 7f58114f4640 1 -- 172.21.15.145:0/1112310461 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd0a5e10 con 0x563cbd1f4510 2024-09-10T04:52:14.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.509+0000 7f58114f4640 1 --2- 172.21.15.145:0/1112310461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5804025da0 tx=0x7f5804051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97514081d1819256 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.509+0000 7f56ff606640 1 -- 172.21.15.145:0/1112310461 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5804051950 con 0x563cbd1f4510 2024-09-10T04:52:14.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.509+0000 7f56ff606640 1 -- 172.21.15.145:0/1112310461 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804051af0 con 0x563cbd1f4510 2024-09-10T04:52:14.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.509+0000 7f56ff606640 1 -- 172.21.15.145:0/1112310461 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5804051dd0 con 0x563cbd1f4510 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- 172.21.15.145:0/1112310461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 msgr2=0x563cbd2e56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 --2- 172.21.15.145:0/1112310461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5804025da0 tx=0x7f5804051000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- 172.21.15.145:0/1112310461 shutdown_connections 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 --2- 172.21.15.145:0/1112310461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2e56d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- 172.21.15.145:0/1112310461 >> 172.21.15.145:0/1112310461 conn(0x563cbd1ed910 msgr2=0x563cbd2e1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- 172.21.15.145:0/1112310461 shutdown_connections 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- 172.21.15.145:0/1112310461 wait complete. 2024-09-10T04:52:14.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f5815744800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563cbd1fd260 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47102/0 (socket says 172.21.15.145:47102) 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.510+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 learned_addr learned my addr 172.21.15.145:0/4194362836 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd2ed3d0 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5804025da0 tx=0x7f5804002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f56fde03640 1 -- 172.21.15.145:0/4194362836 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580405a600 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f56fde03640 1 -- 172.21.15.145:0/4194362836 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804073070 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cbd2ed660 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f56fde03640 1 -- 172.21.15.145:0/4194362836 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580405a910 con 0x563cbd1f4510 2024-09-10T04:52:14.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.511+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cbd2ee270 con 0x563cbd1f4510 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f56fde03640 1 -- 172.21.15.145:0/4194362836 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5804058070 con 0x563cbd1f4510 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5815744800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5815744800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563cbd0eaa00 con 0x563cbd2fa3c0 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f56fde03640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56f803c730 0x7f56f803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5811cf5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5811cf5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47116/0 (socket says 172.21.15.145:47116) 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5811cf5640 1 -- 172.21.15.145:0/2311190676 learned_addr learned my addr 172.21.15.145:0/2311190676 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f56fde03640 1 -- 172.21.15.145:0/4194362836 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f580406b040 con 0x563cbd1f4510 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56f803c730 0x7f56f803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f5811cf5640 1 -- 172.21.15.145:0/2311190676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd2fcd80 con 0x563cbd2fa3c0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.512+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56f803c730 0x7f56f803ebf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5804066020 tx=0x7f5804005700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5811cf5640 1 --2- 172.21.15.145:0/2311190676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f580c00a3e0 tx=0x7f580c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc403184c3e82dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f56f77fe640 1 -- 172.21.15.145:0/2311190676 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c015070 con 0x563cbd2fa3c0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f56f77fe640 1 -- 172.21.15.145:0/2311190676 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c001670 con 0x563cbd2fa3c0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f56f77fe640 1 -- 172.21.15.145:0/2311190676 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c001990 con 0x563cbd2fa3c0 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- 172.21.15.145:0/2311190676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 msgr2=0x563cbd2fc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 --2- 172.21.15.145:0/2311190676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f580c00a3e0 tx=0x7f580c00a8a0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- 172.21.15.145:0/2311190676 shutdown_connections 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 --2- 172.21.15.145:0/2311190676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd2fc7b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- 172.21.15.145:0/2311190676 >> 172.21.15.145:0/2311190676 conn(0x563cbd1f9330 msgr2=0x563cbd2f4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- 172.21.15.145:0/2311190676 shutdown_connections 2024-09-10T04:52:14.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- 172.21.15.145:0/2311190676 wait complete. 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.513+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5815744800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5815744800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563cbd2fd0d0 con 0x563cbd2fa3c0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5811cf5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5811cf5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47130/0 (socket says 172.21.15.145:47130) 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5811cf5640 1 -- 172.21.15.145:0/3993255978 learned_addr learned my addr 172.21.15.145:0/3993255978 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5811cf5640 1 -- 172.21.15.145:0/3993255978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd3017f0 con 0x563cbd2fa3c0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5811cf5640 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563cbd2f56c0 tx=0x7f580c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f56f5ffb640 1 -- 172.21.15.145:0/3993255978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c020020 con 0x563cbd2fa3c0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f56f5ffb640 1 -- 172.21.15.145:0/3993255978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c010780 con 0x563cbd2fa3c0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cbd301a80 con 0x563cbd2fa3c0 2024-09-10T04:52:14.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f56f5ffb640 1 -- 172.21.15.145:0/3993255978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c015040 con 0x563cbd2fa3c0 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.514+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cbd302400 con 0x563cbd2fa3c0 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.515+0000 7f56f5ffb640 1 -- 172.21.15.145:0/3993255978 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f580c023020 con 0x563cbd2fa3c0 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f56f5ffb640 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 0x7f56e803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f56f5ffb640 1 -- 172.21.15.145:0/3993255978 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f580c0533d0 con 0x563cbd2fa3c0 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5810cf3640 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 0x7f56e803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5810cf3640 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 0x7f56e803ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5808000c00 tx=0x7f5808001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 1 Processor -- start 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 1 -- start start 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.516+0000 7f5815744800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563cbd2e5e60 con 0x563cbd31b0e0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f58114f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47142/0 (socket says 172.21.15.145:47142) 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f58114f4640 1 -- 172.21.15.145:0/3333482982 learned_addr learned my addr 172.21.15.145:0/3333482982 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f58114f4640 1 -- 172.21.15.145:0/3333482982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd31bb40 con 0x563cbd31b0e0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f58114f4640 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5804095c40 tx=0x7f5804092e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.517+0000 7f56d67e4640 1 -- 172.21.15.145:0/3333482982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040773c0 con 0x563cbd31b0e0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.518+0000 7f56d67e4640 1 -- 172.21.15.145:0/3333482982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580408a050 con 0x563cbd31b0e0 2024-09-10T04:52:14.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.518+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cbd31c370 con 0x563cbd31b0e0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.518+0000 7f56d67e4640 1 -- 172.21.15.145:0/3333482982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5804064e20 con 0x563cbd31b0e0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.518+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cbd31c910 con 0x563cbd31b0e0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f56d67e4640 1 -- 172.21.15.145:0/3333482982 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f580404f070 con 0x563cbd31b0e0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f56d67e4640 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 0x7f564803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f56d67e4640 1 -- 172.21.15.145:0/3333482982 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f5804062070 con 0x563cbd31b0e0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f5810cf3640 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 0x7f564803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f56cf7fe640 20 reqs_thread_entry: start 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f5810cf3640 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 0x7f564803ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563cbd328a00 0x563cbd32ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd32b4d0 con 0x563cbd328a00 2024-09-10T04:52:14.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.519+0000 7f5811cf5640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563cbd328a00 0x563cbd32ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f5811cf5640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563cbd328a00 0x563cbd32ae50 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563cbd32c2c0 0x563cbd32e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd32ed60 con 0x563cbd32c2c0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563cbd32c2c0 0x563cbd32e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.520+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563cbd32c2c0 0x563cbd32e6b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd330610 con 0x563cbd328a00 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd33d410 con 0x563cbd328a00 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.535 INFO:teuthology.orchestra.run.smithi145.stderr:NOTICE: set zone's realm_id= 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563cbd3347d0 0x563cbd337700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.521+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f5810cf3640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563cbd3347d0 0x563cbd337700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f5810cf3640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563cbd3347d0 0x563cbd337700 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f58114f4640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f580408f030 0x7f5804097a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.522+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f580408f030 0x7f5804097a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f580408f030 0x7f5804097a70 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.523+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.524+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.525+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.526+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.527+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd328a00 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.528+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x7f580408f030 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.529+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd3347d0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580801e040 con 0x563cbd3347d0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f5810cf3640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563cbd337280 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.530+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd33b2e0 con 0x563cbd32c2c0 2024-09-10T04:52:14.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.531+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.531+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cbd339c60 con 0x563cbd328a00 2024-09-10T04:52:14.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.531+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(38 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.531+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:39 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563cbd336b10 con 0x563cbd328a00 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.532+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(39 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f580c00e070 con 0x563cbd328a00 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.532+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563cbd3388b0 con 0x563cbd32c2c0 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.533+0000 7f58114f4640 1 -- 172.21.15.145:0/4194362836 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f580409d020 con 0x563cbd32c2c0 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.533+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563cbd33ccb0 con 0x7f580408f030 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.534+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f580c00e070 con 0x7f580408f030 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 msgr2=0x7f56e803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 0x7f56e803ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5808000c00 tx=0x7f5808001330 comp rx=0 tx=0).stop 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 msgr2=0x563cbd301290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563cbd2f56c0 tx=0x7f580c003370 comp rx=0 tx=0).stop 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 shutdown_connections 2024-09-10T04:52:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56e803c780 0x7f56e803ec40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 --2- 172.21.15.145:0/3993255978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd2fa3c0 0x563cbd301290 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 >> 172.21.15.145:0/3993255978 conn(0x563cbd1f9330 msgr2=0x563cbd2f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 shutdown_connections 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.535+0000 7f5815744800 1 -- 172.21.15.145:0/3993255978 wait complete. 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 msgr2=0x7f564803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 0x7f564803ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808006000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 msgr2=0x563cbd31b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5804095c40 tx=0x7f5804092e50 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 shutdown_connections 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f564803c780 0x7f564803ec40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/3333482982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd31b0e0 0x563cbd31b500 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 >> 172.21.15.145:0/3333482982 conn(0x563cbd310640 msgr2=0x563cbd310a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 shutdown_connections 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/3333482982 wait complete. 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563cbd32c2c0 msgr2=0x563cbd32e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563cbd32c2c0 0x563cbd32e6b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563cbd328a00 msgr2=0x563cbd32ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563cbd328a00 0x563cbd32ae50 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f580408f030 msgr2=0x7f5804097a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f580408f030 0x7f5804097a70 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563cbd3347d0 msgr2=0x563cbd337700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563cbd3347d0 0x563cbd337700 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56f803c730 msgr2=0x7f56f803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f56f803c730 0x7f56f803ebf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5804066020 tx=0x7f5804005700 comp rx=0 tx=0).stop 2024-09-10T04:52:14.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 msgr2=0x563cbd2ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5811cf5640 1 -- 172.21.15.145:0/4194362836 reap_dead start 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5804025da0 tx=0x7f5804002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 shutdown_connections 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 --2- 172.21.15.145:0/4194362836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563cbd1f4510 0x563cbd2ece70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 >> 172.21.15.145:0/4194362836 conn(0x563cbd1ed910 msgr2=0x563cbd2df840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 shutdown_connections 2024-09-10T04:52:14.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.536+0000 7f5815744800 1 -- 172.21.15.145:0/4194362836 wait complete. 2024-09-10T04:52:14.549 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T04:52:14.549 DEBUG:tasks.util.rgw: json result: {'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T04:52:14.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-10T04:52:14.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-10T04:52:14.550 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-10T04:52:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.631+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.631+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1cc746800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ca53f1b9c0 0x55ca53f215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1cc746800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca53dc5e40 con 0x55ca53f1b450 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1cc746800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55ca53d90680 con 0x55ca53f1b9c0 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1c9a36640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ca53f1b9c0 0x55ca53f215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1ca237640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55ca53f1b450 0x55ca53f1ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36868/0 (socket says 172.21.15.145:36868) 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1ca237640 1 -- 172.21.15.145:0/153223502 learned_addr learned my addr 172.21.15.145:0/153223502 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1c9a36640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55ca53f1b9c0 0x55ca53f215f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47148/0 (socket says 172.21.15.145:47148) 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1c9a36640 1 -- 172.21.15.145:0/153223502 >> v1:172.21.15.98:6789/0 conn(0x55ca53f1b450 legacy=0x55ca53f1ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1c9235640 1 -- 172.21.15.145:0/153223502 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441545251 0 0) 0x55ca53dc5e40 con 0x55ca53f1b450 2024-09-10T04:52:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.632+0000 7fe1c9a36640 1 -- 172.21.15.145:0/153223502 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca53dac6b0 con 0x55ca53f1b9c0 2024-09-10T04:52:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.634+0000 7fe1c9a36640 1 --2- 172.21.15.145:0/153223502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b9c0 0x55ca53f215f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a470 tx=0x7fe1b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a466354fd60069 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.634+0000 7fe1c9235640 1 -- 172.21.15.145:0/153223502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b4053570 con 0x55ca53f1b9c0 2024-09-10T04:52:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.634+0000 7fe1c9235640 1 -- 172.21.15.145:0/153223502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b4058070 con 0x55ca53f1b9c0 2024-09-10T04:52:14.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.634+0000 7fe1c9235640 1 -- 172.21.15.145:0/153223502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b4053880 con 0x55ca53f1b9c0 2024-09-10T04:52:14.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 -- 172.21.15.145:0/153223502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b9c0 msgr2=0x55ca53f215f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 --2- 172.21.15.145:0/153223502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b9c0 0x55ca53f215f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a470 tx=0x7fe1b4045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 -- 172.21.15.145:0/153223502 shutdown_connections 2024-09-10T04:52:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 --2- 172.21.15.145:0/153223502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b9c0 0x55ca53f215f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 -- 172.21.15.145:0/153223502 >> 172.21.15.145:0/153223502 conn(0x55ca53f15910 msgr2=0x55ca53f17d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 -- 172.21.15.145:0/153223502 shutdown_connections 2024-09-10T04:52:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.635+0000 7fe1cc746800 1 -- 172.21.15.145:0/153223502 wait complete. 2024-09-10T04:52:14.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.648+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1cc746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1cc746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca53db4dd0 con 0x55ca53f1b450 2024-09-10T04:52:14.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47160/0 (socket says 172.21.15.145:47160) 2024-09-10T04:52:14.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1ca237640 1 -- 172.21.15.145:0/2711158350 learned_addr learned my addr 172.21.15.145:0/2711158350 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.649+0000 7fe1ca237640 1 -- 172.21.15.145:0/2711158350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca53dcde10 con 0x55ca53f1b450 2024-09-10T04:52:14.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2711158350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4006fa0 tx=0x7fe1c4001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42183e5a82eba00e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe0b8608640 1 -- 172.21.15.145:0/2711158350 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c4003450 con 0x55ca53f1b450 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe0b8608640 1 -- 172.21.15.145:0/2711158350 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4003610 con 0x55ca53f1b450 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe0b8608640 1 -- 172.21.15.145:0/2711158350 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c4003970 con 0x55ca53f1b450 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 -- 172.21.15.145:0/2711158350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 msgr2=0x55ca53f1a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2711158350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4006fa0 tx=0x7fe1c4001b00 comp rx=0 tx=0).stop 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 -- 172.21.15.145:0/2711158350 shutdown_connections 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2711158350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca53f1a590 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 -- 172.21.15.145:0/2711158350 >> 172.21.15.145:0/2711158350 conn(0x55ca53f15910 msgr2=0x55ca54005d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.650+0000 7fe1cc746800 1 -- 172.21.15.145:0/2711158350 shutdown_connections 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1cc746800 1 -- 172.21.15.145:0/2711158350 wait complete. 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1cc746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1cc746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca53f21f70 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47164/0 (socket says 172.21.15.145:47164) 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1ca237640 1 -- 172.21.15.145:0/2233109687 learned_addr learned my addr 172.21.15.145:0/2233109687 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.651+0000 7fe1ca237640 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca54015560 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4001330 tx=0x7fe1c4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe0b6e05640 1 -- 172.21.15.145:0/2233109687 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c4014a10 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe0b6e05640 1 -- 172.21.15.145:0/2233109687 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4014bb0 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe0b6e05640 1 -- 172.21.15.145:0/2233109687 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c401e3f0 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca540157f0 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca540161f0 con 0x55ca53f1b450 2024-09-10T04:52:14.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.652+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1cc746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1cc746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca53e12a00 con 0x55ca540224f0 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b6e05640 1 -- 172.21.15.145:0/2233109687 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1c4010070 con 0x55ca53f1b450 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1caa38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1caa38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47180/0 (socket says 172.21.15.145:47180) 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b6e05640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 0x7fe0b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1caa38640 1 -- 172.21.15.145:0/1255720608 learned_addr learned my addr 172.21.15.145:0/1255720608 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b6e05640 1 -- 172.21.15.145:0/2233109687 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe1c4018070 con 0x55ca53f1b450 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 0x7fe0b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1caa38640 1 -- 172.21.15.145:0/1255720608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca54024eb0 con 0x55ca540224f0 2024-09-10T04:52:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1caa38640 1 --2- 172.21.15.145:0/1255720608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00a430 tx=0x7fe1bc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9dfe3df2c90f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 0x7fe0b003ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40015a0 tx=0x7fe1c4001530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b4e01640 1 -- 172.21.15.145:0/1255720608 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc008840 con 0x55ca540224f0 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b4e01640 1 -- 172.21.15.145:0/1255720608 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc008a00 con 0x55ca540224f0 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.653+0000 7fe0b4e01640 1 -- 172.21.15.145:0/1255720608 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc008d20 con 0x55ca540224f0 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- 172.21.15.145:0/1255720608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 msgr2=0x55ca540248e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 --2- 172.21.15.145:0/1255720608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00a430 tx=0x7fe1bc00a8f0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- 172.21.15.145:0/1255720608 shutdown_connections 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 --2- 172.21.15.145:0/1255720608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540248e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- 172.21.15.145:0/1255720608 >> 172.21.15.145:0/1255720608 conn(0x55ca53f1b9c0 msgr2=0x55ca5401ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- 172.21.15.145:0/1255720608 shutdown_connections 2024-09-10T04:52:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- 172.21.15.145:0/1255720608 wait complete. 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1cc746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca540251a0 con 0x55ca540224f0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1caa38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1caa38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47188/0 (socket says 172.21.15.145:47188) 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.654+0000 7fe1caa38640 1 -- 172.21.15.145:0/2851787543 learned_addr learned my addr 172.21.15.145:0/2851787543 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe1caa38640 1 -- 172.21.15.145:0/2851787543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca54029950 con 0x55ca540224f0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe1caa38640 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00adf0 tx=0x7fe1bc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe0aeffd640 1 -- 172.21.15.145:0/2851787543 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc022030 con 0x55ca540224f0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe0aeffd640 1 -- 172.21.15.145:0/2851787543 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc019040 con 0x55ca540224f0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca54029be0 con 0x55ca540224f0 2024-09-10T04:52:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe0aeffd640 1 -- 172.21.15.145:0/2851787543 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc013970 con 0x55ca540224f0 2024-09-10T04:52:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.655+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5402a560 con 0x55ca540224f0 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe0aeffd640 1 -- 172.21.15.145:0/2851787543 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1bc025070 con 0x55ca540224f0 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe0aeffd640 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 0x7fe0a403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe0aeffd640 1 -- 172.21.15.145:0/2851787543 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe1bc023070 con 0x55ca540224f0 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe1cc746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe1cc746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.656+0000 7fe1c9a36640 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 0x7fe0a403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1cc746800 1 Processor -- start 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1cc746800 1 -- start start 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1c9a36640 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 0x7fe0a403ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4057000 tx=0x7fe1b4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1cc746800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1cc746800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca54010490 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1ca237640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47204/0 (socket says 172.21.15.145:47204) 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.657+0000 7fe1ca237640 1 -- 172.21.15.145:0/4136520256 learned_addr learned my addr 172.21.15.145:0/4136520256 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe1ca237640 1 -- 172.21.15.145:0/4136520256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca54043cb0 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe1ca237640 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40035e0 tx=0x7fe1c401db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe08efe5640 1 -- 172.21.15.145:0/4136520256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40123c0 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe08efe5640 1 -- 172.21.15.145:0/4136520256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c401d510 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe08efe5640 1 -- 172.21.15.145:0/4136520256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c4012930 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca540444e0 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.658+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca54044a80 con 0x55ca54043250 2024-09-10T04:52:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe08efe5640 1 -- 172.21.15.145:0/4136520256 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1c403f050 con 0x55ca54043250 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe08efe5640 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 0x7fe00c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe08efe5640 1 -- 172.21.15.145:0/4136520256 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe1c404bd70 con 0x55ca54043250 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe1c9a36640 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 0x7fe00c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe08cfe1640 20 reqs_thread_entry: start 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe1c9a36640 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 0x7fe00c03ec40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4045a60 tx=0x7fe1b4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 0x55ca540531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca54053870 con 0x55ca54050d80 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.659+0000 7fe1caa38640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 0x55ca540531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.660+0000 7fe1caa38640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 0x55ca540531f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.660+0000 7fe1caa38640 1 -- 172.21.15.145:0/2233109687 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1bc01ecd0 con 0x55ca54050d80 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.660+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 0x55ca54056a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.660+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca540570a0 con 0x55ca54054630 2024-09-10T04:52:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.660+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 0x55ca54056a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.661+0000 7fe1ca237640 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 0x55ca54056a20 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.661+0000 7fe1ca237640 1 -- 172.21.15.145:0/2233109687 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1c4051070 con 0x55ca54054630 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.661+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca54058950 con 0x55ca54050d80 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.661+0000 7fe1caa38640 1 -- 172.21.15.145:0/2233109687 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fe1bc01ecd0 con 0x55ca54050d80 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 msgr2=0x7fe0a403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 0x7fe0a403ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4057000 tx=0x7fe1b4052000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 msgr2=0x55ca540293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00adf0 tx=0x7fe1bc002ff0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 shutdown_connections 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0a403c780 0x7fe0a403ec40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2851787543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca540224f0 0x55ca540293f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 >> 172.21.15.145:0/2851787543 conn(0x55ca53f1b9c0 msgr2=0x55ca5401cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 shutdown_connections 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/2851787543 wait complete. 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 msgr2=0x7fe00c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.662+0000 7fe1cc746800 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 0x7fe00c03ec40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4045a60 tx=0x7fe1b4005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 msgr2=0x55ca54043670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40035e0 tx=0x7fe1c401db40 comp rx=0 tx=0).stop 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 shutdown_connections 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe00c03c780 0x7fe00c03ec40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/4136520256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca54043250 0x55ca54043670 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 >> 172.21.15.145:0/4136520256 conn(0x55ca540387d0 msgr2=0x55ca54038bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 shutdown_connections 2024-09-10T04:52:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/4136520256 wait complete. 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 msgr2=0x55ca54056a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 0x55ca54056a20 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 msgr2=0x55ca540531f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 0x55ca540531f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 msgr2=0x7fe0b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 0x7fe0b003ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40015a0 tx=0x7fe1c4001530 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 msgr2=0x55ca54015000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4001330 tx=0x7fe1c4001250 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 shutdown_connections 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55ca54054630 0x55ca54056a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55ca54050d80 0x55ca540531f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe0b003c780 0x7fe0b003ec40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 --2- 172.21.15.145:0/2233109687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca53f1b450 0x55ca54015000 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 >> 172.21.15.145:0/2233109687 conn(0x55ca53f15910 msgr2=0x55ca54004540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 shutdown_connections 2024-09-10T04:52:14.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.663+0000 7fe1cc746800 1 -- 172.21.15.145:0/2233109687 wait complete. 2024-09-10T04:52:14.675 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T04:52:14.675 DEBUG:tasks.util.rgw: json result: {'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T04:52:14.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T04:52:14.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T04:52:14.675 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T04:52:14.762 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.762 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.761+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.761+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.761+0000 7f4751b2e800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a17ec31340 0x55a17ec33800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.761+0000 7f4751b2e800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a17ead6e40 con 0x55a17ec2d740 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.761+0000 7f4751b2e800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a17eaa1680 con 0x55a17ec31340 2024-09-10T04:52:14.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f4747fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a17ec31340 0x55a17ec33800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f4747fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a17ec31340 0x55a17ec33800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47206/0 (socket says 172.21.15.145:47206) 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f4747fff640 1 -- 172.21.15.145:0/1416306835 learned_addr learned my addr 172.21.15.145:0/1416306835 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f474d8dd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55a17ec2d740 0x55a17ec2fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36876/0 (socket says 172.21.15.145:36876) 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f4747fff640 1 -- 172.21.15.145:0/1416306835 >> v1:172.21.15.98:6789/0 conn(0x55a17ec2d740 legacy=0x55a17ec2fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f474d0dc640 1 -- 172.21.15.145:0/1416306835 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001261815 0 0) 0x55a17ead6e40 con 0x55a17ec2d740 2024-09-10T04:52:14.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.762+0000 7f4747fff640 1 -- 172.21.15.145:0/1416306835 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17eabd6b0 con 0x55a17ec31340 2024-09-10T04:52:14.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4747fff640 1 --2- 172.21.15.145:0/1416306835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec31340 0x55a17ec33800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f473800a520 tx=0x7f4738045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15c1c18c70526e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f474d0dc640 1 -- 172.21.15.145:0/1416306835 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4738055070 con 0x55a17ec31340 2024-09-10T04:52:14.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f474d0dc640 1 -- 172.21.15.145:0/1416306835 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47380515b0 con 0x55a17ec31340 2024-09-10T04:52:14.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f474d0dc640 1 -- 172.21.15.145:0/1416306835 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47380518d0 con 0x55a17ec31340 2024-09-10T04:52:14.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 -- 172.21.15.145:0/1416306835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec31340 msgr2=0x55a17ec33800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 --2- 172.21.15.145:0/1416306835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec31340 0x55a17ec33800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f473800a520 tx=0x7f4738045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 -- 172.21.15.145:0/1416306835 shutdown_connections 2024-09-10T04:52:14.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 --2- 172.21.15.145:0/1416306835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec31340 0x55a17ec33800 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 -- 172.21.15.145:0/1416306835 >> 172.21.15.145:0/1416306835 conn(0x55a17ec27320 msgr2=0x55a17ec29760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 -- 172.21.15.145:0/1416306835 shutdown_connections 2024-09-10T04:52:14.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.764+0000 7f4751b2e800 1 -- 172.21.15.145:0/1416306835 wait complete. 2024-09-10T04:52:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.778+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.778+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.778+0000 7f4751b2e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.778+0000 7f4751b2e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a17eac5dd0 con 0x55a17ec2d740 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47208/0 (socket says 172.21.15.145:47208) 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f474d8dd640 1 -- 172.21.15.145:0/1356345184 learned_addr learned my addr 172.21.15.145:0/1356345184 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f474d8dd640 1 -- 172.21.15.145:0/1356345184 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17eadee10 con 0x55a17ec2d740 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f474d8dd640 1 --2- 172.21.15.145:0/1356345184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4740001ea0 tx=0x7f474000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a0702a6dc892dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f463be07640 1 -- 172.21.15.145:0/1356345184 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740008070 con 0x55a17ec2d740 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f463be07640 1 -- 172.21.15.145:0/1356345184 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474000d500 con 0x55a17ec2d740 2024-09-10T04:52:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.779+0000 7f463be07640 1 -- 172.21.15.145:0/1356345184 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474000d880 con 0x55a17ec2d740 2024-09-10T04:52:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 -- 172.21.15.145:0/1356345184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 msgr2=0x55a17ec2ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 --2- 172.21.15.145:0/1356345184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4740001ea0 tx=0x7f474000b6a0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 -- 172.21.15.145:0/1356345184 shutdown_connections 2024-09-10T04:52:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 --2- 172.21.15.145:0/1356345184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ec2ce90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 -- 172.21.15.145:0/1356345184 >> 172.21.15.145:0/1356345184 conn(0x55a17ec27320 msgr2=0x55a17ed17ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 -- 172.21.15.145:0/1356345184 shutdown_connections 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.780+0000 7f4751b2e800 1 -- 172.21.15.145:0/1356345184 wait complete. 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f4751b2e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f4751b2e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a17ec34180 con 0x55a17ec2d740 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47210/0 (socket says 172.21.15.145:47210) 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f474d8dd640 1 -- 172.21.15.145:0/4216699521 learned_addr learned my addr 172.21.15.145:0/4216699521 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f474d8dd640 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ed265f0 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f474d8dd640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47400012f0 tx=0x7f4740000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f463a604640 1 -- 172.21.15.145:0/4216699521 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474000f9d0 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f463a604640 1 -- 172.21.15.145:0/4216699521 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474000fb70 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ed26880 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.781+0000 7f463a604640 1 -- 172.21.15.145:0/4216699521 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474000fe50 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ed27280 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f463a604640 1 -- 172.21.15.145:0/4216699521 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4740017040 con 0x55a17ec2d740 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f4751b2e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.782+0000 7f4751b2e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a17eb23a00 con 0x55a17ed33580 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474e0de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474e0de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47226/0 (socket says 172.21.15.145:47226) 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474e0de640 1 -- 172.21.15.145:0/433975358 learned_addr learned my addr 172.21.15.145:0/433975358 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f463a604640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 0x7f463403ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f463a604640 1 -- 172.21.15.145:0/4216699521 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4740015020 con 0x55a17ec2d740 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474d8dd640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 0x7f463403ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474e0de640 1 -- 172.21.15.145:0/433975358 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ed35f40 con 0x55a17ed33580 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474e0de640 1 --2- 172.21.15.145:0/433975358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f474800a3e0 tx=0x7f474800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310d8d641d45c085 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f474d8dd640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 0x7f463403ed90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f474001bfd0 tx=0x7f4740034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f4633fff640 1 -- 172.21.15.145:0/433975358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748015070 con 0x55a17ed33580 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f4633fff640 1 -- 172.21.15.145:0/433975358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4748001670 con 0x55a17ed33580 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.783+0000 7f4633fff640 1 -- 172.21.15.145:0/433975358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748001990 con 0x55a17ed33580 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- 172.21.15.145:0/433975358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 msgr2=0x55a17ed35970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 --2- 172.21.15.145:0/433975358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f474800a3e0 tx=0x7f474800a8a0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- 172.21.15.145:0/433975358 shutdown_connections 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 --2- 172.21.15.145:0/433975358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed35970 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- 172.21.15.145:0/433975358 >> 172.21.15.145:0/433975358 conn(0x55a17ec31340 msgr2=0x55a17ed2dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- 172.21.15.145:0/433975358 shutdown_connections 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- 172.21.15.145:0/433975358 wait complete. 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f4751b2e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a17ed36290 con 0x55a17ed33580 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f474e0de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f474e0de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47230/0 (socket says 172.21.15.145:47230) 2024-09-10T04:52:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.784+0000 7f474e0de640 1 -- 172.21.15.145:0/3019033434 learned_addr learned my addr 172.21.15.145:0/3019033434 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f474e0de640 1 -- 172.21.15.145:0/3019033434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ed3aa60 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f474e0de640 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4748013040 tx=0x7f4748003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f46327fc640 1 -- 172.21.15.145:0/3019033434 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748020020 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f46327fc640 1 -- 172.21.15.145:0/3019033434 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4748010780 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ed3acf0 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f46327fc640 1 -- 172.21.15.145:0/3019033434 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748015040 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.785+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ed3b670 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f46327fc640 1 -- 172.21.15.145:0/3019033434 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4748023020 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f46327fc640 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 0x7f462803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f46327fc640 1 -- 172.21.15.145:0/3019033434 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4748053390 con 0x55a17ed33580 2024-09-10T04:52:14.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f4747fff640 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 0x7f462803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f4751b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.786+0000 7f4751b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f4747fff640 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 0x7f462803ebf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4738057000 tx=0x7f4738052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f4751b2e800 1 Processor -- start 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f4751b2e800 1 -- start start 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f4751b2e800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f4751b2e800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a17ec2b730 con 0x55a17ed54390 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f474d8dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47238/0 (socket says 172.21.15.145:47238) 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f474d8dd640 1 -- 172.21.15.145:0/3063846937 learned_addr learned my addr 172.21.15.145:0/3063846937 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.787+0000 7f474d8dd640 1 -- 172.21.15.145:0/3063846937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ed54df0 con 0x55a17ed54390 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f474d8dd640 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f474000c010 tx=0x7f4740018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f46127e4640 1 -- 172.21.15.145:0/3063846937 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474003eb80 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f46127e4640 1 -- 172.21.15.145:0/3063846937 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474003ed20 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ed55620 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f46127e4640 1 -- 172.21.15.145:0/3063846937 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474001a3c0 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ed55bc0 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.788+0000 7f46127e4640 1 -- 172.21.15.145:0/3063846937 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f474001a560 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f46127e4640 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 0x7f459003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f46127e4640 1 -- 172.21.15.145:0/3063846937 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4740048da0 con 0x55a17ed54390 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f4747fff640 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 0x7f459003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f4583fff640 20 reqs_thread_entry: start 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 0x55a17ed64350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a17ed64a20 con 0x55a17ed61ec0 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f4747fff640 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 0x7f459003ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4738045be0 tx=0x7f4738005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.789+0000 7f474e0de640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 0x55a17ed64350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f474e0de640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 0x55a17ed64350 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f474e0de640 1 -- 172.21.15.145:0/4216699521 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f474800e070 con 0x55a17ed61ec0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 0x55a17ed68be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a17ed69320 con 0x55a17ed667f0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f474d8dd640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 0x55a17ed68be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.790+0000 7f474d8dd640 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 0x55a17ed68be0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.791+0000 7f474d8dd640 1 -- 172.21.15.145:0/4216699521 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(2 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f4740038070 con 0x55a17ed667f0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.791+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a17ed65ea0 con 0x55a17ed667f0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.792+0000 7f474d8dd640 1 -- 172.21.15.145:0/4216699521 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f4740038070 con 0x55a17ed667f0 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 msgr2=0x7f462803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 0x7f462803ebf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4738057000 tx=0x7f4738052000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 msgr2=0x55a17ed3a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4748013040 tx=0x7f4748003370 comp rx=0 tx=0).stop 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 shutdown_connections 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f462803c730 0x7f462803ebf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3019033434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed33580 0x55a17ed3a500 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 >> 172.21.15.145:0/3019033434 conn(0x55a17ec31340 msgr2=0x55a17ed2de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 shutdown_connections 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3019033434 wait complete. 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 msgr2=0x7f459003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 0x7f459003ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4738045be0 tx=0x7f4738005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 msgr2=0x55a17ed547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f474000c010 tx=0x7f4740018f20 comp rx=0 tx=0).stop 2024-09-10T04:52:14.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 shutdown_connections 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459003c780 0x7f459003ec40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 --2- 172.21.15.145:0/3063846937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ed54390 0x55a17ed547b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 >> 172.21.15.145:0/3063846937 conn(0x55a17ed498f0 msgr2=0x55a17ed49cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 shutdown_connections 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.793+0000 7f4751b2e800 1 -- 172.21.15.145:0/3063846937 wait complete. 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 msgr2=0x55a17ed64350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 0x55a17ed64350 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 msgr2=0x55a17ed68be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 0x55a17ed68be0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 msgr2=0x7f463403ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 0x7f463403ed90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f474001bfd0 tx=0x7f4740034040 comp rx=0 tx=0).stop 2024-09-10T04:52:14.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 msgr2=0x55a17ed26090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f47400012f0 tx=0x7f4740000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 shutdown_connections 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a17ed667f0 0x55a17ed68be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a17ed61ec0 0x55a17ed64350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f463403c8d0 0x7f463403ed90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 --2- 172.21.15.145:0/4216699521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a17ec2d740 0x55a17ed26090 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 >> 172.21.15.145:0/4216699521 conn(0x55a17ec27320 msgr2=0x55a17ed17a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 shutdown_connections 2024-09-10T04:52:14.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.794+0000 7f4751b2e800 1 -- 172.21.15.145:0/4216699521 wait complete. 2024-09-10T04:52:14.804 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T04:52:14.804 DEBUG:tasks.util.rgw: json result: {'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T04:52:14.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-10T04:52:14.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-10T04:52:14.805 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-10T04:52:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.847+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.847+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b88142800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b4b8bec490 0x55b4b8bec890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b88142800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4b8a97e40 con 0x55b4b8becdd0 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b88142800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55b4b8a62680 con 0x55b4b8bec490 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83e86640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b4b8bec490 0x55b4b8bec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83e86640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55b4b8bec490 0x55b4b8bec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47246/0 (socket says 172.21.15.145:47246) 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83e86640 1 -- 172.21.15.145:0/1973741274 learned_addr learned my addr 172.21.15.145:0/1973741274 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83685640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55b4b8becdd0 0x55b4b8bed280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36886/0 (socket says 172.21.15.145:36886) 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83e86640 1 -- 172.21.15.145:0/1973741274 >> v1:172.21.15.98:6789/0 conn(0x55b4b8becdd0 legacy=0x55b4b8bed280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.848+0000 7f7b83e86640 1 -- 172.21.15.145:0/1973741274 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8a7e6b0 con 0x55b4b8bec490 2024-09-10T04:52:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1973741274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8bec890 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a520 tx=0x7f7b74045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b9a2d4b41a123 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b82e84640 1 -- 172.21.15.145:0/1973741274 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74055070 con 0x55b4b8bec490 2024-09-10T04:52:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b82e84640 1 -- 172.21.15.145:0/1973741274 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b740515b0 con 0x55b4b8bec490 2024-09-10T04:52:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b82e84640 1 -- 172.21.15.145:0/1973741274 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740518d0 con 0x55b4b8bec490 2024-09-10T04:52:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b88142800 1 -- 172.21.15.145:0/1973741274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 msgr2=0x55b4b8bec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.850+0000 7f7b88142800 1 --2- 172.21.15.145:0/1973741274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8bec890 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a520 tx=0x7f7b74045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.851+0000 7f7b88142800 1 -- 172.21.15.145:0/1973741274 shutdown_connections 2024-09-10T04:52:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.851+0000 7f7b88142800 1 --2- 172.21.15.145:0/1973741274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8bec890 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.851+0000 7f7b88142800 1 -- 172.21.15.145:0/1973741274 >> 172.21.15.145:0/1973741274 conn(0x55b4b8be81e0 msgr2=0x55b4b8bea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.851+0000 7f7b88142800 1 -- 172.21.15.145:0/1973741274 shutdown_connections 2024-09-10T04:52:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.851+0000 7f7b88142800 1 -- 172.21.15.145:0/1973741274 wait complete. 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.864+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.864+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b88142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b88142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8a86dd0 con 0x55b4b8bec490 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47260/0 (socket says 172.21.15.145:47260) 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b83e86640 1 -- 172.21.15.145:0/2155191809 learned_addr learned my addr 172.21.15.145:0/2155191809 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b83e86640 1 -- 172.21.15.145:0/2155191809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8a9fe10 con 0x55b4b8bec490 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7b83e86640 1 --2- 172.21.15.145:0/2155191809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7b740460d0 tx=0x7f7b74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a683c8f9933e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.865+0000 7f7a71e0b640 1 -- 172.21.15.145:0/2155191809 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740519d0 con 0x55b4b8bec490 2024-09-10T04:52:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7a71e0b640 1 -- 172.21.15.145:0/2155191809 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74051b70 con 0x55b4b8bec490 2024-09-10T04:52:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7a71e0b640 1 -- 172.21.15.145:0/2155191809 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74051e50 con 0x55b4b8bec490 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 -- 172.21.15.145:0/2155191809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 msgr2=0x55b4b8cdf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 --2- 172.21.15.145:0/2155191809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7b740460d0 tx=0x7f7b74051000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 -- 172.21.15.145:0/2155191809 shutdown_connections 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 --2- 172.21.15.145:0/2155191809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8cdf800 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 -- 172.21.15.145:0/2155191809 >> 172.21.15.145:0/2155191809 conn(0x55b4b8be81e0 msgr2=0x55b4b8cdb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 -- 172.21.15.145:0/2155191809 shutdown_connections 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 -- 172.21.15.145:0/2155191809 wait complete. 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.866+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b88142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8ce7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b88142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8bedd50 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8ce7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8ce7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47266/0 (socket says 172.21.15.145:47266) 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b83e86640 1 -- 172.21.15.145:0/1546898763 learned_addr learned my addr 172.21.15.145:0/1546898763 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b83e86640 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8ce7580 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8ce7020 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7b740460d0 tx=0x7f7b74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7a6bfff640 1 -- 172.21.15.145:0/1546898763 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74073020 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7a6bfff640 1 -- 172.21.15.145:0/1546898763 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7406f580 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b8ce7810 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.867+0000 7f7a6bfff640 1 -- 172.21.15.145:0/1546898763 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7406f8a0 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b8ce8420 con 0x55b4b8bec490 2024-09-10T04:52:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b88142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b88142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8ae4a00 con 0x55b4b8cf4570 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7a6bfff640 1 -- 172.21.15.145:0/1546898763 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b74076020 con 0x55b4b8bec490 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b84687640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b84687640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47274/0 (socket says 172.21.15.145:47274) 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.868+0000 7f7b84687640 1 -- 172.21.15.145:0/3095998690 learned_addr learned my addr 172.21.15.145:0/3095998690 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7a6bfff640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a6c03c780 0x7f7a6c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7a6bfff640 1 -- 172.21.15.145:0/1546898763 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f7b7406b040 con 0x55b4b8bec490 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a6c03c780 0x7f7a6c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b84687640 1 -- 172.21.15.145:0/3095998690 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8cf6f30 con 0x55b4b8cf4570 2024-09-10T04:52:14.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b84687640 1 --2- 172.21.15.145:0/3095998690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a3e0 tx=0x7f7b7c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edf4f4e12232e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a6c03c780 0x7f7a6c03ec40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b74051e80 tx=0x7f7b74050660 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7a69ffb640 1 -- 172.21.15.145:0/3095998690 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c015070 con 0x55b4b8cf4570 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7a69ffb640 1 -- 172.21.15.145:0/3095998690 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c001670 con 0x55b4b8cf4570 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7a69ffb640 1 -- 172.21.15.145:0/3095998690 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c001990 con 0x55b4b8cf4570 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b88142800 1 -- 172.21.15.145:0/3095998690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 msgr2=0x55b4b8cf6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.869+0000 7f7b88142800 1 --2- 172.21.15.145:0/3095998690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a3e0 tx=0x7f7b7c00a8a0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- 172.21.15.145:0/3095998690 shutdown_connections 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 --2- 172.21.15.145:0/3095998690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cf6960 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- 172.21.15.145:0/3095998690 >> 172.21.15.145:0/3095998690 conn(0x55b4b8becdd0 msgr2=0x55b4b8ceee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- 172.21.15.145:0/3095998690 shutdown_connections 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- 172.21.15.145:0/3095998690 wait complete. 2024-09-10T04:52:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b88142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8cf7220 con 0x55b4b8cf4570 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b84687640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b84687640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47286/0 (socket says 172.21.15.145:47286) 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.870+0000 7f7b84687640 1 -- 172.21.15.145:0/823803815 learned_addr learned my addr 172.21.15.145:0/823803815 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7b84687640 1 -- 172.21.15.145:0/823803815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8cfb9f0 con 0x55b4b8cf4570 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7b84687640 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c013040 tx=0x7f7b7c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7a63fff640 1 -- 172.21.15.145:0/823803815 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c020020 con 0x55b4b8cf4570 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7a63fff640 1 -- 172.21.15.145:0/823803815 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c010780 con 0x55b4b8cf4570 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b8cfbc80 con 0x55b4b8cf4570 2024-09-10T04:52:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7a63fff640 1 -- 172.21.15.145:0/823803815 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c015040 con 0x55b4b8cf4570 2024-09-10T04:52:14.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.871+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b8cfc600 con 0x55b4b8cf4570 2024-09-10T04:52:14.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7a63fff640 1 -- 172.21.15.145:0/823803815 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b7c023020 con 0x55b4b8cf4570 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7a63fff640 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 0x7f7a5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7a63fff640 1 -- 172.21.15.145:0/823803815 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f7b7c053310 con 0x55b4b8cf4570 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7b83685640 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 0x7f7a5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7b88142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.872+0000 7f7b88142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b83685640 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 0x7f7a5c03ec40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7b78001db0 tx=0x7f7b78001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b88142800 1 Processor -- start 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b88142800 1 -- start start 2024-09-10T04:52:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b88142800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b88142800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8cdff90 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b83e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47298/0 (socket says 172.21.15.145:47298) 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b83e86640 1 -- 172.21.15.145:0/3956219730 learned_addr learned my addr 172.21.15.145:0/3956219730 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.873+0000 7f7b83e86640 1 -- 172.21.15.145:0/3956219730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8d15d80 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f7b83e86640 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7b74065fd0 tx=0x7f7b74096210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f79f3fff640 1 -- 172.21.15.145:0/3956219730 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7409b070 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f79f3fff640 1 -- 172.21.15.145:0/3956219730 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7405a970 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b8d165b0 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f79f3fff640 1 -- 172.21.15.145:0/3956219730 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740643b0 con 0x55b4b8d15320 2024-09-10T04:52:14.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.874+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b8d16b50 con 0x55b4b8d15320 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f79f3fff640 1 -- 172.21.15.145:0/3956219730 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b7409e070 con 0x55b4b8d15320 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f79f3fff640 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 0x7f79c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f79f3fff640 1 -- 172.21.15.145:0/3956219730 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f7b74062070 con 0x55b4b8d15320 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f7b83685640 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 0x7f79c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f79f1ffb640 20 reqs_thread_entry: start 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f7b83685640 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 0x7f79c403ebf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000f60 tx=0x7f7b7800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b4b8d22c40 0x55b4b8d250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8d256f0 con 0x55b4b8d22c40 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.875+0000 7f7b84687640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b4b8d22c40 0x55b4b8d250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b84687640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b4b8d22c40 0x55b4b8d250b0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b84687640 1 -- 172.21.15.145:0/1546898763 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b7c00e070 con 0x55b4b8d22c40 2024-09-10T04:52:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b4b8d26310 0x55b4b8d287d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8d28f50 con 0x55b4b8d26310 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b4b8d26310 0x55b4b8d287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.876+0000 7f7b83e86640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b4b8d26310 0x55b4b8d287d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b83e86640 1 -- 172.21.15.145:0/1546898763 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b7409d030 con 0x55b4b8d26310 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b4b8d2acc0 0x55b4b8d2d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:3 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8d2d7b0 con 0x55b4b8d2acc0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b83685640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b4b8d2acc0 0x55b4b8d2d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b83685640 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b4b8d2acc0 0x55b4b8d2d0b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.877+0000 7f7b83685640 1 -- 172.21.15.145:0/1546898763 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(3 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b7801e700 con 0x55b4b8d2acc0 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 msgr2=0x7f7a5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 0x7f7a5c03ec40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7b78001db0 tx=0x7f7b78001310 comp rx=0 tx=0).stop 2024-09-10T04:52:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 msgr2=0x55b4b8cfb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c013040 tx=0x7f7b7c003370 comp rx=0 tx=0).stop 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 shutdown_connections 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a5c03c780 0x7f7a5c03ec40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 --2- 172.21.15.145:0/823803815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8cf4570 0x55b4b8cfb490 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 >> 172.21.15.145:0/823803815 conn(0x55b4b8becdd0 msgr2=0x55b4b8ceee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 shutdown_connections 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/823803815 wait complete. 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.878+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 msgr2=0x7f79c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 0x7f79c403ebf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000f60 tx=0x7f7b7800f000 comp rx=0 tx=0).stop 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 msgr2=0x55b4b8d15740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7b74065fd0 tx=0x7f7b74096210 comp rx=0 tx=0).stop 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 shutdown_connections 2024-09-10T04:52:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f79c403c730 0x7f79c403ebf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/3956219730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8d15320 0x55b4b8d15740 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 >> 172.21.15.145:0/3956219730 conn(0x55b4b8d0a860 msgr2=0x55b4b8d0ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 shutdown_connections 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/3956219730 wait complete. 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b4b8d26310 msgr2=0x55b4b8d287d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55b4b8d26310 0x55b4b8d287d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b4b8d22c40 msgr2=0x55b4b8d250b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55b4b8d22c40 0x55b4b8d250b0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b4b8d2acc0 msgr2=0x55b4b8d2d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55b4b8d2acc0 0x55b4b8d2d0b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a6c03c780 msgr2=0x7f7a6c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7a6c03c780 0x7f7a6c03ec40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b74051e80 tx=0x7f7b74050660 comp rx=0 tx=0).stop 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 msgr2=0x55b4b8ce7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 --2- 172.21.15.145:0/1546898763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b4b8bec490 0x55b4b8ce7020 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7b740460d0 tx=0x7f7b74002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b84687640 1 -- 172.21.15.145:0/1546898763 reap_dead start 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 shutdown_connections 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 >> 172.21.15.145:0/1546898763 conn(0x55b4b8be81e0 msgr2=0x55b4b8cd9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 shutdown_connections 2024-09-10T04:52:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.879+0000 7f7b88142800 1 -- 172.21.15.145:0/1546898763 wait complete. 2024-09-10T04:52:14.891 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","zones":[{"id":"df93e6a2-96e2-43a0-9951-5c4d01bc8580","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-10T04:52:14.891 DEBUG:tasks.util.rgw: json result: {'id': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'zones': [{'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-10T04:52:14.894 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-10T04:52:14.912 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T04:52:14.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T04:52:14.912 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-10T04:52:14.967 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:14.967 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801ed0c800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x558062313020 0x55806231bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801ed0c800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580621bce40 con 0x558062311500 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801ed0c800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x558062187680 con 0x558062313020 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801bff5640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x558062313020 0x55806231bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801bff5640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x558062313020 0x55806231bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47300/0 (socket says 172.21.15.145:47300) 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801c7f6640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x558062311500 0x558062311900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36894/0 (socket says 172.21.15.145:36894) 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.967+0000 7f801bff5640 1 -- 172.21.15.145:0/2515355272 learned_addr learned my addr 172.21.15.145:0/2515355272 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.968+0000 7f801bff5640 1 -- 172.21.15.145:0/2515355272 >> v1:172.21.15.98:6789/0 conn(0x558062311500 legacy=0x558062311900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.968+0000 7f801bff5640 1 -- 172.21.15.145:0/2515355272 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580621a36b0 con 0x558062313020 2024-09-10T04:52:14.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.969+0000 7f801bff5640 1 --2- 172.21.15.145:0/2515355272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062313020 0x55806231bb40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f801000a520 tx=0x7f8010045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf3f25e538d296a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801b7f4640 1 -- 172.21.15.145:0/2515355272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8010055070 con 0x558062313020 2024-09-10T04:52:14.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801b7f4640 1 -- 172.21.15.145:0/2515355272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80100515b0 con 0x558062313020 2024-09-10T04:52:14.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801b7f4640 1 -- 172.21.15.145:0/2515355272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80100518d0 con 0x558062313020 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 -- 172.21.15.145:0/2515355272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062313020 msgr2=0x55806231bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 --2- 172.21.15.145:0/2515355272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062313020 0x55806231bb40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f801000a520 tx=0x7f8010045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 -- 172.21.15.145:0/2515355272 shutdown_connections 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 --2- 172.21.15.145:0/2515355272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062313020 0x55806231bb40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 -- 172.21.15.145:0/2515355272 >> 172.21.15.145:0/2515355272 conn(0x55806230d250 msgr2=0x55806230f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 -- 172.21.15.145:0/2515355272 shutdown_connections 2024-09-10T04:52:14.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.970+0000 7f801ed0c800 1 -- 172.21.15.145:0/2515355272 wait complete. 2024-09-10T04:52:14.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:14.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:14.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801ed0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801ed0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5580621abdd0 con 0x558062311500 2024-09-10T04:52:14.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47302/0 (socket says 172.21.15.145:47302) 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.984+0000 7f801c7f6640 1 -- 172.21.15.145:0/2530771298 learned_addr learned my addr 172.21.15.145:0/2530771298 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.985+0000 7f801c7f6640 1 -- 172.21.15.145:0/2530771298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580621c4e10 con 0x558062311500 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.985+0000 7f801c7f6640 1 --2- 172.21.15.145:0/2530771298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b260 tx=0x7f800c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1713f71263343c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.985+0000 7f7f0a60c640 1 -- 172.21.15.145:0/2530771298 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c00be60 con 0x558062311500 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.985+0000 7f7f0a60c640 1 -- 172.21.15.145:0/2530771298 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c006070 con 0x558062311500 2024-09-10T04:52:14.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.985+0000 7f7f0a60c640 1 -- 172.21.15.145:0/2530771298 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c00e710 con 0x558062311500 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- 172.21.15.145:0/2530771298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 msgr2=0x5580624049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 --2- 172.21.15.145:0/2530771298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b260 tx=0x7f800c00b660 comp rx=0 tx=0).stop 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- 172.21.15.145:0/2530771298 shutdown_connections 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 --2- 172.21.15.145:0/2530771298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x5580624049e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- 172.21.15.145:0/2530771298 >> 172.21.15.145:0/2530771298 conn(0x55806230d250 msgr2=0x558062400360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:14.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- 172.21.15.145:0/2530771298 shutdown_connections 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- 172.21.15.145:0/2530771298 wait complete. 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x55806240c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.986+0000 7f801ed0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55806231c350 con 0x558062311500 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x55806240c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x55806240c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47318/0 (socket says 172.21.15.145:47318) 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801c7f6640 1 -- 172.21.15.145:0/1059999043 learned_addr learned my addr 172.21.15.145:0/1059999043 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801c7f6640 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806240c8d0 con 0x558062311500 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801c7f6640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x55806240c370 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x558062405970 tx=0x7f800c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f7f08e09640 1 -- 172.21.15.145:0/1059999043 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c00ee10 con 0x558062311500 2024-09-10T04:52:14.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f7f08e09640 1 -- 172.21.15.145:0/1059999043 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c00fa30 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55806240cb60 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.987+0000 7f7f08e09640 1 -- 172.21.15.145:0/1059999043 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c00fd30 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.988+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806240d560 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.988+0000 7f7f08e09640 1 -- 172.21.15.145:0/1059999043 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f800c017070 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.988+0000 7f7f08e09640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7f0403c780 0x7f7f0403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f7f08e09640 1 -- 172.21.15.145:0/1059999043 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f800c015020 con 0x558062311500 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801bff5640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7f0403c780 0x7f7f0403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558062313020 0x5580624139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062413f00 con 0x558062313020 2024-09-10T04:52:14.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801cff7640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558062313020 0x5580624139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801bff5640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7f0403c780 0x7f7f0403ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8010057000 tx=0x7f8010052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801cff7640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558062313020 0x5580624139c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801cff7640 1 -- 172.21.15.145:0/1059999043 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801400a4d0 con 0x558062313020 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5580624147b0 0x558062416c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.989+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580624173b0 con 0x5580624147b0 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.990+0000 7f801c7f6640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5580624147b0 0x558062416c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:14.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.990+0000 7f801c7f6640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5580624147b0 0x558062416c40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.990+0000 7f801c7f6640 1 -- 172.21.15.145:0/1059999043 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f800c02e070 con 0x5580624147b0 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.990+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062418c60 con 0x558062313020 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801cff7640 1 -- 172.21.15.145:0/1059999043 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f801400a4d0 con 0x558062313020 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062417e90 con 0x5580624147b0 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801c7f6640 1 -- 172.21.15.145:0/1059999043 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f800c02e070 con 0x5580624147b0 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55806241a010 0x55806241c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55806241c940 con 0x55806241a010 2024-09-10T04:52:15.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801bff5640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55806241a010 0x55806241c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.991+0000 7f801bff5640 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55806241a010 0x55806241c400 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801bff5640 1 -- 172.21.15.145:0/1059999043 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8010057030 con 0x55806241a010 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801ed0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801ed0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558062209a00 con 0x55806242a490 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47324/0 (socket says 172.21.15.145:47324) 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.992+0000 7f801c7f6640 1 -- 172.21.15.145:0/1887229993 learned_addr learned my addr 172.21.15.145:0/1887229993 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f801c7f6640 1 -- 172.21.15.145:0/1887229993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806242aef0 con 0x55806242a490 2024-09-10T04:52:15.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f801c7f6640 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f800c00bfb0 tx=0x7f800c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f7f01ffb640 1 -- 172.21.15.145:0/1887229993 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c019e30 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f7f01ffb640 1 -- 172.21.15.145:0/1887229993 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c051130 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55806242b720 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f7f01ffb640 1 -- 172.21.15.145:0/1887229993 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c01d980 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.993+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806242bcc0 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f7f01ffb640 1 -- 172.21.15.145:0/1887229993 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f800c01db20 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f7f01ffb640 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 0x7f7ef403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f7f01ffb640 1 -- 172.21.15.145:0/1887229993 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f800c03ad50 con 0x55806242a490 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f801bff5640 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 0x7f7ef403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.994+0000 7f801bff5640 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 0x7f7ef403ec40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55806240e260 tx=0x7f8010005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801ed0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801ed0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558062405230 con 0x558062436db0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47326/0 (socket says 172.21.15.145:47326) 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801c7f6640 1 -- 172.21.15.145:0/3543518396 learned_addr learned my addr 172.21.15.145:0/3543518396 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801c7f6640 1 -- 172.21.15.145:0/3543518396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580624377a0 con 0x558062436db0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f801c7f6640 1 --2- 172.21.15.145:0/3543518396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f800c017490 tx=0x7f800c027e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1664049faaf90d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f7efb7fe640 1 -- 172.21.15.145:0/3543518396 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c03e040 con 0x558062436db0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f7efb7fe640 1 -- 172.21.15.145:0/3543518396 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c01de10 con 0x558062436db0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.995+0000 7f7efb7fe640 1 -- 172.21.15.145:0/3543518396 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c027430 con 0x558062436db0 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- 172.21.15.145:0/3543518396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 msgr2=0x5580624371b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 --2- 172.21.15.145:0/3543518396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f800c017490 tx=0x7f800c027e20 comp rx=0 tx=0).stop 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- 172.21.15.145:0/3543518396 shutdown_connections 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 --2- 172.21.15.145:0/3543518396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x5580624371b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- 172.21.15.145:0/3543518396 >> 172.21.15.145:0/3543518396 conn(0x5580624331b0 msgr2=0x5580624313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- 172.21.15.145:0/3543518396 shutdown_connections 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- 172.21.15.145:0/3543518396 wait complete. 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 Processor -- start 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- start start 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801ed0c800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558062437c10 con 0x558062436db0 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801c7f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47330/0 (socket says 172.21.15.145:47330) 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.996+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 learned_addr learned my addr 172.21.15.145:0/52334368 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806243e6d0 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f801c7f6640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f800c053ea0 tx=0x7f800c027f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f7ef9ffb640 1 -- 172.21.15.145:0/52334368 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c06e070 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f7ef9ffb640 1 -- 172.21.15.145:0/52334368 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c031450 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55806243e6d0 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f7ef9ffb640 1 -- 172.21.15.145:0/52334368 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800c03e050 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.997+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55806243ebc0 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.998+0000 7f7ef9ffb640 1 -- 172.21.15.145:0/52334368 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f800c071070 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.998+0000 7f7ef9ffb640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7eec03c730 0x7f7eec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.998+0000 7f7ef9ffb640 1 -- 172.21.15.145:0/52334368 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f800c074da0 con 0x558062436db0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.998+0000 7f801bff5640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7eec03c730 0x7f7eec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801bff5640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7eec03c730 0x7f7eec03ebf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8010045be0 tx=0x7f801006d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5580624495a0 0x55806244ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55806244c1b0 con 0x5580624495a0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801cff7640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5580624495a0 0x55806244ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801cff7640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5580624495a0 0x55806244ba60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 20 realm 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:14.999+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580624488d0 con 0x5580624495a0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55806244cc40 con 0x5580624495a0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55806244da20 0x55806244fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062450470 con 0x55806244da20 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801c7f6640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55806244da20 0x55806244fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.000+0000 7f801c7f6640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55806244da20 0x55806244fe10 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f800c070030 con 0x55806244da20 2024-09-10T04:52:15.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062450cc0 con 0x5580624495a0 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 20 searching for the correct realm 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558062452a30 0x558062454e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.001+0000 7f801bff5640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558062452a30 0x558062454e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801bff5640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558062452a30 0x558062454e60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c070030 con 0x55806244da20 2024-09-10T04:52:15.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801c7f6640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f800c073060 0x7f800c054490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.002+0000 7f801cff7640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f800c073060 0x7f800c054490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f800c073060 0x7f800c054490 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f801400a4d0 con 0x7f800c073060 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.003+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.004+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801400a4d0 con 0x5580624495a0 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.005+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.006+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.007+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x5580624495a0 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.008+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x7f800c073060 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8014030040 con 0x7f800c073060 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x558062452a30 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.009+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558062455530 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062451640 con 0x5580624495a0 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8014030040 con 0x5580624495a0 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062451ee0 con 0x55806244da20 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.010+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062451280 con 0x7f800c073060 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 zone default found 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 4 Realm: () 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 zonegroup default 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580624559b0 con 0x7f800c073060 2024-09-10T04:52:15.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062457810 con 0x558062452a30 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062457cf0 con 0x558062452a30 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 started sync module instance, tier type = 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.011+0000 7f801ed0c800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.012+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062456c80 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.013+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.013+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009892892832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580624568e0 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.013+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062458c20 con 0x5580624495a0 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.014+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.014+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009892899152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580624593e0 con 0x5580624495a0 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.014+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062459f00 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.014+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009892892832] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.017+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009892899152] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.017+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.017+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009892903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062459ec0 con 0x55806244da20 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.017+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245a7a0 con 0x7f800c073060 2024-09-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.018+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.018+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009892905712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245abc0 con 0x7f800c073060 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.018+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245b410 con 0x55806244da20 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.018+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009892903376] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.020+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009892905712] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.020+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.020+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009892906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245afe0 con 0x55806244da20 2024-09-10T04:52:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.020+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245b870 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.021+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009892906768] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.021+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.021+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009892908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245bc60 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.021+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245c620 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.022+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009892908304] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.022+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.022+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009892909488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245cef0 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.022+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245d8b0 con 0x7f800c073060 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009892909488] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009892918272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245dcd0 con 0x7f800c073060 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=0 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=1 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=2 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=3 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=4 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=5 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.023+0000 7f801ed0c800 20 add_watcher() i=6 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009892918272] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801ed0c800 20 add_watcher() i=7 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801ed0c800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062460fb0 con 0x5580624495a0 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.024+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009892919696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55806245e260 con 0x5580624495a0 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009892919696] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f7ed27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 5 note: GC not initialized 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f7ed17e2640 20 reqs_thread_entry: start 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 20 Filter name: none 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f7e42ffd640 20 reqs_thread_entry: start 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.026+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062494150 con 0x5580624495a0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580624927f0 con 0x5580624495a0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.027+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580624930f0 con 0x5580624495a0 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.028+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.028+0000 7f801ed0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.028+0000 7f801ed0c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.028+0000 7f801ed0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.028+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94009893137424 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062497a90 con 0x55806244da20 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94009892906768 notify 146028888107 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55806242b720 con 0x55806244da20 2024-09-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f7efb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94009892906768 notifier 4832 bl.length()=649 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.4 [notify cookie 94009893137424 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f7efb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f7efb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f7efb7fe640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7ee0003ea0 con 0x55806244da20 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94009893137424 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f800c08c020 con 0x55806244da20 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.029+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062492c10 con 0x5580624495a0 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801ed0c800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801ed0c800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801ed0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94009893137344 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558062497e80 con 0x55806244da20 2024-09-10T04:52:15.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== watch-notify(notify (1) cookie 94009892903376 notify 146028888108 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f800c08c020 con 0x55806244da20 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f7efb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94009892903376 notifier 4832 bl.length()=177 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f7efb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f7efb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(68 notify.2 [notify cookie 94009893137344 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.030+0000 7f7efb7fe640 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7ee0003ea0 con 0x55806244da20 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.031+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.031+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== watch-notify(notify_complete (2) cookie 94009893137344 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55806242aef0 con 0x55806244da20 2024-09-10T04:52:15.046 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.031+0000 7f7ed27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.031+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009892919696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x5580624495a0 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.033+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94009892919696] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.033+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009892892832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x55806244da20 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.034+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94009892892832] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.034+0000 7f801ed0c800 20 remove_watcher() i=0 2024-09-10T04:52:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.034+0000 7f801ed0c800 2 removed watcher, disabling cache 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.034+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009892899152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x5580624495a0 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.035+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94009892899152] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x5580624495a0 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.035+0000 7f801ed0c800 20 remove_watcher() i=1 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.035+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009892903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x55806244da20 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.036+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94009892903376] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.036+0000 7f801ed0c800 20 remove_watcher() i=2 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.036+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009892905712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x7f800c073060 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.037+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94009892905712] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.037+0000 7f801ed0c800 20 remove_watcher() i=3 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.037+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009892906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x55806244da20 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.038+0000 7f801c7f6640 1 -- 172.21.15.145:0/52334368 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94009892906768] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c082040 con 0x55806244da20 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.038+0000 7f801ed0c800 20 remove_watcher() i=4 2024-09-10T04:52:15.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.038+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009892908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x558062452a30 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.039+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94009892908304] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.039+0000 7f801ed0c800 20 remove_watcher() i=5 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.039+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009892909488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x558062452a30 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.040+0000 7f801bff5640 1 -- 172.21.15.145:0/52334368 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94009892909488] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8010057030 con 0x558062452a30 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.040+0000 7f801ed0c800 20 remove_watcher() i=6 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.040+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009892918272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558062491f60 con 0x7f800c073060 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.041+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94009892918272] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8014041040 con 0x7f800c073060 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.041+0000 7f801ed0c800 20 remove_watcher() i=7 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55806244da20 msgr2=0x55806244fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55806244da20 0x55806244fe10 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5580624495a0 msgr2=0x55806244ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5580624495a0 0x55806244ba60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f800c073060 msgr2=0x7f800c054490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f800c073060 0x7f800c054490 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558062452a30 msgr2=0x558062454e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x558062452a30 0x558062454e60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7eec03c730 msgr2=0x7f7eec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7eec03c730 0x7f7eec03ebf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8010045be0 tx=0x7f801006d040 comp rx=0 tx=0).stop 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 msgr2=0x55806243e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801cff7640 1 -- 172.21.15.145:0/52334368 reap_dead start 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f800c053ea0 tx=0x7f800c027f30 comp rx=0 tx=0).stop 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 shutdown_connections 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/52334368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062436db0 0x55806243e170 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 >> 172.21.15.145:0/52334368 conn(0x5580624331b0 msgr2=0x5580624313c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 shutdown_connections 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/52334368 wait complete. 2024-09-10T04:52:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 msgr2=0x7f7ef403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 0x7f7ef403ec40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55806240e260 tx=0x7f8010005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 msgr2=0x55806242a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f800c00bfb0 tx=0x7f800c01beb0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 shutdown_connections 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7ef403c780 0x7f7ef403ec40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1887229993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55806242a490 0x55806242a8b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 >> 172.21.15.145:0/1887229993 conn(0x55806241e840 msgr2=0x55806241ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 shutdown_connections 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.042+0000 7f801ed0c800 1 -- 172.21.15.145:0/1887229993 wait complete. 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5580624147b0 msgr2=0x558062416c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5580624147b0 0x558062416c40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558062313020 msgr2=0x5580624139c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x558062313020 0x5580624139c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55806241a010 msgr2=0x55806241c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55806241a010 0x55806241c400 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7f0403c780 msgr2=0x7f7f0403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f7f0403c780 0x7f7f0403ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8010057000 tx=0x7f8010052000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 msgr2=0x55806240c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 --2- 172.21.15.145:0/1059999043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558062311500 0x55806240c370 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x558062405970 tx=0x7f800c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801cff7640 1 -- 172.21.15.145:0/1059999043 reap_dead start 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 shutdown_connections 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 >> 172.21.15.145:0/1059999043 conn(0x55806230d250 msgr2=0x558062405cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 shutdown_connections 2024-09-10T04:52:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.043+0000 7f801ed0c800 1 -- 172.21.15.145:0/1059999043 wait complete. 2024-09-10T04:52:15.057 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.057 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.058 ERROR:root:0 2024-09-10T04:52:15.059 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:15.065 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002d0b5686d28ec986-0066dfd07f-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:52:15.066 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-10T04:52:15.075 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:15.075 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-10T04:52:15.087 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-10T04:52:15.087 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-10T04:52:15.102 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T04:52:15.102 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T04:52:15.109 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-10T04:52:15.109 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:15.113 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:15.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-10T04:52:15.117 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:15.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:15.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:15.117 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-10T04:52:15.164 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.164 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.163+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.163+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.163+0000 7f331180f800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557be82e0e00 0x557be82e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f331180f800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557be818be40 con 0x557be82e2040 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f331180f800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x557be8156680 con 0x557be82e0e00 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f330cf48640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557be82e0e00 0x557be82e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f330cf48640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x557be82e0e00 0x557be82e1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47338/0 (socket says 172.21.15.145:47338) 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f330cf48640 1 -- 172.21.15.145:0/2644942806 learned_addr learned my addr 172.21.15.145:0/2644942806 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f3307fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x557be82e2040 0x557be82e6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36896/0 (socket says 172.21.15.145:36896) 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f330cf48640 1 -- 172.21.15.145:0/2644942806 >> v1:172.21.15.98:6789/0 conn(0x557be82e2040 legacy=0x557be82e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f330cf48640 1 -- 172.21.15.145:0/2644942806 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be81726b0 con 0x557be82e0e00 2024-09-10T04:52:15.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.164+0000 7f33077fe640 1 -- 172.21.15.145:0/2644942806 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516184303 0 0) 0x557be818be40 con 0x557be82e2040 2024-09-10T04:52:15.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f330cf48640 1 --2- 172.21.15.145:0/2644942806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be82e1b00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f330000a520 tx=0x7f3300045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efefb2250379082 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f33077fe640 1 -- 172.21.15.145:0/2644942806 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300055070 con 0x557be82e0e00 2024-09-10T04:52:15.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f33077fe640 1 -- 172.21.15.145:0/2644942806 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33000515b0 con 0x557be82e0e00 2024-09-10T04:52:15.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f33077fe640 1 -- 172.21.15.145:0/2644942806 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33000518d0 con 0x557be82e0e00 2024-09-10T04:52:15.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f331180f800 1 -- 172.21.15.145:0/2644942806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 msgr2=0x557be82e1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.166+0000 7f331180f800 1 --2- 172.21.15.145:0/2644942806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be82e1b00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f330000a520 tx=0x7f3300045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.167+0000 7f331180f800 1 -- 172.21.15.145:0/2644942806 shutdown_connections 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.167+0000 7f331180f800 1 --2- 172.21.15.145:0/2644942806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be82e1b00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.167+0000 7f331180f800 1 -- 172.21.15.145:0/2644942806 >> 172.21.15.145:0/2644942806 conn(0x557be82dc1d0 msgr2=0x557be82de630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.167+0000 7f331180f800 1 -- 172.21.15.145:0/2644942806 shutdown_connections 2024-09-10T04:52:15.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.167+0000 7f331180f800 1 -- 172.21.15.145:0/2644942806 wait complete. 2024-09-10T04:52:15.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.180+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f331180f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f331180f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557be817add0 con 0x557be82e0e00 2024-09-10T04:52:15.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47354/0 (socket says 172.21.15.145:47354) 2024-09-10T04:52:15.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f330cf48640 1 -- 172.21.15.145:0/1821601500 learned_addr learned my addr 172.21.15.145:0/1821601500 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.181+0000 7f330cf48640 1 -- 172.21.15.145:0/1821601500 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be8193e10 con 0x557be82e0e00 2024-09-10T04:52:15.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.182+0000 7f330cf48640 1 --2- 172.21.15.145:0/1821601500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3300025da0 tx=0x7f3300051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132a95dc54ff7c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.182+0000 7f31fae05640 1 -- 172.21.15.145:0/1821601500 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300051950 con 0x557be82e0e00 2024-09-10T04:52:15.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.182+0000 7f31fae05640 1 -- 172.21.15.145:0/1821601500 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300051af0 con 0x557be82e0e00 2024-09-10T04:52:15.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.182+0000 7f31fae05640 1 -- 172.21.15.145:0/1821601500 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300051dd0 con 0x557be82e0e00 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- 172.21.15.145:0/1821601500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 msgr2=0x557be8254d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 --2- 172.21.15.145:0/1821601500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3300025da0 tx=0x7f3300051000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- 172.21.15.145:0/1821601500 shutdown_connections 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 --2- 172.21.15.145:0/1821601500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be8254d40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- 172.21.15.145:0/1821601500 >> 172.21.15.145:0/1821601500 conn(0x557be82dc1d0 msgr2=0x557be83cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- 172.21.15.145:0/1821601500 shutdown_connections 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- 172.21.15.145:0/1821601500 wait complete. 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be83d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f331180f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557be82e2730 con 0x557be82e0e00 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be83d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be83d8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47370/0 (socket says 172.21.15.145:47370) 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.183+0000 7f330cf48640 1 -- 172.21.15.145:0/62746394 learned_addr learned my addr 172.21.15.145:0/62746394 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f330cf48640 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be83d91b0 con 0x557be82e0e00 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f330cf48640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be83d8c50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f330000a520 tx=0x7f3300002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f31f9602640 1 -- 172.21.15.145:0/62746394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330005a580 con 0x557be82e0e00 2024-09-10T04:52:15.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f31f9602640 1 -- 172.21.15.145:0/62746394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300073070 con 0x557be82e0e00 2024-09-10T04:52:15.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f31f9602640 1 -- 172.21.15.145:0/62746394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330005a890 con 0x557be82e0e00 2024-09-10T04:52:15.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557be83d9440 con 0x557be82e0e00 2024-09-10T04:52:15.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.184+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be83da050 con 0x557be82e0e00 2024-09-10T04:52:15.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f31f9602640 1 -- 172.21.15.145:0/62746394 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3300058070 con 0x557be82e0e00 2024-09-10T04:52:15.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f31f9602640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31f403c780 0x7f31f403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f31f9602640 1 -- 172.21.15.145:0/62746394 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f330006b040 con 0x557be82e0e00 2024-09-10T04:52:15.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f3307fff640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31f403c780 0x7f31f403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be82e2040 0x557be83e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.185+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be83e07e0 con 0x557be82e2040 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f330d749640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be82e2040 0x557be83e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f3307fff640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31f403c780 0x7f31f403ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f330d749640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be82e2040 0x557be83e02a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f330d749640 1 -- 172.21.15.145:0/62746394 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330800a4d0 con 0x557be82e2040 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be83e10e0 0x557be83e3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be83e3ce0 con 0x557be83e10e0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.186+0000 7f330cf48640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be83e10e0 0x557be83e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.187+0000 7f330cf48640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be83e10e0 0x557be83e3570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.187+0000 7f330cf48640 1 -- 172.21.15.145:0/62746394 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3300091040 con 0x557be83e10e0 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.187+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be83e5590 con 0x557be82e2040 2024-09-10T04:52:15.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.187+0000 7f330d749640 1 -- 172.21.15.145:0/62746394 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f330800a4d0 con 0x557be82e2040 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.187+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be83e47c0 con 0x557be83e10e0 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f330cf48640 1 -- 172.21.15.145:0/62746394 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3300091040 con 0x557be83e10e0 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557be83e6940 0x557be83e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be83e9270 con 0x557be83e6940 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f3307fff640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557be83e6940 0x557be83e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f3307fff640 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557be83e6940 0x557be83e8d30 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.188+0000 7f3307fff640 1 -- 172.21.15.145:0/62746394 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32f800f670 con 0x557be83e6940 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f331180f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f331180f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557be81d8a00 con 0x557be83f6dc0 2024-09-10T04:52:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47380/0 (socket says 172.21.15.145:47380) 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.189+0000 7f330cf48640 1 -- 172.21.15.145:0/3696494886 learned_addr learned my addr 172.21.15.145:0/3696494886 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f330cf48640 1 -- 172.21.15.145:0/3696494886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be83f7820 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f330cf48640 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3300079fd0 tx=0x7f330005ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f31f27fc640 1 -- 172.21.15.145:0/3696494886 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330009b020 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f31f27fc640 1 -- 172.21.15.145:0/3696494886 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330008ed00 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557be83f8050 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f31f27fc640 1 -- 172.21.15.145:0/3696494886 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330008efe0 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.190+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be83f85f0 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f31f27fc640 1 -- 172.21.15.145:0/3696494886 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f330008b030 con 0x557be83f6dc0 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f31f27fc640 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 0x7f31e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f31f27fc640 1 -- 172.21.15.145:0/3696494886 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3300062070 con 0x557be83f6dc0 2024-09-10T04:52:15.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f3307fff640 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 0x7f31e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f3307fff640 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 0x7f31e403ec40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557be83dabc0 tx=0x7f32f8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f331180f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.191+0000 7f331180f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557be83d4160 con 0x557be84036a0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47396/0 (socket says 172.21.15.145:47396) 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f330cf48640 1 -- 172.21.15.145:0/2279568179 learned_addr learned my addr 172.21.15.145:0/2279568179 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f330cf48640 1 -- 172.21.15.145:0/2279568179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be8404070 con 0x557be84036a0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f330cf48640 1 --2- 172.21.15.145:0/2279568179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3300095ce0 tx=0x7f33000826f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3441debad02eda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f31e3fff640 1 -- 172.21.15.145:0/2279568179 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330005e0c0 con 0x557be84036a0 2024-09-10T04:52:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f31e3fff640 1 -- 172.21.15.145:0/2279568179 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330005e260 con 0x557be84036a0 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.192+0000 7f31e3fff640 1 -- 172.21.15.145:0/2279568179 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300097bc0 con 0x557be84036a0 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- 172.21.15.145:0/2279568179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 msgr2=0x557be8403a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 --2- 172.21.15.145:0/2279568179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3300095ce0 tx=0x7f33000826f0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- 172.21.15.145:0/2279568179 shutdown_connections 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 --2- 172.21.15.145:0/2279568179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be8403a80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- 172.21.15.145:0/2279568179 >> 172.21.15.145:0/2279568179 conn(0x557be83ffaa0 msgr2=0x557be83fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- 172.21.15.145:0/2279568179 shutdown_connections 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- 172.21.15.145:0/2279568179 wait complete. 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 Processor -- start 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- start start 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f331180f800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557be8404500 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f330cf48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47410/0 (socket says 172.21.15.145:47410) 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.193+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 learned_addr learned my addr 172.21.15.145:0/1820270566 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be840b010 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f330cf48640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f33000025a0 tx=0x7f3300067ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f31e27fc640 1 -- 172.21.15.145:0/1820270566 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330005e0c0 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f31e27fc640 1 -- 172.21.15.145:0/1820270566 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300082e30 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557be840b010 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f31e27fc640 1 -- 172.21.15.145:0/1820270566 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330006d780 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.194+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be840b010 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.195+0000 7f31e27fc640 1 -- 172.21.15.145:0/1820270566 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f33000c4030 con 0x557be84036a0 2024-09-10T04:52:15.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.195+0000 7f31e27fc640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31d803c780 0x7f31d803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.195+0000 7f31e27fc640 1 -- 172.21.15.145:0/1820270566 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f33000c2070 con 0x557be84036a0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.195+0000 7f3307fff640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31d803c780 0x7f31d803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f3307fff640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31d803c780 0x7f31d803ec40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f32f800ffd0 tx=0x7f32f8023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be8416060 0x557be8418520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8418c70 con 0x557be8416060 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f330d749640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be8416060 0x557be8418520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.196+0000 7f330d749640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be8416060 0x557be8418520 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 realm 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8415390 con 0x557be8416060 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8419700 con 0x557be8416060 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be841a4e0 0x557be841c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be841cf30 con 0x557be841a4e0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f330cf48640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be841a4e0 0x557be841c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.197+0000 7f330cf48640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be841a4e0 0x557be841c8d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be841d780 con 0x557be8416060 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 20 searching for the correct realm 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557be841f4f0 0x557be8421920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.198+0000 7f3307fff640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557be841f4f0 0x557be8421920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f3307fff640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557be841f4f0 0x557be8421920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f330cf48640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33000d1040 0x7f330006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.199+0000 7f330d749640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33000d1040 0x7f330006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33000d1040 0x7f330006ea40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f330800a4d0 con 0x7f33000d1040 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.200+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.201+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330800a4d0 con 0x557be8416060 2024-09-10T04:52:15.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.202+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.203+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.204+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be8416060 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.205+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308030040 con 0x7f33000d1040 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841f4f0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.206+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557be8421ff0 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be841e130 con 0x557be8416060 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3308030040 con 0x557be8416060 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be841e9d0 con 0x557be841a4e0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.207+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be841dd70 con 0x7f33000d1040 2024-09-10T04:52:15.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 zone default found 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 4 Realm: () 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 zonegroup default 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be84224e0 con 0x7f33000d1040 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8424340 con 0x557be841f4f0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8424850 con 0x557be841f4f0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.208+0000 7f331180f800 20 started sync module instance, tier type = 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.209+0000 7f331180f800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.209+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be84237b0 con 0x557be841a4e0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.210+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.210+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93990665993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8425160 con 0x557be841a4e0 2024-09-10T04:52:15.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.210+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be84259b0 con 0x557be8416060 2024-09-10T04:52:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.211+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93990665993120] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.211+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.211+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93990665997488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8425a10 con 0x557be8416060 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.211+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8426520 con 0x557be841a4e0 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.212+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93990665997488] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.212+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.212+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93990666002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be84264e0 con 0x557be841a4e0 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.212+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8426fd0 con 0x7f33000d1040 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.214+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93990666002384] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.214+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.214+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93990666005216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8426fd0 con 0x7f33000d1040 2024-09-10T04:52:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.214+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8427a20 con 0x557be841a4e0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.215+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93990666005216] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.215+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.215+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93990665999616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be84279e0 con 0x557be841a4e0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.215+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8428430 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.216+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.216+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93990666010496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8428cd0 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.216+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93990665999616] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.216+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8429770 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.217+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93990666010496] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.217+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.217+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93990666015296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8429b60 con 0x557be841f4f0 2024-09-10T04:52:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.217+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be842a3b0 con 0x7f33000d1040 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.218+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93990666015296] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.218+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93990666017632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be842a7a0 con 0x7f33000d1040 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=0 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=1 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=2 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=3 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=4 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=5 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=6 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93990666017632] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 20 add_watcher() i=7 2024-09-10T04:52:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.219+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be842d800 con 0x557be8416060 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.220+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.220+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93990666018688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be842ac00 con 0x557be8416060 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.221+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93990666018688] v34'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.221+0000 7f31c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.221+0000 7f331180f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.221+0000 7f331180f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.221+0000 7f331180f800 5 note: GC not initialized 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f31c1fe3640 20 reqs_thread_entry: start 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 20 Filter name: none 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f31337fe640 20 reqs_thread_entry: start 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8460930 con 0x557be8416060 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.222+0000 7f331180f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.223+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be8467070 con 0x557be8416060 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f331180f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f331180f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f331180f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93990666267248 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557be8462710 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93990665999616 notify 146028888110 ret 0) ==== 678+0+0 (crc 0 0 0) 0x557be83f8050 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f31e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 93990665999616 notifier 4839 bl.length()=636 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93990666267248 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f31e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f31e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f31e3fff640 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f31d0003ea0 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.224+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.225+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93990666267248 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557be83f7820 con 0x557be841a4e0 2024-09-10T04:52:15.237 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.225+0000 7f31c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.225+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93990666018688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be8416060 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.226+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93990666018688] v34'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.226+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93990665993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be841a4e0 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.228+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93990665993120] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.228+0000 7f331180f800 20 remove_watcher() i=0 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.228+0000 7f331180f800 2 removed watcher, disabling cache 2024-09-10T04:52:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.228+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93990665997488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be8416060 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.229+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93990665997488] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x557be8416060 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.229+0000 7f331180f800 20 remove_watcher() i=1 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.229+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93990666002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be841a4e0 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.230+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93990666002384] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.230+0000 7f331180f800 20 remove_watcher() i=2 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.230+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93990666005216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x7f33000d1040 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.231+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93990666005216] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.231+0000 7f331180f800 20 remove_watcher() i=3 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.231+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93990665999616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be841a4e0 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.232+0000 7f330cf48640 1 -- 172.21.15.145:0/1820270566 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93990665999616] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330009d020 con 0x557be841a4e0 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.232+0000 7f331180f800 20 remove_watcher() i=4 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.232+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93990666010496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be841f4f0 2024-09-10T04:52:15.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.233+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93990666010496] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.233+0000 7f331180f800 20 remove_watcher() i=5 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.233+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93990666015296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x557be841f4f0 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.234+0000 7f3307fff640 1 -- 172.21.15.145:0/1820270566 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93990666015296] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x557be841f4f0 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.234+0000 7f331180f800 20 remove_watcher() i=6 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.234+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93990666017632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557be845e760 con 0x7f33000d1040 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93990666017632] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308041040 con 0x7f33000d1040 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 20 remove_watcher() i=7 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be841a4e0 msgr2=0x557be841c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be841a4e0 0x557be841c8d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be8416060 msgr2=0x557be8418520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be8416060 0x557be8418520 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33000d1040 msgr2=0x7f330006ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f33000d1040 0x7f330006ea40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557be841f4f0 msgr2=0x557be8421920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x557be841f4f0 0x557be8421920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31d803c780 msgr2=0x7f31d803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31d803c780 0x7f31d803ec40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f32f800ffd0 tx=0x7f32f8023040 comp rx=0 tx=0).stop 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 msgr2=0x557be840aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f330d749640 1 -- 172.21.15.145:0/1820270566 reap_dead start 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f33000025a0 tx=0x7f3300067ef0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 shutdown_connections 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 --2- 172.21.15.145:0/1820270566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be84036a0 0x557be840aab0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 >> 172.21.15.145:0/1820270566 conn(0x557be83ffaa0 msgr2=0x557be83fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 shutdown_connections 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.235+0000 7f331180f800 1 -- 172.21.15.145:0/1820270566 wait complete. 2024-09-10T04:52:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 msgr2=0x7f31e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 0x7f31e403ec40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557be83dabc0 tx=0x7f32f8006000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 msgr2=0x557be83f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3300079fd0 tx=0x7f330005ae00 comp rx=0 tx=0).stop 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 shutdown_connections 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31e403c780 0x7f31e403ec40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/3696494886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be83f6dc0 0x557be83f71e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 >> 172.21.15.145:0/3696494886 conn(0x557be83eb170 msgr2=0x557be83eb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 shutdown_connections 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/3696494886 wait complete. 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be83e10e0 msgr2=0x557be83e3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x557be83e10e0 0x557be83e3570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be82e2040 msgr2=0x557be83e02a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x557be82e2040 0x557be83e02a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557be83e6940 msgr2=0x557be83e8d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x557be83e6940 0x557be83e8d30 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31f403c780 msgr2=0x7f31f403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f31f403c780 0x7f31f403ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f80013b0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 msgr2=0x557be83d8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 --2- 172.21.15.145:0/62746394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557be82e0e00 0x557be83d8c50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f330000a520 tx=0x7f3300002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f330d749640 1 -- 172.21.15.145:0/62746394 reap_dead start 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 shutdown_connections 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 >> 172.21.15.145:0/62746394 conn(0x557be82dc1d0 msgr2=0x557be83ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 shutdown_connections 2024-09-10T04:52:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.236+0000 7f331180f800 1 -- 172.21.15.145:0/62746394 wait complete. 2024-09-10T04:52:15.248 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.248 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.248 ERROR:root:0 2024-09-10T04:52:15.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T04:52:15.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T04:52:15.249 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-10T04:52:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651fa14800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f039d98ae0 0x55f039e2cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651fa14800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f039ccde40 con 0x55f039d97fd0 2024-09-10T04:52:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651fa14800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f039c98680 con 0x55f039d98ae0 2024-09-10T04:52:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651a8ca640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f039d98ae0 0x55f039e2cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651a8ca640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f039d98ae0 0x55f039e2cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47422/0 (socket says 172.21.15.145:47422) 2024-09-10T04:52:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651b0cb640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55f039d97fd0 0x55f039d983d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36898/0 (socket says 172.21.15.145:36898) 2024-09-10T04:52:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651a8ca640 1 -- 172.21.15.145:0/894032336 learned_addr learned my addr 172.21.15.145:0/894032336 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651a8ca640 1 -- 172.21.15.145:0/894032336 >> v1:172.21.15.98:6789/0 conn(0x55f039d97fd0 legacy=0x55f039d983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.302+0000 7f651a8ca640 1 -- 172.21.15.145:0/894032336 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039cb46b0 con 0x55f039d98ae0 2024-09-10T04:52:15.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.304+0000 7f651a8ca640 1 --2- 172.21.15.145:0/894032336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d98ae0 0x55f039e2cb50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f651000a520 tx=0x7f6510045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4487f6316385fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.304+0000 7f651a0c9640 1 -- 172.21.15.145:0/894032336 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6510055070 con 0x55f039d98ae0 2024-09-10T04:52:15.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.304+0000 7f651a0c9640 1 -- 172.21.15.145:0/894032336 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65100515b0 con 0x55f039d98ae0 2024-09-10T04:52:15.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651a0c9640 1 -- 172.21.15.145:0/894032336 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65100518d0 con 0x55f039d98ae0 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 -- 172.21.15.145:0/894032336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d98ae0 msgr2=0x55f039e2cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 --2- 172.21.15.145:0/894032336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d98ae0 0x55f039e2cb50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f651000a520 tx=0x7f6510045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 -- 172.21.15.145:0/894032336 shutdown_connections 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 --2- 172.21.15.145:0/894032336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d98ae0 0x55f039e2cb50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 -- 172.21.15.145:0/894032336 >> 172.21.15.145:0/894032336 conn(0x55f039e1f420 msgr2=0x55f039e21880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 -- 172.21.15.145:0/894032336 shutdown_connections 2024-09-10T04:52:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.305+0000 7f651fa14800 1 -- 172.21.15.145:0/894032336 wait complete. 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651fa14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651fa14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f039cbcdd0 con 0x55f039d97fd0 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47424/0 (socket says 172.21.15.145:47424) 2024-09-10T04:52:15.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.319+0000 7f651b0cb640 1 -- 172.21.15.145:0/3211798685 learned_addr learned my addr 172.21.15.145:0/3211798685 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.320+0000 7f651b0cb640 1 -- 172.21.15.145:0/3211798685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039cd5e10 con 0x55f039d97fd0 2024-09-10T04:52:15.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.320+0000 7f651b0cb640 1 --2- 172.21.15.145:0/3211798685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b260 tx=0x7f650c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb2ab310f4145e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.320+0000 7f640960a640 1 -- 172.21.15.145:0/3211798685 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c00be60 con 0x55f039d97fd0 2024-09-10T04:52:15.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.320+0000 7f640960a640 1 -- 172.21.15.145:0/3211798685 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c006070 con 0x55f039d97fd0 2024-09-10T04:52:15.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.320+0000 7f640960a640 1 -- 172.21.15.145:0/3211798685 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c00e710 con 0x55f039d97fd0 2024-09-10T04:52:15.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- 172.21.15.145:0/3211798685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 msgr2=0x55f039f158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 --2- 172.21.15.145:0/3211798685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b260 tx=0x7f650c00b660 comp rx=0 tx=0).stop 2024-09-10T04:52:15.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- 172.21.15.145:0/3211798685 shutdown_connections 2024-09-10T04:52:15.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 --2- 172.21.15.145:0/3211798685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f158a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- 172.21.15.145:0/3211798685 >> 172.21.15.145:0/3211798685 conn(0x55f039e1f420 msgr2=0x55f039f11220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- 172.21.15.145:0/3211798685 shutdown_connections 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- 172.21.15.145:0/3211798685 wait complete. 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f1d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651fa14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f039e2d360 con 0x55f039d97fd0 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f1d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f1d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47428/0 (socket says 172.21.15.145:47428) 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.321+0000 7f651b0cb640 1 -- 172.21.15.145:0/1159596822 learned_addr learned my addr 172.21.15.145:0/1159596822 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f651b0cb640 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039f1d750 con 0x55f039d97fd0 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f651b0cb640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f1d1f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55f039f16830 tx=0x7f650c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f6407e07640 1 -- 172.21.15.145:0/1159596822 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c00f810 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f6407e07640 1 -- 172.21.15.145:0/1159596822 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c00f9b0 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f039f1d9e0 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f6407e07640 1 -- 172.21.15.145:0/1159596822 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c00fcd0 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.322+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f039f1e3e0 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f6407e07640 1 -- 172.21.15.145:0/1159596822 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f650c017070 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f6407e07640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f640003c730 0x7f640003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f6407e07640 1 -- 172.21.15.145:0/1159596822 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f650c015020 con 0x55f039d97fd0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f640003c730 0x7f640003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039d98ae0 0x55f039f24840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f24d80 con 0x55f039d98ae0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f651b8cc640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039d98ae0 0x55f039f24840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.323+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f640003c730 0x7f640003ebf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6510057000 tx=0x7f6510052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.324+0000 7f651b8cc640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039d98ae0 0x55f039f24840 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.324+0000 7f651b8cc640 1 -- 172.21.15.145:0/1159596822 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039d98ae0 2024-09-10T04:52:15.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.324+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f25630 0x55f039f27af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.324+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f28260 con 0x55f039f25630 2024-09-10T04:52:15.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.324+0000 7f651b0cb640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f25630 0x55f039f27af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651b0cb640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f25630 0x55f039f27af0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651b0cb640 1 -- 172.21.15.145:0/1159596822 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f650c02e070 con 0x55f039f25630 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f29b10 con 0x55f039d98ae0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651b8cc640 1 -- 172.21.15.145:0/1159596822 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039d98ae0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f28d40 con 0x55f039f25630 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.325+0000 7f651b0cb640 1 -- 172.21.15.145:0/1159596822 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f650c02e070 con 0x55f039f25630 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f039f2aec0 0x55f039f2d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f2d7f0 con 0x55f039f2aec0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f039f2aec0 0x55f039f2d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f039f2aec0 0x55f039f2d2b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651a8ca640 1 -- 172.21.15.145:0/1159596822 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6510057030 con 0x55f039f2aec0 2024-09-10T04:52:15.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.326+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651fa14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651fa14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f039d1aa00 con 0x55f039f3b370 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47436/0 (socket says 172.21.15.145:47436) 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651b0cb640 1 -- 172.21.15.145:0/1605444544 learned_addr learned my addr 172.21.15.145:0/1605444544 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651b0cb640 1 -- 172.21.15.145:0/1605444544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039f3bdd0 con 0x55f039f3b370 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.327+0000 7f651b0cb640 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f650c000c00 tx=0x7f650c017e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f6405602640 1 -- 172.21.15.145:0/1605444544 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c019dc0 con 0x55f039f3b370 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f6405602640 1 -- 172.21.15.145:0/1605444544 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c01b760 con 0x55f039f3b370 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f039f3c600 con 0x55f039f3b370 2024-09-10T04:52:15.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f6405602640 1 -- 172.21.15.145:0/1605444544 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c01ba40 con 0x55f039f3b370 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f039f3cba0 con 0x55f039f3b370 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.328+0000 7f6405602640 1 -- 172.21.15.145:0/1605444544 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f650c044a10 con 0x55f039f3b370 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f6405602640 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 0x7f63f403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f6405602640 1 -- 172.21.15.145:0/1605444544 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f650c03bd90 con 0x55f039f3b370 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 0x7f63f403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651a8ca640 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 0x7f63f403ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f039f1f120 tx=0x7f6510005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651fa14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651fa14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f039f160f0 con 0x55f039f47c10 2024-09-10T04:52:15.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47444/0 (socket says 172.21.15.145:47444) 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651b0cb640 1 -- 172.21.15.145:0/987381370 learned_addr learned my addr 172.21.15.145:0/987381370 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.329+0000 7f651b0cb640 1 -- 172.21.15.145:0/987381370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039f48600 con 0x55f039f47c10 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651b0cb640 1 --2- 172.21.15.145:0/987381370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f650c0307a0 tx=0x7f650c00a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e559238ee8fbfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f63feffd640 1 -- 172.21.15.145:0/987381370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c03f040 con 0x55f039f47c10 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f63feffd640 1 -- 172.21.15.145:0/987381370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c031480 con 0x55f039f47c10 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f63feffd640 1 -- 172.21.15.145:0/987381370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c020e10 con 0x55f039f47c10 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 -- 172.21.15.145:0/987381370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 msgr2=0x55f039f48010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 --2- 172.21.15.145:0/987381370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f650c0307a0 tx=0x7f650c00a2f0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 -- 172.21.15.145:0/987381370 shutdown_connections 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 --2- 172.21.15.145:0/987381370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f48010 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 -- 172.21.15.145:0/987381370 >> 172.21.15.145:0/987381370 conn(0x55f039f44010 msgr2=0x55f039f42250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 -- 172.21.15.145:0/987381370 shutdown_connections 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.330+0000 7f651fa14800 1 -- 172.21.15.145:0/987381370 wait complete. 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651fa14800 1 Processor -- start 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651fa14800 1 -- start start 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651fa14800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651fa14800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f039f48a70 con 0x55f039f47c10 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651b0cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47446/0 (socket says 172.21.15.145:47446) 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 learned_addr learned my addr 172.21.15.145:0/3354238267 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f039f4f580 con 0x55f039f47c10 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.331+0000 7f651b0cb640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a3e0 tx=0x7f650c00a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.332+0000 7f63fd7fa640 1 -- 172.21.15.145:0/3354238267 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c03f050 con 0x55f039f47c10 2024-09-10T04:52:15.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.332+0000 7f63fd7fa640 1 -- 172.21.15.145:0/3354238267 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650c01a5b0 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.332+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f039f4f580 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.332+0000 7f63fd7fa640 1 -- 172.21.15.145:0/3354238267 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c019510 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.332+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f039f4f580 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f63fd7fa640 1 -- 172.21.15.145:0/3354238267 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f650c030be0 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f63fd7fa640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63e403c780 0x7f63e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f63fd7fa640 1 -- 172.21.15.145:0/3354238267 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f650c068030 con 0x55f039f47c10 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651a8ca640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63e403c780 0x7f63e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039f5a600 0x55f039f5cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651a8ca640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63e403c780 0x7f63e403ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6510000c00 tx=0x7f651006d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f5d210 con 0x55f039f5a600 2024-09-10T04:52:15.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.333+0000 7f651b8cc640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039f5a600 0x55f039f5cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651b8cc640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039f5a600 0x55f039f5cac0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 realm 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f59930 con 0x55f039f5a600 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f5dca0 con 0x55f039f5a600 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f5ea80 0x55f039f60e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.334+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f61500 con 0x55f039f5ea80 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651b0cb640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f5ea80 0x55f039f60e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651b0cb640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f5ea80 0x55f039f60e70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f61d50 con 0x55f039f5a600 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 20 searching for the correct realm 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.335+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f039f63ac0 0x55f039f65f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.336+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.336+0000 7f651a8ca640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f039f63ac0 0x55f039f65f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.336+0000 7f651a8ca640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f039f63ac0 0x55f039f65f10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.336+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.336+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b0cb640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f650c052c60 0x7f650c0608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b8cc640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f650c052c60 0x7f650c0608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b8cc640 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f650c052c60 0x7f650c0608b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f651400a4d0 con 0x7f650c052c60 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.337+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.338+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f651400a4d0 con 0x55f039f5a600 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.339+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.340+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.341+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5a600 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.342+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x7f650c052c60 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6514030040 con 0x7f650c052c60 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.343+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f63ac0 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f039f665e0 con 0x55f039f5ea80 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.344+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f626a0 con 0x55f039f5a600 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6514030040 con 0x55f039f5a600 2024-09-10T04:52:15.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f622e0 con 0x55f039f5ea80 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f63040 con 0x7f650c052c60 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 zone default found 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 4 Realm: () 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 zonegroup default 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f66a60 con 0x7f650c052c60 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.345+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f68840 con 0x55f039f63ac0 2024-09-10T04:52:15.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f68ca0 con 0x55f039f63ac0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 started sync module instance, tier type = 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.346+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f67ce0 con 0x55f039f5ea80 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.348+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.348+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94490252968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f67940 con 0x55f039f5ea80 2024-09-10T04:52:15.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.348+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69bd0 con 0x55f039f5a600 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.348+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94490252968144] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.349+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.349+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94490252972288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69bd0 con 0x55f039f5a600 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.349+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6a6a0 con 0x55f039f5ea80 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.350+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94490252972288] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.350+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.350+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94490252976528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69bd0 con 0x55f039f5ea80 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.350+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6b170 con 0x7f650c052c60 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.351+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94490252976528] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.351+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.351+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94490252979296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69bd0 con 0x7f650c052c60 2024-09-10T04:52:15.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.351+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6bbc0 con 0x55f039f5ea80 2024-09-10T04:52:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.352+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94490252979296] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.352+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.352+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94490252981968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69bd0 con 0x55f039f5ea80 2024-09-10T04:52:15.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.352+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6c600 con 0x55f039f63ac0 2024-09-10T04:52:15.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.353+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94490252981968] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.353+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.353+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94490252973856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f69b40 con 0x55f039f63ac0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.353+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6d4c0 con 0x55f039f63ac0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.354+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94490252973856] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.354+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.354+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94490252986864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6dd10 con 0x55f039f63ac0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.355+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6e5c0 con 0x7f650c052c60 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94490252992688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6ee60 con 0x7f650c052c60 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=0 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=1 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=2 2024-09-10T04:52:15.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=3 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=4 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=5 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94490252986864] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.356+0000 7f651fa14800 20 add_watcher() i=6 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94490252992688] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651fa14800 20 add_watcher() i=7 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651fa14800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6d860 con 0x55f039f5a600 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.357+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94490252994912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039f6d860 con 0x55f039f5a600 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.358+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94490252994912] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.358+0000 7f63d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.358+0000 7f651fa14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.358+0000 7f651fa14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.358+0000 7f651fa14800 5 note: GC not initialized 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f63d0fe1640 20 reqs_thread_entry: start 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 Filter name: none 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f634a7fc640 20 reqs_thread_entry: start 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa4f30 con 0x55f039f63ac0 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa35d0 con 0x55f039f63ac0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.359+0000 7f651fa14800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.360+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa3ea0 con 0x55f039f63ac0 2024-09-10T04:52:15.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651fa14800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651fa14800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651fa14800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94490253212144 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa8870 con 0x55f039f5ea80 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94490252968144 notify 146028888111 ret 0) ==== 575+0+0 (crc 0 0 0) 0x55f039f3c600 con 0x55f039f5ea80 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(65 notify.0 [notify cookie 94490253212144 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f63feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94490252968144 notifier 4846 bl.length()=533 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f63feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f63feffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f63feffd640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63e0003ea0 con 0x55f039f5ea80 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94490253212144 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f039f3bdd0 con 0x55f039f5ea80 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.361+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa3ea0 con 0x55f039f63ac0 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.362+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.362+0000 7f651fa14800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.362+0000 7f651fa14800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.362+0000 7f651fa14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.362+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94490253212064 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa3e80 con 0x55f039f5a600 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== watch-notify(notify (1) cookie 94490252972288 notify 146028888080 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f6514010d50 con 0x55f039f5a600 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f63feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94490252972288 notifier 4846 bl.length()=176 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f63feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f63feffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(68 notify.1 [notify cookie 94490253212064 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f63feffd640 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63e0003ea0 con 0x55f039f5a600 2024-09-10T04:52:15.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.363+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== watch-notify(notify_complete (2) cookie 94490253212064 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f651400d610 con 0x55f039f5a600 2024-09-10T04:52:15.379 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-10T04:52:15.360831Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.360817Z","tags":[],"group_ids":[]} 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.364+0000 7f63d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.364+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94490252994912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f5a600 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.365+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94490252994912] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.365+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94490252968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f5ea80 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.366+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94490252968144] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651fa14800 20 remove_watcher() i=0 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651fa14800 2 removed watcher, disabling cache 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94490252972288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f5a600 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94490252972288] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x55f039f5a600 2024-09-10T04:52:15.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651fa14800 20 remove_watcher() i=1 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.367+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94490252976528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f5ea80 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.369+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94490252976528] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.369+0000 7f651fa14800 20 remove_watcher() i=2 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.369+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94490252979296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x7f650c052c60 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.370+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94490252979296] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.370+0000 7f651fa14800 20 remove_watcher() i=3 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.370+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94490252981968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f5ea80 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.371+0000 7f651b0cb640 1 -- 172.21.15.145:0/3354238267 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94490252981968] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f650c041070 con 0x55f039f5ea80 2024-09-10T04:52:15.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.371+0000 7f651fa14800 20 remove_watcher() i=4 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.371+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94490252973856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f63ac0 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.372+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94490252973856] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.372+0000 7f651fa14800 20 remove_watcher() i=5 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.372+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94490252986864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x55f039f63ac0 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.373+0000 7f651a8ca640 1 -- 172.21.15.145:0/3354238267 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94490252986864] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510057030 con 0x55f039f63ac0 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.373+0000 7f651fa14800 20 remove_watcher() i=6 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.373+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94490252992688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f039fa2d80 con 0x7f650c052c60 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94490252992688] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6514041040 con 0x7f650c052c60 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 20 remove_watcher() i=7 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f5ea80 msgr2=0x55f039f60e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f5ea80 0x55f039f60e70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039f5a600 msgr2=0x55f039f5cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039f5a600 0x55f039f5cac0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f650c052c60 msgr2=0x7f650c0608b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f650c052c60 0x7f650c0608b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f039f63ac0 msgr2=0x55f039f65f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f039f63ac0 0x55f039f65f10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63e403c780 msgr2=0x7f63e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63e403c780 0x7f63e403ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6510000c00 tx=0x7f651006d040 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 msgr2=0x55f039f4f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651b8cc640 1 -- 172.21.15.145:0/3354238267 reap_dead start 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.374+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a3e0 tx=0x7f650c00a370 comp rx=0 tx=0).stop 2024-09-10T04:52:15.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 shutdown_connections 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/3354238267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f47c10 0x55f039f4f020 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 >> 172.21.15.145:0/3354238267 conn(0x55f039f44010 msgr2=0x55f039f42220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 shutdown_connections 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/3354238267 wait complete. 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 msgr2=0x7f63f403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 0x7f63f403ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f039f1f120 tx=0x7f6510005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 msgr2=0x55f039f3b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f650c000c00 tx=0x7f650c017e70 comp rx=0 tx=0).stop 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 shutdown_connections 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f63f403c730 0x7f63f403ebf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1605444544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039f3b370 0x55f039f3b790 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 >> 172.21.15.145:0/1605444544 conn(0x55f039f2f720 msgr2=0x55f039f2fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 shutdown_connections 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1605444544 wait complete. 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f25630 msgr2=0x55f039f27af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f039f25630 0x55f039f27af0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039d98ae0 msgr2=0x55f039f24840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f039d98ae0 0x55f039f24840 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f039f2aec0 msgr2=0x55f039f2d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f039f2aec0 0x55f039f2d2b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f640003c730 msgr2=0x7f640003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.375+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f640003c730 0x7f640003ebf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6510057000 tx=0x7f6510052000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 msgr2=0x55f039f1d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 --2- 172.21.15.145:0/1159596822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f039d97fd0 0x55f039f1d1f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55f039f16830 tx=0x7f650c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651b8cc640 1 -- 172.21.15.145:0/1159596822 reap_dead start 2024-09-10T04:52:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 shutdown_connections 2024-09-10T04:52:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 >> 172.21.15.145:0/1159596822 conn(0x55f039e1f420 msgr2=0x55f039f16b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 shutdown_connections 2024-09-10T04:52:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.376+0000 7f651fa14800 1 -- 172.21.15.145:0/1159596822 wait complete. 2024-09-10T04:52:15.392 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T04:52:15.360831Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.360817Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.392 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T04:52:15.360831Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.360817Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.392 ERROR:root:0 2024-09-10T04:52:15.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:15.397 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:15.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-10T04:52:15.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-10T04:52:15.398 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-10T04:52:15.442 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.442 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.441+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.441+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.441+0000 7fca2fb28800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5611c3da7fd0 0x5611c3db0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2fb28800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611c3c51e40 con 0x5611c3da64b0 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2fb28800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5611c3c1c680 con 0x5611c3da7fd0 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2306e640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5611c3da7fd0 0x5611c3db0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2306e640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5611c3da7fd0 0x5611c3db0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47454/0 (socket says 172.21.15.145:47454) 2024-09-10T04:52:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2b86f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5611c3da64b0 0x5611c3da68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36910/0 (socket says 172.21.15.145:36910) 2024-09-10T04:52:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2306e640 1 -- 172.21.15.145:0/1738532964 learned_addr learned my addr 172.21.15.145:0/1738532964 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2306e640 1 -- 172.21.15.145:0/1738532964 >> v1:172.21.15.98:6789/0 conn(0x5611c3da64b0 legacy=0x5611c3da68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2b06e640 1 -- 172.21.15.145:0/1738532964 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193889576 0 0) 0x5611c3c51e40 con 0x5611c3da64b0 2024-09-10T04:52:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.442+0000 7fca2306e640 1 -- 172.21.15.145:0/1738532964 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3c386b0 con 0x5611c3da7fd0 2024-09-10T04:52:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.444+0000 7fca2306e640 1 --2- 172.21.15.145:0/1738532964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da7fd0 0x5611c3db0af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fca1400a520 tx=0x7fca14045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7038253b2d8444 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.444+0000 7fca2b06e640 1 -- 172.21.15.145:0/1738532964 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca14055070 con 0x5611c3da7fd0 2024-09-10T04:52:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.444+0000 7fca2b06e640 1 -- 172.21.15.145:0/1738532964 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140515b0 con 0x5611c3da7fd0 2024-09-10T04:52:15.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.444+0000 7fca2b06e640 1 -- 172.21.15.145:0/1738532964 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca140518d0 con 0x5611c3da7fd0 2024-09-10T04:52:15.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 -- 172.21.15.145:0/1738532964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da7fd0 msgr2=0x5611c3db0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 --2- 172.21.15.145:0/1738532964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da7fd0 0x5611c3db0af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fca1400a520 tx=0x7fca14045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 -- 172.21.15.145:0/1738532964 shutdown_connections 2024-09-10T04:52:15.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 --2- 172.21.15.145:0/1738532964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da7fd0 0x5611c3db0af0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 -- 172.21.15.145:0/1738532964 >> 172.21.15.145:0/1738532964 conn(0x5611c3da21c0 msgr2=0x5611c3da4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 -- 172.21.15.145:0/1738532964 shutdown_connections 2024-09-10T04:52:15.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.445+0000 7fca2fb28800 1 -- 172.21.15.145:0/1738532964 wait complete. 2024-09-10T04:52:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.458+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2fb28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2fb28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5611c3c40dd0 con 0x5611c3da64b0 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47458/0 (socket says 172.21.15.145:47458) 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2b86f640 1 -- 172.21.15.145:0/2454767384 learned_addr learned my addr 172.21.15.145:0/2454767384 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.459+0000 7fca2b86f640 1 -- 172.21.15.145:0/2454767384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3c59e10 con 0x5611c3da64b0 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2b86f640 1 --2- 172.21.15.145:0/2454767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001ea0 tx=0x7fca1c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac64b1735c01f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fc919e0b640 1 -- 172.21.15.145:0/2454767384 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c008070 con 0x5611c3da64b0 2024-09-10T04:52:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fc919e0b640 1 -- 172.21.15.145:0/2454767384 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c00d500 con 0x5611c3da64b0 2024-09-10T04:52:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fc919e0b640 1 -- 172.21.15.145:0/2454767384 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c00d880 con 0x5611c3da64b0 2024-09-10T04:52:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 -- 172.21.15.145:0/2454767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 msgr2=0x5611c3e99670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 --2- 172.21.15.145:0/2454767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001ea0 tx=0x7fca1c00b6a0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 -- 172.21.15.145:0/2454767384 shutdown_connections 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 --2- 172.21.15.145:0/2454767384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3e99670 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 -- 172.21.15.145:0/2454767384 >> 172.21.15.145:0/2454767384 conn(0x5611c3da21c0 msgr2=0x5611c3e94ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 -- 172.21.15.145:0/2454767384 shutdown_connections 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.460+0000 7fca2fb28800 1 -- 172.21.15.145:0/2454767384 wait complete. 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2fb28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3ea1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2fb28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5611c3db1330 con 0x5611c3da64b0 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3ea1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3ea1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47460/0 (socket says 172.21.15.145:47460) 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2b86f640 1 -- 172.21.15.145:0/3318132032 learned_addr learned my addr 172.21.15.145:0/3318132032 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.461+0000 7fca2b86f640 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3ea1560 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3ea1000 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fca1c000f60 tx=0x7fca1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fc913fff640 1 -- 172.21.15.145:0/3318132032 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c00f8d0 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fc913fff640 1 -- 172.21.15.145:0/3318132032 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c00fa70 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611c3ea17f0 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fc913fff640 1 -- 172.21.15.145:0/3318132032 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c00fd50 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.462+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611c3ea21f0 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fc913fff640 1 -- 172.21.15.145:0/3318132032 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca1c017040 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fc913fff640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc91403c730 0x7fc91403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fc913fff640 1 -- 172.21.15.145:0/3318132032 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fca1c015020 con 0x5611c3da64b0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2306e640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc91403c730 0x7fc91403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3da7fd0 0x5611c3ea8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ea8b90 con 0x5611c3da7fd0 2024-09-10T04:52:15.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2c070640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3da7fd0 0x5611c3ea8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2306e640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc91403c730 0x7fc91403ebf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca14057000 tx=0x7fca14052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.463+0000 7fca2c070640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3da7fd0 0x5611c3ea8650 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.464+0000 7fca2c070640 1 -- 172.21.15.145:0/3318132032 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3da7fd0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.464+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ea9440 0x5611c3eab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.464+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eabfe0 con 0x5611c3ea9440 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.464+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ea9440 0x5611c3eab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.464+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ea9440 0x5611c3eab870 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2b86f640 1 -- 172.21.15.145:0/3318132032 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca1c02d070 con 0x5611c3ea9440 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ead890 con 0x5611c3da7fd0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2c070640 1 -- 172.21.15.145:0/3318132032 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3da7fd0 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eacac0 con 0x5611c3ea9440 2024-09-10T04:52:15.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2b86f640 1 -- 172.21.15.145:0/3318132032 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca1c02d070 con 0x5611c3ea9440 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5611c3eaec40 0x5611c3eb1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eb1570 con 0x5611c3eaec40 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.465+0000 7fca2306e640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5611c3eaec40 0x5611c3eb1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.466+0000 7fca2306e640 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5611c3eaec40 0x5611c3eb1030 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.466+0000 7fca2306e640 1 -- 172.21.15.145:0/3318132032 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca14057030 con 0x5611c3eaec40 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.466+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.466+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.466+0000 7fca2fb28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2fb28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5611c3c9ea00 con 0x5611c3ebf0c0 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47474/0 (socket says 172.21.15.145:47474) 2024-09-10T04:52:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2b86f640 1 -- 172.21.15.145:0/3942314081 learned_addr learned my addr 172.21.15.145:0/3942314081 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2b86f640 1 -- 172.21.15.145:0/3942314081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3ebfb20 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00eb00 tx=0x7fca1c018e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fc911ffb640 1 -- 172.21.15.145:0/3942314081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c02b040 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fc911ffb640 1 -- 172.21.15.145:0/3942314081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c04b3d0 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611c3ec0350 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fc911ffb640 1 -- 172.21.15.145:0/3942314081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c0187d0 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.467+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611c3ec08f0 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.468+0000 7fc911ffb640 1 -- 172.21.15.145:0/3942314081 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca1c03e970 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.468+0000 7fc911ffb640 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 0x7fc90403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.468+0000 7fc911ffb640 1 -- 172.21.15.145:0/3942314081 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fca1c0449b0 con 0x5611c3ebf0c0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.468+0000 7fca2306e640 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 0x7fc90403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2306e640 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 0x7fc90403ebf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5611c3d1b460 tx=0x7fca14005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2fb28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2fb28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5611c3e99ec0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47490/0 (socket says 172.21.15.145:47490) 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2b86f640 1 -- 172.21.15.145:0/694021073 learned_addr learned my addr 172.21.15.145:0/694021073 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2b86f640 1 -- 172.21.15.145:0/694021073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3ecc3d0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fca2b86f640 1 --2- 172.21.15.145:0/694021073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00efa0 tx=0x7fca1c01a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff1430d71101c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.469+0000 7fc90affd640 1 -- 172.21.15.145:0/694021073 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c04b720 con 0x5611c3ecb9e0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fc90affd640 1 -- 172.21.15.145:0/694021073 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c0267f0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fc90affd640 1 -- 172.21.15.145:0/694021073 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c00a200 con 0x5611c3ecb9e0 2024-09-10T04:52:15.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- 172.21.15.145:0/694021073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 msgr2=0x5611c3ecbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 --2- 172.21.15.145:0/694021073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00efa0 tx=0x7fca1c01a480 comp rx=0 tx=0).stop 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- 172.21.15.145:0/694021073 shutdown_connections 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 --2- 172.21.15.145:0/694021073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ecbde0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- 172.21.15.145:0/694021073 >> 172.21.15.145:0/694021073 conn(0x5611c3ec7de0 msgr2=0x5611c3ec6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- 172.21.15.145:0/694021073 shutdown_connections 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- 172.21.15.145:0/694021073 wait complete. 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 Processor -- start 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.470+0000 7fca2fb28800 1 -- start start 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2fb28800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ed2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2fb28800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5611c3ecc840 con 0x5611c3ecb9e0 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ed2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2b86f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ed2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47498/0 (socket says 172.21.15.145:47498) 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 learned_addr learned my addr 172.21.15.145:0/3594586508 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c3ed33a0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ed2e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fca1c04b580 tx=0x7fca1c012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fc9097fa640 1 -- 172.21.15.145:0/3594586508 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c0110d0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fc9097fa640 1 -- 172.21.15.145:0/3594586508 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c011270 con 0x5611c3ecb9e0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fc9097fa640 1 -- 172.21.15.145:0/3594586508 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca1c030810 con 0x5611c3ecb9e0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611c3ed33a0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.471+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611c3ed33a0 con 0x5611c3ecb9e0 2024-09-10T04:52:15.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.472+0000 7fc9097fa640 1 -- 172.21.15.145:0/3594586508 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca1c06c070 con 0x5611c3ecb9e0 2024-09-10T04:52:15.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.472+0000 7fc9097fa640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc8f403c730 0x7fc8f403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.472+0000 7fc9097fa640 1 -- 172.21.15.145:0/3594586508 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fca1c05c070 con 0x5611c3ecb9e0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2306e640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc8f403c730 0x7fc8f403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2306e640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc8f403c730 0x7fc8f403ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca14077040 tx=0x7fca14053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3ede260 0x5611c3ee0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee0e70 con 0x5611c3ede260 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2c070640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3ede260 0x5611c3ee0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.473+0000 7fca2c070640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3ede260 0x5611c3ee0720 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 realm 2024-09-10T04:52:15.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3edd590 con 0x5611c3ede260 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee1900 con 0x5611c3ede260 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ee26e0 0x5611c3ee4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee5160 con 0x5611c3ee26e0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.474+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ee26e0 0x5611c3ee4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ee26e0 0x5611c3ee4ad0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee59b0 con 0x5611c3ede260 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 20 searching for the correct realm 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5611c3ee7720 0x5611c3ee9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.475+0000 7fca2306e640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5611c3ee7720 0x5611c3ee9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2306e640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5611c3ee7720 0x5611c3ee9b70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2b86f640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fca1c03ec60 0x7fca1c00a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.476+0000 7fca2c070640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fca1c03ec60 0x7fca1c00a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fca1c03ec60 0x7fca1c00a680 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca2400a4d0 con 0x7fca1c03ec60 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.477+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.478+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca2400a4d0 con 0x5611c3ede260 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.479+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.480+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.481+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ede260 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.482+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x7fca1c03ec60 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca24030040 con 0x7fca1c03ec60 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.483+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee7720 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea240 con 0x5611c3ee26e0 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.484+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee6330 con 0x5611c3ede260 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca24030040 con 0x5611c3ede260 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee5f70 con 0x5611c3ee26e0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ee6cd0 con 0x7fca1c03ec60 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 zone default found 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 4 Realm: () 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 zonegroup default 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eea6c0 con 0x7fca1c03ec60 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.485+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eec500 con 0x5611c3ee7720 2024-09-10T04:52:15.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eec9c0 con 0x5611c3ee7720 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 started sync module instance, tier type = 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.486+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eeb970 con 0x5611c3ee26e0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.487+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.487+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634301635984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eed2d0 con 0x5611c3ee26e0 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.487+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eedb20 con 0x5611c3ede260 2024-09-10T04:52:15.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.488+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634301635984] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.489+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.489+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634301640224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eed7f0 con 0x5611c3ede260 2024-09-10T04:52:15.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.489+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eee310 con 0x5611c3ee26e0 2024-09-10T04:52:15.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.490+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634301640224] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.490+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.490+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634301644256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eee2d0 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.490+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eeedc0 con 0x7fca1c03ec60 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.491+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634301644256] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.491+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.491+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634301647056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eeedc0 con 0x7fca1c03ec60 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.491+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eef800 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.492+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634301647056] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.492+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.492+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634301641280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eef800 con 0x5611c3ee26e0 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.492+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef0210 con 0x5611c3ee7720 2024-09-10T04:52:15.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.493+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634301641280] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.493+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.493+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634301649744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eef770 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.494+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef10d0 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.495+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634301649744] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.495+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.495+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634301654528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef1920 con 0x5611c3ee7720 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.495+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef21f0 con 0x7fca1c03ec60 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634301659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef1d80 con 0x7fca1c03ec60 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=0 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=1 2024-09-10T04:52:15.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=2 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=3 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=4 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=5 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634301654528] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.496+0000 7fca2fb28800 20 add_watcher() i=6 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634301659424] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2fb28800 20 add_watcher() i=7 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2fb28800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef1470 con 0x5611c3ede260 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.497+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634301662608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef1470 con 0x5611c3ede260 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.498+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634301662608] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.498+0000 7fc8e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.499+0000 7fca2fb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.499+0000 7fca2fb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.499+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efdfe0 con 0x5611c3ee26e0 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.500+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.500+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efdfe0 con 0x7fca1c03ec60 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.501+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.501+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efdfe0 con 0x5611c3ee7720 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.502+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.502+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efea60 con 0x5611c3ede260 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.503+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'252 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.503+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efee80 con 0x5611c3ee26e0 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.504+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.504+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efee80 con 0x5611c3ee7720 2024-09-10T04:52:15.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.505+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.505+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff3f0 con 0x5611c3ee26e0 2024-09-10T04:52:15.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.506+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.506+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff3f0 con 0x5611c3ede260 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.507+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'59 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.507+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff9e0 con 0x5611c3ee26e0 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.508+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.508+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff9e0 con 0x5611c3ee26e0 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.509+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.509+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff9e0 con 0x5611c3ee26e0 2024-09-10T04:52:15.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.510+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.510+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eff9e0 con 0x5611c3ee7720 2024-09-10T04:52:15.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.511+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.511+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3effe90 con 0x5611c3ee26e0 2024-09-10T04:52:15.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.512+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.512+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3effe90 con 0x5611c3ede260 2024-09-10T04:52:15.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.513+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.513+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ede260 2024-09-10T04:52:15.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.514+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'253 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.514+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.515+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.516+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.516+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.516+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee7720 2024-09-10T04:52:15.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.517+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.518+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.519+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.519+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ede260 2024-09-10T04:52:15.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.520+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'254 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.520+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.521+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.521+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.522+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.522+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee7720 2024-09-10T04:52:15.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.523+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.523+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee26e0 2024-09-10T04:52:15.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.524+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.524+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc640 con 0x5611c3ee7720 2024-09-10T04:52:15.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.525+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.525+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc470 con 0x5611c3ee7720 2024-09-10T04:52:15.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.526+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.526+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc470 con 0x5611c3ee7720 2024-09-10T04:52:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.528+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.528+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc8f0 con 0x5611c3ee26e0 2024-09-10T04:52:15.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.529+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.529+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efbfc0 con 0x5611c3ede260 2024-09-10T04:52:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.530+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'60 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.530+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc610 con 0x5611c3ee26e0 2024-09-10T04:52:15.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.531+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.531+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc4a0 con 0x5611c3ede260 2024-09-10T04:52:15.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.532+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.532+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3efc470 con 0x7fca1c03ec60 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.533+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.533+0000 7fc8e0fe1640 20 reqs_thread_entry: start 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.533+0000 7fca2fb28800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.533+0000 7fca2fb28800 20 Filter name: none 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fc85a7fc640 20 reqs_thread_entry: start 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2b080 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 20 rados_obj.operate() r=0 bl.length=349 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2d9b0 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 10 removing key index: system_akey 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.534+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2ab70 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.535+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.535+0000 7fca2fb28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94634301895824 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2deb0 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== watch-notify(notify (1) cookie 94634301640224 notify 146028888081 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5611c3eff3f0 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fc90affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94634301640224 notifier 4853 bl.length()=161 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(97 notify.1 [notify cookie 94634301895824 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fc90affd640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8f0003d60 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== watch-notify(notify_complete (2) cookie 94634301895824 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611c3eff810 con 0x5611c3ede260 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2fb28800 10 removing email index: 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2fb28800 10 removing user buckets index 2024-09-10T04:52:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.536+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2b490 con 0x5611c3ee7720 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.537+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.537+0000 7fca2fb28800 10 removing user index: system_user 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.537+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2fed0 con 0x5611c3ee7720 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.538+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.538+0000 7fca2fb28800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.538+0000 7fca2fb28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.538+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94634301896976 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611c3f2d1f0 con 0x5611c3ee26e0 2024-09-10T04:52:15.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== watch-notify(notify (1) cookie 94634301635984 notify 146028888112 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5611c3efe550 con 0x5611c3ee26e0 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fc90a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888112 cookie 94634301635984 notifier 4853 bl.length()=160 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(101 notify.0 [notify cookie 94634301896976 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fc90a7fc640 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8600032c0 con 0x5611c3ee26e0 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.539+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== watch-notify(notify_complete (2) cookie 94634301896976 notify 146028888112 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611c3ebfb20 con 0x5611c3ee26e0 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.540+0000 7fc8e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.540+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634301662608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3edb820 con 0x5611c3ede260 2024-09-10T04:52:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.541+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94634301662608] v34'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.541+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634301635984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef2590 con 0x5611c3ee26e0 2024-09-10T04:52:15.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.542+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94634301635984] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.542+0000 7fca2fb28800 20 remove_watcher() i=0 2024-09-10T04:52:15.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.542+0000 7fca2fb28800 2 removed watcher, disabling cache 2024-09-10T04:52:15.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.542+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634301640224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eebd90 con 0x5611c3ede260 2024-09-10T04:52:15.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.543+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94634301640224] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x5611c3ede260 2024-09-10T04:52:15.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.543+0000 7fca2fb28800 20 remove_watcher() i=1 2024-09-10T04:52:15.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.543+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634301644256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eece20 con 0x5611c3ee26e0 2024-09-10T04:52:15.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.544+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94634301644256] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.545+0000 7fca2fb28800 20 remove_watcher() i=2 2024-09-10T04:52:15.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.545+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634301647056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eece20 con 0x7fca1c03ec60 2024-09-10T04:52:15.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.546+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94634301647056] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.546+0000 7fca2fb28800 20 remove_watcher() i=3 2024-09-10T04:52:15.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.546+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634301641280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eee8d0 con 0x5611c3ee26e0 2024-09-10T04:52:15.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.547+0000 7fca2b86f640 1 -- 172.21.15.145:0/3594586508 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94634301641280] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1c075020 con 0x5611c3ee26e0 2024-09-10T04:52:15.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.547+0000 7fca2fb28800 20 remove_watcher() i=4 2024-09-10T04:52:15.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.547+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634301649744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eedde0 con 0x5611c3ee7720 2024-09-10T04:52:15.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.548+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94634301649744] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.548+0000 7fca2fb28800 20 remove_watcher() i=5 2024-09-10T04:52:15.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.548+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634301654528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3eedde0 con 0x5611c3ee7720 2024-09-10T04:52:15.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.549+0000 7fca2306e640 1 -- 172.21.15.145:0/3594586508 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94634301654528] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca14057030 con 0x5611c3ee7720 2024-09-10T04:52:15.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.549+0000 7fca2fb28800 20 remove_watcher() i=6 2024-09-10T04:52:15.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.549+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634301659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611c3ef0600 con 0x7fca1c03ec60 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94634301659424] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca24041040 con 0x7fca1c03ec60 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 20 remove_watcher() i=7 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ee26e0 msgr2=0x5611c3ee4ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ee26e0 0x5611c3ee4ad0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3ede260 msgr2=0x5611c3ee0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3ede260 0x5611c3ee0720 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fca1c03ec60 msgr2=0x7fca1c00a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fca1c03ec60 0x7fca1c00a680 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5611c3ee7720 msgr2=0x5611c3ee9b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5611c3ee7720 0x5611c3ee9b70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc8f403c730 msgr2=0x7fc8f403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc8f403c730 0x7fc8f403ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca14077040 tx=0x7fca14053000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 msgr2=0x5611c3ed2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3594586508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ecb9e0 0x5611c3ed2e40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fca1c04b580 tx=0x7fca1c012ea0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2c070640 1 -- 172.21.15.145:0/3594586508 reap_dead start 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 shutdown_connections 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 >> 172.21.15.145:0/3594586508 conn(0x5611c3ec7de0 msgr2=0x5611c3ec5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.550+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 shutdown_connections 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3594586508 wait complete. 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 msgr2=0x7fc90403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 0x7fc90403ebf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5611c3d1b460 tx=0x7fca14005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 msgr2=0x5611c3ebf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00eb00 tx=0x7fca1c018e40 comp rx=0 tx=0).stop 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 shutdown_connections 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc90403c730 0x7fc90403ebf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3942314081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3ebf0c0 0x5611c3ebf4e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 >> 172.21.15.145:0/3942314081 conn(0x5611c3eb3470 msgr2=0x5611c3eb3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 shutdown_connections 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3942314081 wait complete. 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ea9440 msgr2=0x5611c3eab870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5611c3ea9440 0x5611c3eab870 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3da7fd0 msgr2=0x5611c3ea8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5611c3da7fd0 0x5611c3ea8650 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5611c3eaec40 msgr2=0x5611c3eb1030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5611c3eaec40 0x5611c3eb1030 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc91403c730 msgr2=0x7fc91403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc91403c730 0x7fc91403ebf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca14057000 tx=0x7fca14052000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 msgr2=0x5611c3ea1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 --2- 172.21.15.145:0/3318132032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5611c3da64b0 0x5611c3ea1000 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fca1c000f60 tx=0x7fca1c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2c070640 1 -- 172.21.15.145:0/3318132032 reap_dead start 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 shutdown_connections 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 >> 172.21.15.145:0/3318132032 conn(0x5611c3da21c0 msgr2=0x5611c3e9a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.551+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 shutdown_connections 2024-09-10T04:52:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.552+0000 7fca2fb28800 1 -- 172.21.15.145:0/3318132032 wait complete. 2024-09-10T04:52:15.562 ERROR:root:None 2024-09-10T04:52:15.562 ERROR:root:0 2024-09-10T04:52:15.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T04:52:15.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T04:52:15.562 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-10T04:52:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.615+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.615+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.615+0000 7f48af019800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c8f7c3d010 0x55c8f7c45b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.615+0000 7f48af019800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8f7ae6e40 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48af019800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55c8f7ab1680 con 0x55c8f7c3d010 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48a9fea640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c8f7c3d010 0x55c8f7c45b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48a9fea640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55c8f7c3d010 0x55c8f7c45b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47510/0 (socket says 172.21.15.145:47510) 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48aa7eb640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55c8f7c3b4f0 0x55c8f7c3b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36926/0 (socket says 172.21.15.145:36926) 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48a9fea640 1 -- 172.21.15.145:0/1768464012 learned_addr learned my addr 172.21.15.145:0/1768464012 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48a9fea640 1 -- 172.21.15.145:0/1768464012 >> v1:172.21.15.98:6789/0 conn(0x55c8f7c3b4f0 legacy=0x55c8f7c3b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.616+0000 7f48a9fea640 1 -- 172.21.15.145:0/1768464012 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7acd6b0 con 0x55c8f7c3d010 2024-09-10T04:52:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.618+0000 7f48a9fea640 1 --2- 172.21.15.145:0/1768464012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3d010 0x55c8f7c45b30 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f489400a520 tx=0x7f4894045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcf4564a26dd503 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.618+0000 7f48a97e9640 1 -- 172.21.15.145:0/1768464012 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894055070 con 0x55c8f7c3d010 2024-09-10T04:52:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.618+0000 7f48a97e9640 1 -- 172.21.15.145:0/1768464012 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48940515b0 con 0x55c8f7c3d010 2024-09-10T04:52:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.618+0000 7f48a97e9640 1 -- 172.21.15.145:0/1768464012 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48940518d0 con 0x55c8f7c3d010 2024-09-10T04:52:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 -- 172.21.15.145:0/1768464012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3d010 msgr2=0x55c8f7c45b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 --2- 172.21.15.145:0/1768464012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3d010 0x55c8f7c45b30 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f489400a520 tx=0x7f4894045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 -- 172.21.15.145:0/1768464012 shutdown_connections 2024-09-10T04:52:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 --2- 172.21.15.145:0/1768464012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3d010 0x55c8f7c45b30 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 -- 172.21.15.145:0/1768464012 >> 172.21.15.145:0/1768464012 conn(0x55c8f7c37220 msgr2=0x55c8f7c39680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 -- 172.21.15.145:0/1768464012 shutdown_connections 2024-09-10T04:52:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.619+0000 7f48af019800 1 -- 172.21.15.145:0/1768464012 wait complete. 2024-09-10T04:52:15.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48af019800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48af019800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c8f7ad5dd0 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47522/0 (socket says 172.21.15.145:47522) 2024-09-10T04:52:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.633+0000 7f48aa7eb640 1 -- 172.21.15.145:0/571064362 learned_addr learned my addr 172.21.15.145:0/571064362 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.634+0000 7f48aa7eb640 1 -- 172.21.15.145:0/571064362 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7aeee10 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.634+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/571064362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f489c0016e0 tx=0x7f489c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844e682a5dfb35b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.634+0000 7f4798608640 1 -- 172.21.15.145:0/571064362 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c013420 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.634+0000 7f4798608640 1 -- 172.21.15.145:0/571064362 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c0135e0 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.634+0000 7f4798608640 1 -- 172.21.15.145:0/571064362 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c013900 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- 172.21.15.145:0/571064362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 msgr2=0x55c8f7d2e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 --2- 172.21.15.145:0/571064362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f489c0016e0 tx=0x7f489c001ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- 172.21.15.145:0/571064362 shutdown_connections 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 --2- 172.21.15.145:0/571064362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d2e920 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- 172.21.15.145:0/571064362 >> 172.21.15.145:0/571064362 conn(0x55c8f7c37220 msgr2=0x55c8f7d2a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- 172.21.15.145:0/571064362 shutdown_connections 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- 172.21.15.145:0/571064362 wait complete. 2024-09-10T04:52:15.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48af019800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c8f7c46340 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47530/0 (socket says 172.21.15.145:47530) 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.635+0000 7f48aa7eb640 1 -- 172.21.15.145:0/1523594901 learned_addr learned my addr 172.21.15.145:0/1523594901 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f48aa7eb640 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7d36830 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d362d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f489c000f80 tx=0x7f489c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f4796e05640 1 -- 172.21.15.145:0/1523594901 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c022020 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f4796e05640 1 -- 172.21.15.145:0/1523594901 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c006810 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8f7d36ac0 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f4796e05640 1 -- 172.21.15.145:0/1523594901 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c004ae0 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.636+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f7d374c0 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.637+0000 7f4796e05640 1 -- 172.21.15.145:0/1523594901 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f489c025020 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.637+0000 7f4796e05640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f479003c730 0x7f479003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.637+0000 7f4796e05640 1 -- 172.21.15.145:0/1523594901 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f489c018030 con 0x55c8f7c3b4f0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48a9fea640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f479003c730 0x7f479003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7c3d010 0x55c8f7d3d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d3de60 con 0x55c8f7c3d010 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48aafec640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7c3d010 0x55c8f7d3d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48a9fea640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f479003c730 0x7f479003ebf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4894057000 tx=0x7f4894052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48aafec640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7c3d010 0x55c8f7d3d920 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48aafec640 1 -- 172.21.15.145:0/1523594901 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7c3d010 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d3e710 0x55c8f7d40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.638+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d41340 con 0x55c8f7d3e710 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.639+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d3e710 0x55c8f7d40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.639+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d3e710 0x55c8f7d40bd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.639+0000 7f48aa7eb640 1 -- 172.21.15.145:0/1523594901 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f489c01b070 con 0x55c8f7d3e710 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.639+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d42bf0 con 0x55c8f7c3d010 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48aafec640 1 -- 172.21.15.145:0/1523594901 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7c3d010 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d41e20 con 0x55c8f7d3e710 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48aa7eb640 1 -- 172.21.15.145:0/1523594901 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f489c01b070 con 0x55c8f7d3e710 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c8f7d43fa0 0x55c8f7d46390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d468d0 con 0x55c8f7d43fa0 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48a9fea640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c8f7d43fa0 0x55c8f7d46390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48a9fea640 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c8f7d43fa0 0x55c8f7d46390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.640+0000 7f48a9fea640 1 -- 172.21.15.145:0/1523594901 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d43fa0 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48af019800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48af019800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c8f7b33a00 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47544/0 (socket says 172.21.15.145:47544) 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.641+0000 7f48aa7eb640 1 -- 172.21.15.145:0/2898091244 learned_addr learned my addr 172.21.15.145:0/2898091244 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f48aa7eb640 1 -- 172.21.15.145:0/2898091244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7d54eb0 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f489c01dad0 tx=0x7f489c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f478ffff640 1 -- 172.21.15.145:0/2898091244 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c01e730 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f478ffff640 1 -- 172.21.15.145:0/2898091244 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c035020 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8f7d556e0 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f478ffff640 1 -- 172.21.15.145:0/2898091244 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c04aed0 con 0x55c8f7d54450 2024-09-10T04:52:15.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.642+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f7d55c80 con 0x55c8f7d54450 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f478ffff640 1 -- 172.21.15.145:0/2898091244 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f489c010070 con 0x55c8f7d54450 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f478ffff640 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 0x7f478403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f478ffff640 1 -- 172.21.15.145:0/2898091244 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f489c036030 con 0x55c8f7d54450 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f48a9fea640 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 0x7f478403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f48a9fea640 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 0x7f478403ebf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55c8f7d38200 tx=0x7f4894005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.643+0000 7f48af019800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48af019800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c8f7d2f170 con 0x55c8f7d60cf0 2024-09-10T04:52:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47550/0 (socket says 172.21.15.145:47550) 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48aa7eb640 1 -- 172.21.15.145:0/4093981489 learned_addr learned my addr 172.21.15.145:0/4093981489 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48aa7eb640 1 -- 172.21.15.145:0/4093981489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7d616e0 con 0x55c8f7d60cf0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/4093981489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f489c026520 tx=0x7f489c048850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8992c02c5cc4ab06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f478dffb640 1 -- 172.21.15.145:0/4093981489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c026d50 con 0x55c8f7d60cf0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f478dffb640 1 -- 172.21.15.145:0/4093981489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c052d30 con 0x55c8f7d60cf0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.644+0000 7f478dffb640 1 -- 172.21.15.145:0/4093981489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c031540 con 0x55c8f7d60cf0 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- 172.21.15.145:0/4093981489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 msgr2=0x55c8f7d610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 --2- 172.21.15.145:0/4093981489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f489c026520 tx=0x7f489c048850 comp rx=0 tx=0).stop 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- 172.21.15.145:0/4093981489 shutdown_connections 2024-09-10T04:52:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 --2- 172.21.15.145:0/4093981489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d610f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- 172.21.15.145:0/4093981489 >> 172.21.15.145:0/4093981489 conn(0x55c8f7d5d0f0 msgr2=0x55c8f7d5b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- 172.21.15.145:0/4093981489 shutdown_connections 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- 172.21.15.145:0/4093981489 wait complete. 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 Processor -- start 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- start start 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48af019800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c8f7d61b50 con 0x55c8f7d60cf0 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48aa7eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47556/0 (socket says 172.21.15.145:47556) 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.645+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 learned_addr learned my addr 172.21.15.145:0/72854658 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f7d686d0 con 0x55c8f7d60cf0 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f489c026520 tx=0x7f489c013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f477bfff640 1 -- 172.21.15.145:0/72854658 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c031950 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f477bfff640 1 -- 172.21.15.145:0/72854658 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c071070 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8f7d686d0 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f477bfff640 1 -- 172.21.15.145:0/72854658 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c026960 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.646+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f7d686d0 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.647+0000 7f477bfff640 1 -- 172.21.15.145:0/72854658 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f489c05e070 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.647+0000 7f477bfff640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f477403c730 0x7f477403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.647+0000 7f477bfff640 1 -- 172.21.15.145:0/72854658 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f489c066070 con 0x55c8f7d60cf0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.647+0000 7f48a9fea640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f477403c730 0x7f477403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48a9fea640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f477403c730 0x7f477403ebf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4894045be0 tx=0x7f489406d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7d73780 0x55c8f7d75c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d76390 con 0x55c8f7d73780 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48aafec640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7d73780 0x55c8f7d75c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48aafec640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7d73780 0x55c8f7d75c40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7d73780 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.648+0000 7f48af019800 20 realm 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d72ab0 con 0x55c8f7d73780 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7d73780 2024-09-10T04:52:15.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d76e20 con 0x55c8f7d73780 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7d73780 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d77c00 0x55c8f7d79ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7a680 con 0x55c8f7d77c00 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d77c00 0x55c8f7d79ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.649+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d77c00 0x55c8f7d79ff0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7d73780 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 20 searching for the correct realm 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c8f7d7cc40 0x55c8f7d7f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7f760 con 0x55c8f7d7cc40 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.650+0000 7f48a9fea640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c8f7d7cc40 0x55c8f7d7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48a9fea640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c8f7d7cc40 0x55c8f7d7f090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7f760 con 0x55c8f7d77c00 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48aa7eb640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f489c027020 0x7f489c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7a680 con 0x7f489c027020 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48aafec640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f489c027020 0x7f489c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.651+0000 7f48aafec640 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f489c027020 0x7f489c061a70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48a40083e0 con 0x7f489c027020 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.652+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.653+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.654+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.655+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.656+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d73780 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.657+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x7f489c027020 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.658+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7aed0 con 0x55c8f7d77c00 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.659+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7a680 con 0x55c8f7d73780 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7b720 con 0x55c8f7d77c00 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7b720 con 0x7f489c027020 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 zone default found 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 4 Realm: () 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 zonegroup default 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.660+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7b720 con 0x7f489c027020 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d7c070 con 0x55c8f7d7cc40 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d815d0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 started sync module instance, tier type = 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.661+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d80a70 con 0x55c8f7d77c00 2024-09-10T04:52:15.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.662+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.663+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94321639951968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d80a70 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.663+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d81e20 con 0x55c8f7d73780 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.663+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94321639951968] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.664+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.664+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94321639955280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d80a70 con 0x55c8f7d73780 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.664+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d828b0 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.665+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.665+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94321639955280] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.665+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94321639957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d828b0 con 0x55c8f7d77c00 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.665+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d805c0 con 0x7f489c027020 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.666+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.666+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94321639961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d805c0 con 0x7f489c027020 2024-09-10T04:52:15.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.666+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d84320 con 0x55c8f7d77c00 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.666+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94321639957376] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.667+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94321639961504] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.667+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.667+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94321639962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d842e0 con 0x55c8f7d77c00 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.667+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d84bc0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.668+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.668+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94321639966480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d842e0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.668+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d85ac0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.668+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94321639962560] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.669+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94321639966480] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.669+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.669+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94321639970224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d85eb0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.669+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d86780 con 0x7f489c027020 2024-09-10T04:52:15.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94321639970224] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94321639973456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d86b70 con 0x7f489c027020 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=0 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=1 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=2 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=3 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=4 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=5 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.670+0000 7f48af019800 20 add_watcher() i=6 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.671+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94321639973456] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.671+0000 7f48af019800 20 add_watcher() i=7 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.671+0000 7f48af019800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.671+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d8a050 con 0x55c8f7d73780 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.672+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.672+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94321639975712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7d87460 con 0x55c8f7d73780 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.673+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94321639975712] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.673+0000 7f4760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.673+0000 7f48af019800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.673+0000 7f48af019800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.673+0000 7f48af019800 5 note: GC not initialized 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f46db7fe640 20 reqs_thread_entry: start 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 Filter name: none 2024-09-10T04:52:15.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f46d97fa640 20 reqs_thread_entry: start 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbcfe0 con 0x55c8f7d77c00 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbb6a0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.674+0000 7f48af019800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.675+0000 7f48af019800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.675+0000 7f48af019800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.675+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbbf40 con 0x55c8f7d77c00 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48af019800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48af019800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48af019800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94321640192656 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dc0470 con 0x55c8f7d77c00 2024-09-10T04:52:15.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== watch-notify(notify (1) cookie 94321639957376 notify 146028888113 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55c8f7dbc930 con 0x55c8f7d77c00 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f478dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888113 cookie 94321639957376 notifier 4860 bl.length()=542 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f478dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f478dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(65 notify.2 [notify cookie 94321640192656 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f478dffb640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4770003ea0 con 0x55c8f7d77c00 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.676+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== watch-notify(notify_complete (2) cookie 94321640192656 notify 146028888113 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c8f7d54eb0 con 0x55c8f7d77c00 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.677+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbbf40 con 0x55c8f7d7cc40 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48af019800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48af019800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48af019800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T04:52:15.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94321640192656 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dc0580 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== watch-notify(notify (1) cookie 94321639966480 notify 146028888092 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55c8f7acd6b0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f478d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94321639966480 notifier 4860 bl.length()=175 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f478d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f478d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f478d7fa640 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f46e0003400 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(68 notify.5 [notify cookie 94321640192656 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.678+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== watch-notify(notify_complete (2) cookie 94321640192656 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f48940806e0 con 0x55c8f7d7cc40 2024-09-10T04:52:15.693 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-10T04:52:15.675872Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.675861Z","tags":[],"group_ids":[]} 2024-09-10T04:52:15.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.679+0000 7f4760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.679+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94321639975712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d73780 2024-09-10T04:52:15.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.680+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94321639975712] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.680+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94321639951968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d77c00 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.681+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94321639951968] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.681+0000 7f48af019800 20 remove_watcher() i=0 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.681+0000 7f48af019800 2 removed watcher, disabling cache 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.681+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94321639955280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d73780 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.682+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94321639955280] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x55c8f7d73780 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.682+0000 7f48af019800 20 remove_watcher() i=1 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.682+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94321639957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d77c00 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.684+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94321639957376] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.684+0000 7f48af019800 20 remove_watcher() i=2 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.684+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94321639961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x7f489c027020 2024-09-10T04:52:15.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.685+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94321639961504] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.685+0000 7f48af019800 20 remove_watcher() i=3 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.685+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94321639962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d77c00 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.686+0000 7f48aa7eb640 1 -- 172.21.15.145:0/72854658 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94321639962560] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c069030 con 0x55c8f7d77c00 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.686+0000 7f48af019800 20 remove_watcher() i=4 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.686+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94321639966480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d7cc40 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.687+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94321639966480] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.687+0000 7f48af019800 20 remove_watcher() i=5 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.687+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94321639970224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x55c8f7d7cc40 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.688+0000 7f48a9fea640 1 -- 172.21.15.145:0/72854658 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94321639970224] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4894057030 con 0x55c8f7d7cc40 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.688+0000 7f48af019800 20 remove_watcher() i=6 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.688+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94321639973456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8f7dbae50 con 0x7f489c027020 2024-09-10T04:52:15.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94321639973456] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4025040 con 0x7f489c027020 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 20 remove_watcher() i=7 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d77c00 msgr2=0x55c8f7d79ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d77c00 0x55c8f7d79ff0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7d73780 msgr2=0x55c8f7d75c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7d73780 0x55c8f7d75c40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f489c027020 msgr2=0x7f489c061a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f489c027020 0x7f489c061a70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c8f7d7cc40 msgr2=0x55c8f7d7f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55c8f7d7cc40 0x55c8f7d7f090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f477403c730 msgr2=0x7f477403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f477403c730 0x7f477403ebf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4894045be0 tx=0x7f489406d040 comp rx=0 tx=0).stop 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 msgr2=0x55c8f7d68170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48aafec640 1 -- 172.21.15.145:0/72854658 reap_dead start 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f489c026520 tx=0x7f489c013d50 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 shutdown_connections 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 --2- 172.21.15.145:0/72854658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d60cf0 0x55c8f7d68170 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 >> 172.21.15.145:0/72854658 conn(0x55c8f7d5d0f0 msgr2=0x55c8f7d5b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 shutdown_connections 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.689+0000 7f48af019800 1 -- 172.21.15.145:0/72854658 wait complete. 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 msgr2=0x7f478403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 0x7f478403ebf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55c8f7d38200 tx=0x7f4894005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 msgr2=0x55c8f7d54870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f489c01dad0 tx=0x7f489c010da0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 shutdown_connections 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f478403c730 0x7f478403ebf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/2898091244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7d54450 0x55c8f7d54870 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 >> 172.21.15.145:0/2898091244 conn(0x55c8f7d48800 msgr2=0x55c8f7d48be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 shutdown_connections 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/2898091244 wait complete. 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d3e710 msgr2=0x55c8f7d40bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55c8f7d3e710 0x55c8f7d40bd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7c3d010 msgr2=0x55c8f7d3d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55c8f7c3d010 0x55c8f7d3d920 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c8f7d43fa0 msgr2=0x55c8f7d46390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55c8f7d43fa0 0x55c8f7d46390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f479003c730 msgr2=0x7f479003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f479003c730 0x7f479003ebf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4894057000 tx=0x7f4894052000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 msgr2=0x55c8f7d362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 --2- 172.21.15.145:0/1523594901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c8f7c3b4f0 0x55c8f7d362d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f489c000f80 tx=0x7f489c001250 comp rx=0 tx=0).stop 2024-09-10T04:52:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48aafec640 1 -- 172.21.15.145:0/1523594901 reap_dead start 2024-09-10T04:52:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 shutdown_connections 2024-09-10T04:52:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 >> 172.21.15.145:0/1523594901 conn(0x55c8f7c37220 msgr2=0x55c8f7d2fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 shutdown_connections 2024-09-10T04:52:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.690+0000 7f48af019800 1 -- 172.21.15.145:0/1523594901 wait complete. 2024-09-10T04:52:15.705 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T04:52:15.675872Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.675861Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.705 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T04:52:15.675872Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.675861Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:15.705 ERROR:root:0 2024-09-10T04:52:15.706 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:15.710 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:15.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-10T04:52:15.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-10T04:52:15.711 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-10T04:52:15.757 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.757 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.756+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.756+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde350bb800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e1131be200 0x55e1131c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde350bb800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e113063e40 con 0x55e1131ba690 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde350bb800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55e11302e680 con 0x55e1131be200 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde2bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e1131be200 0x55e1131c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde2bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55e1131be200 0x55e1131c06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47566/0 (socket says 172.21.15.145:47566) 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde32ba5640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55e1131ba690 0x55e1131bca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36934/0 (socket says 172.21.15.145:36934) 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde2bfff640 1 -- 172.21.15.145:0/2203450494 learned_addr learned my addr 172.21.15.145:0/2203450494 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde2bfff640 1 -- 172.21.15.145:0/2203450494 >> v1:172.21.15.98:6789/0 conn(0x55e1131ba690 legacy=0x55e1131bca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.757+0000 7fde2bfff640 1 -- 172.21.15.145:0/2203450494 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11304a6b0 con 0x55e1131be200 2024-09-10T04:52:15.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde2bfff640 1 --2- 172.21.15.145:0/2203450494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131be200 0x55e1131c06c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00a520 tx=0x7fde1c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30aae445843641cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde323a4640 1 -- 172.21.15.145:0/2203450494 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c055070 con 0x55e1131be200 2024-09-10T04:52:15.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde323a4640 1 -- 172.21.15.145:0/2203450494 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0515b0 con 0x55e1131be200 2024-09-10T04:52:15.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde323a4640 1 -- 172.21.15.145:0/2203450494 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c0518d0 con 0x55e1131be200 2024-09-10T04:52:15.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde350bb800 1 -- 172.21.15.145:0/2203450494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131be200 msgr2=0x55e1131c06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.759+0000 7fde350bb800 1 --2- 172.21.15.145:0/2203450494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131be200 0x55e1131c06c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00a520 tx=0x7fde1c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.760+0000 7fde350bb800 1 -- 172.21.15.145:0/2203450494 shutdown_connections 2024-09-10T04:52:15.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.760+0000 7fde350bb800 1 --2- 172.21.15.145:0/2203450494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131be200 0x55e1131c06c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.760+0000 7fde350bb800 1 -- 172.21.15.145:0/2203450494 >> 172.21.15.145:0/2203450494 conn(0x55e1131b41f0 msgr2=0x55e1131b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.760+0000 7fde350bb800 1 -- 172.21.15.145:0/2203450494 shutdown_connections 2024-09-10T04:52:15.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.760+0000 7fde350bb800 1 -- 172.21.15.145:0/2203450494 wait complete. 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde350bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde350bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e113052dd0 con 0x55e1131ba690 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47576/0 (socket says 172.21.15.145:47576) 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde32ba5640 1 -- 172.21.15.145:0/269713854 learned_addr learned my addr 172.21.15.145:0/269713854 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.774+0000 7fde32ba5640 1 -- 172.21.15.145:0/269713854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11306be10 con 0x55e1131ba690 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fde32ba5640 1 --2- 172.21.15.145:0/269713854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b260 tx=0x7fde2400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5289a9864dc24b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fdd20e09640 1 -- 172.21.15.145:0/269713854 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2400be60 con 0x55e1131ba690 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fdd20e09640 1 -- 172.21.15.145:0/269713854 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24006070 con 0x55e1131ba690 2024-09-10T04:52:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fdd20e09640 1 -- 172.21.15.145:0/269713854 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2400e710 con 0x55e1131ba690 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fde350bb800 1 -- 172.21.15.145:0/269713854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 msgr2=0x55e1131b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.775+0000 7fde350bb800 1 --2- 172.21.15.145:0/269713854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b260 tx=0x7fde2400b660 comp rx=0 tx=0).stop 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- 172.21.15.145:0/269713854 shutdown_connections 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 --2- 172.21.15.145:0/269713854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1131b9e00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- 172.21.15.145:0/269713854 >> 172.21.15.145:0/269713854 conn(0x55e1131b41f0 msgr2=0x55e1132a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- 172.21.15.145:0/269713854 shutdown_connections 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- 172.21.15.145:0/269713854 wait complete. 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1132b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde350bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1131c1040 con 0x55e1131ba690 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1132b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1132b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47588/0 (socket says 172.21.15.145:47588) 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde32ba5640 1 -- 172.21.15.145:0/598533298 learned_addr learned my addr 172.21.15.145:0/598533298 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.776+0000 7fde32ba5640 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1132b36f0 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fde32ba5640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1132b3190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55e1131b9930 tx=0x7fde24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fdd1f606640 1 -- 172.21.15.145:0/598533298 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2400f810 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fdd1f606640 1 -- 172.21.15.145:0/598533298 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2400f9b0 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1132b3980 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fdd1f606640 1 -- 172.21.15.145:0/598533298 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2400fcd0 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.777+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1132b4380 con 0x55e1131ba690 2024-09-10T04:52:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fdd1f606640 1 -- 172.21.15.145:0/598533298 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fde24017070 con 0x55e1131ba690 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fdd1f606640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd1803c730 0x7fdd1803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fdd1f606640 1 -- 172.21.15.145:0/598533298 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fde24015020 con 0x55e1131ba690 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde2bfff640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd1803c730 0x7fdd1803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1131be200 0x55e1132ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132bad20 con 0x55e1131be200 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde333a6640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1131be200 0x55e1132ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde2bfff640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd1803c730 0x7fdd1803ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fde1c057000 tx=0x7fde1c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.778+0000 7fde333a6640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1131be200 0x55e1132ba7e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.779+0000 7fde333a6640 1 -- 172.21.15.145:0/598533298 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1131be200 2024-09-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.779+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132bb5d0 0x55e1132bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.779+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132be200 con 0x55e1132bb5d0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.779+0000 7fde32ba5640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132bb5d0 0x55e1132bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.779+0000 7fde32ba5640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132bb5d0 0x55e1132bda90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde32ba5640 1 -- 172.21.15.145:0/598533298 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde2402e070 con 0x55e1132bb5d0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132bfab0 con 0x55e1131be200 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde333a6640 1 -- 172.21.15.145:0/598533298 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1131be200 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132bece0 con 0x55e1132bb5d0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde32ba5640 1 -- 172.21.15.145:0/598533298 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde2402e070 con 0x55e1132bb5d0 2024-09-10T04:52:15.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e1132c0e60 0x55e1132c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132c3790 con 0x55e1132c0e60 2024-09-10T04:52:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.780+0000 7fde2bfff640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e1132c0e60 0x55e1132c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde2bfff640 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e1132c0e60 0x55e1132c3250 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde2bfff640 1 -- 172.21.15.145:0/598533298 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132c0e60 2024-09-10T04:52:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde350bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.781+0000 7fde350bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1130b0a00 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47598/0 (socket says 172.21.15.145:47598) 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde32ba5640 1 -- 172.21.15.145:0/1983614796 learned_addr learned my addr 172.21.15.145:0/1983614796 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde32ba5640 1 -- 172.21.15.145:0/1983614796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1132d1d70 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde32ba5640 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde24000c00 tx=0x7fde24017e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fdd1ce01640 1 -- 172.21.15.145:0/1983614796 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24019dc0 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fdd1ce01640 1 -- 172.21.15.145:0/1983614796 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2401b760 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fdd1ce01640 1 -- 172.21.15.145:0/1983614796 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2401ba40 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1132d25a0 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.782+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1132d2b40 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.783+0000 7fdd1ce01640 1 -- 172.21.15.145:0/1983614796 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fde24044a10 con 0x55e1132d1310 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.783+0000 7fdd1ce01640 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 0x7fdd0c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.783+0000 7fdd1ce01640 1 -- 172.21.15.145:0/1983614796 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fde2403bdb0 con 0x55e1132d1310 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.783+0000 7fde2bfff640 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 0x7fdd0c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.783+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde2bfff640 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 0x7fdd0c03ebf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e1132b50c0 tx=0x7fde1c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde350bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde350bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1131b86a0 con 0x55e1132ddbb0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47614/0 (socket says 172.21.15.145:47614) 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde32ba5640 1 -- 172.21.15.145:0/202688108 learned_addr learned my addr 172.21.15.145:0/202688108 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde32ba5640 1 -- 172.21.15.145:0/202688108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1132de5a0 con 0x55e1132ddbb0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fde32ba5640 1 --2- 172.21.15.145:0/202688108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde24052a60 tx=0x7fde24027ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21edc8ccfc7d985c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.784+0000 7fdd167fc640 1 -- 172.21.15.145:0/202688108 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2403f040 con 0x55e1132ddbb0 2024-09-10T04:52:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fdd167fc640 1 -- 172.21.15.145:0/202688108 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24044d00 con 0x55e1132ddbb0 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fdd167fc640 1 -- 172.21.15.145:0/202688108 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2401a5b0 con 0x55e1132ddbb0 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- 172.21.15.145:0/202688108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 msgr2=0x55e1132ddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 --2- 172.21.15.145:0/202688108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde24052a60 tx=0x7fde24027ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- 172.21.15.145:0/202688108 shutdown_connections 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 --2- 172.21.15.145:0/202688108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132ddfb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- 172.21.15.145:0/202688108 >> 172.21.15.145:0/202688108 conn(0x55e1132d9fb0 msgr2=0x55e1132d81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- 172.21.15.145:0/202688108 shutdown_connections 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- 172.21.15.145:0/202688108 wait complete. 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 Processor -- start 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.785+0000 7fde350bb800 1 -- start start 2024-09-10T04:52:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde350bb800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde350bb800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e1132dea10 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde32ba5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47626/0 (socket says 172.21.15.145:47626) 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 learned_addr learned my addr 172.21.15.145:0/2995388305 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1132e5520 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde32ba5640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fde240199d0 tx=0x7fde2400a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fdd14ff9640 1 -- 172.21.15.145:0/2995388305 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24071070 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fdd14ff9640 1 -- 172.21.15.145:0/2995388305 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24031480 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1132e5520 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fdd14ff9640 1 -- 172.21.15.145:0/2995388305 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24027560 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.786+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1132e5520 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.787+0000 7fdd14ff9640 1 -- 172.21.15.145:0/2995388305 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fde24074070 con 0x55e1132ddbb0 2024-09-10T04:52:15.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.787+0000 7fdd14ff9640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdcfc03c730 0x7fdcfc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.787+0000 7fdd14ff9640 1 -- 172.21.15.145:0/2995388305 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fde24068040 con 0x55e1132ddbb0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.787+0000 7fde2bfff640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdcfc03c730 0x7fdcfc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde2bfff640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdcfc03c730 0x7fdcfc03ebf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fde1c000c00 tx=0x7fde1c06d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1132f05f0 0x55e1132f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f3200 con 0x55e1132f05f0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde333a6640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1132f05f0 0x55e1132f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.788+0000 7fde333a6640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1132f05f0 0x55e1132f2ab0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 realm 2024-09-10T04:52:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132ef920 con 0x55e1132f05f0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f3c90 con 0x55e1132f05f0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132f4a70 0x55e1132f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f74f0 con 0x55e1132f4a70 2024-09-10T04:52:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.789+0000 7fde32ba5640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132f4a70 0x55e1132f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde32ba5640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132f4a70 0x55e1132f6e60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde24073030 con 0x55e1132f4a70 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f7d40 con 0x55e1132f05f0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 20 searching for the correct realm 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e1132f9ab0 0x55e1132fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.790+0000 7fde2bfff640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e1132f9ab0 0x55e1132fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde2bfff640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e1132f9ab0 0x55e1132fbea0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24073030 con 0x55e1132f4a70 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde32ba5640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fde24076060 0x7fde2406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.791+0000 7fde333a6640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fde24076060 0x7fde2406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fde24076060 0x7fde2406ba30 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fde2c00a4d0 con 0x7fde24076060 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.792+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.793+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c00a4d0 con 0x55e1132f05f0 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.794+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.795+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.796+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f05f0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.797+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x7fde24076060 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c030040 con 0x7fde24076060 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f9ab0 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.798+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fc570 con 0x55e1132f4a70 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f86c0 con 0x55e1132f05f0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c030040 con 0x55e1132f05f0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.799+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f8f60 con 0x55e1132f4a70 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132f8300 con 0x7fde24076060 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 zone default found 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 4 Realm: () 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 zonegroup default 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fca30 con 0x7fde24076060 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fe8b0 con 0x55e1132f9ab0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.800+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fed90 con 0x55e1132f9ab0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.801+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.801+0000 7fde350bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.801+0000 7fde350bb800 20 started sync module instance, tier type = 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.801+0000 7fde350bb800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.801+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fdd00 con 0x55e1132f4a70 2024-09-10T04:52:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.802+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.802+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94425177907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fd960 con 0x55e1132f4a70 2024-09-10T04:52:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.802+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1132ffb50 con 0x55e1132f05f0 2024-09-10T04:52:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.810+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.810+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94425177913504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113300430 con 0x55e1132f05f0 2024-09-10T04:52:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.810+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113300f20 con 0x55e1132f4a70 2024-09-10T04:52:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.810+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94425177907440] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.812+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94425177913504] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.812+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.812+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94425177917936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113300ee0 con 0x55e1132f4a70 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.812+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133017c0 con 0x7fde24076060 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.813+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.813+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94425177920272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113301be0 con 0x7fde24076060 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.813+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113302430 con 0x55e1132f4a70 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.813+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94425177917936] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.814+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94425177920272] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.814+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.814+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94425177921328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113302000 con 0x55e1132f4a70 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.814+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113302850 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.815+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.815+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94425177924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133030f0 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.815+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113303be0 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.815+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94425177921328] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.816+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94425177924096] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.816+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.816+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94425177929392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113303fd0 con 0x55e1132f9ab0 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.816+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113304820 con 0x7fde24076060 2024-09-10T04:52:15.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94425177933136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133050c0 con 0x7fde24076060 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=0 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=1 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=2 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=3 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=4 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=5 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94425177929392] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.817+0000 7fde350bb800 20 add_watcher() i=6 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.818+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94425177933136] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.818+0000 7fde350bb800 20 add_watcher() i=7 2024-09-10T04:52:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.818+0000 7fde350bb800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.818+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e1133050c0 con 0x55e1132f05f0 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.819+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.819+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94425177934784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113304fe0 con 0x55e1132f05f0 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.820+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94425177934784] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.820+0000 7fdce97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.820+0000 7fde350bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.820+0000 7fde350bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.820+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x55e1132f4a70 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.821+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.821+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x7fde24076060 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.822+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.822+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x55e1132f9ab0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.823+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.823+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x55e1132f05f0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.824+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'259 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.824+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x55e1132f4a70 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.825+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'86 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.825+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113310a00 con 0x55e1132f9ab0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.827+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.827+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113311ac0 con 0x55e1132f4a70 2024-09-10T04:52:15.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.828+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.828+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113311ac0 con 0x55e1132f05f0 2024-09-10T04:52:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.829+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'61 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.829+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133126f0 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.830+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.830+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133126f0 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.831+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.831+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133126f0 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.832+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'87 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.832+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1133126f0 con 0x55e1132f9ab0 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.833+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.833+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.834+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'39 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.834+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f05f0 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.835+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.835+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f05f0 2024-09-10T04:52:15.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.836+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'260 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.836+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f4a70 2024-09-10T04:52:15.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.837+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.837+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f4a70 2024-09-10T04:52:15.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.838+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'88 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.838+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ba0 con 0x55e1132f9ab0 2024-09-10T04:52:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.839+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.839+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ca0 con 0x55e1132f4a70 2024-09-10T04:52:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.840+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.840+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ca0 con 0x55e1132f05f0 2024-09-10T04:52:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.841+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'261 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.841+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ca0 con 0x55e1132f4a70 2024-09-10T04:52:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.842+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.842+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ca0 con 0x55e1132f4a70 2024-09-10T04:52:15.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.843+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.843+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312ca0 con 0x55e1132f9ab0 2024-09-10T04:52:15.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.844+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.844+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312d30 con 0x55e1132f4a70 2024-09-10T04:52:15.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.845+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.845+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312d30 con 0x55e1132f9ab0 2024-09-10T04:52:15.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.846+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.846+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312dc0 con 0x55e1132f9ab0 2024-09-10T04:52:15.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.847+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.847+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e00 con 0x55e1132f9ab0 2024-09-10T04:52:15.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.848+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.848+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e00 con 0x55e1132f4a70 2024-09-10T04:52:15.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.849+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.849+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e00 con 0x55e1132f05f0 2024-09-10T04:52:15.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.851+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'62 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.851+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e00 con 0x55e1132f4a70 2024-09-10T04:52:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.852+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.852+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e00 con 0x55e1132f05f0 2024-09-10T04:52:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.853+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.853+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113312e40 con 0x7fde24076060 2024-09-10T04:52:15.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fdc63fff640 20 reqs_thread_entry: start 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde350bb800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde350bb800 20 Filter name: none 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fdc61ffb640 20 reqs_thread_entry: start 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde350bb800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde350bb800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.854+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11333dd60 con 0x55e1132f4a70 2024-09-10T04:52:15.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde350bb800 20 rados_obj.operate() r=0 bl.length=363 2024-09-10T04:52:15.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde350bb800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde350bb800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde350bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.855+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e113340290 con 0x55e1132f4a70 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde350bb800 10 removing key index: true_admin_akey 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113340250 con 0x55e1132f9ab0 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde350bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.856+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94425178176992 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11333f220 con 0x55e1132f9ab0 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== watch-notify(notify (1) cookie 94425177924096 notify 146028888093 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55e113311c10 con 0x55e1132f9ab0 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fdd167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94425177924096 notifier 4867 bl.length()=165 2024-09-10T04:52:15.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(97 notify.5 [notify cookie 94425178176992 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fdd167fc640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdcf8003d60 con 0x55e1132f9ab0 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== watch-notify(notify_complete (2) cookie 94425178176992 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e113311a40 con 0x55e1132f9ab0 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde350bb800 10 removing email index: 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde350bb800 10 removing user buckets index 2024-09-10T04:52:15.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.857+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333fde0 con 0x55e1132f4a70 2024-09-10T04:52:15.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.858+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.858+0000 7fde350bb800 10 removing user index: a_user 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.858+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ed70 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.859+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(100 a_user [call,call,delete] v34'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.859+0000 7fde350bb800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.859+0000 7fde350bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.859+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94425178174992 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e113340420 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== watch-notify(notify (1) cookie 94425177917936 notify 146028888114 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55e113312070 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fdd15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888114 cookie 94425177917936 notifier 4867 bl.length()=155 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fdd15ffb640 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdc680032c0 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(101 notify.2 [notify cookie 94425178174992 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.860+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== watch-notify(notify_complete (2) cookie 94425178174992 notify 146028888114 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e1132d1d70 con 0x55e1132f4a70 2024-09-10T04:52:15.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.861+0000 7fdce97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.861+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94425177934784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ff00 con 0x55e1132f05f0 2024-09-10T04:52:15.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.862+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94425177934784] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.862+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94425177907440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ff00 con 0x55e1132f4a70 2024-09-10T04:52:15.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.863+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94425177907440] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.863+0000 7fde350bb800 20 remove_watcher() i=0 2024-09-10T04:52:15.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.863+0000 7fde350bb800 2 removed watcher, disabling cache 2024-09-10T04:52:15.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.863+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94425177913504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ff00 con 0x55e1132f05f0 2024-09-10T04:52:15.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.864+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94425177913504] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x55e1132f05f0 2024-09-10T04:52:15.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.864+0000 7fde350bb800 20 remove_watcher() i=1 2024-09-10T04:52:15.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.864+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94425177917936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113304bc0 con 0x55e1132f4a70 2024-09-10T04:52:15.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.865+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94425177917936] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.865+0000 7fde350bb800 20 remove_watcher() i=2 2024-09-10T04:52:15.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.865+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94425177920272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fe0f0 con 0x7fde24076060 2024-09-10T04:52:15.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.866+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94425177920272] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.866+0000 7fde350bb800 20 remove_watcher() i=3 2024-09-10T04:52:15.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.866+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94425177921328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ff00 con 0x55e1132f4a70 2024-09-10T04:52:15.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.868+0000 7fde32ba5640 1 -- 172.21.15.145:0/2995388305 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94425177921328] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24085040 con 0x55e1132f4a70 2024-09-10T04:52:15.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.868+0000 7fde350bb800 20 remove_watcher() i=4 2024-09-10T04:52:15.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.868+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94425177924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e113304bc0 con 0x55e1132f9ab0 2024-09-10T04:52:15.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.869+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94425177924096] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.869+0000 7fde350bb800 20 remove_watcher() i=5 2024-09-10T04:52:15.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.869+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94425177929392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e1132fe0f0 con 0x55e1132f9ab0 2024-09-10T04:52:15.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.870+0000 7fde2bfff640 1 -- 172.21.15.145:0/2995388305 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94425177929392] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c057030 con 0x55e1132f9ab0 2024-09-10T04:52:15.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.870+0000 7fde350bb800 20 remove_watcher() i=6 2024-09-10T04:52:15.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.870+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94425177933136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11333ff00 con 0x7fde24076060 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94425177933136] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041040 con 0x7fde24076060 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 20 remove_watcher() i=7 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132f4a70 msgr2=0x55e1132f6e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132f4a70 0x55e1132f6e60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1132f05f0 msgr2=0x55e1132f2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1132f05f0 0x55e1132f2ab0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fde24076060 msgr2=0x7fde2406ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fde24076060 0x7fde2406ba30 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e1132f9ab0 msgr2=0x55e1132fbea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55e1132f9ab0 0x55e1132fbea0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdcfc03c730 msgr2=0x7fdcfc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdcfc03c730 0x7fdcfc03ebf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fde1c000c00 tx=0x7fde1c06d040 comp rx=0 tx=0).stop 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 msgr2=0x55e1132e4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde333a6640 1 -- 172.21.15.145:0/2995388305 reap_dead start 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fde240199d0 tx=0x7fde2400a370 comp rx=0 tx=0).stop 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 shutdown_connections 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/2995388305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132ddbb0 0x55e1132e4fc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 >> 172.21.15.145:0/2995388305 conn(0x55e1132d9fb0 msgr2=0x55e1132d81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 shutdown_connections 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/2995388305 wait complete. 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 msgr2=0x7fdd0c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 0x7fdd0c03ebf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e1132b50c0 tx=0x7fde1c005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 msgr2=0x55e1132d1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde24000c00 tx=0x7fde24017e70 comp rx=0 tx=0).stop 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 shutdown_connections 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd0c03c730 0x7fdd0c03ebf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 --2- 172.21.15.145:0/1983614796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1132d1310 0x55e1132d1730 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 >> 172.21.15.145:0/1983614796 conn(0x55e1132c56c0 msgr2=0x55e1132c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 shutdown_connections 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.871+0000 7fde350bb800 1 -- 172.21.15.145:0/1983614796 wait complete. 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132bb5d0 msgr2=0x55e1132bda90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55e1132bb5d0 0x55e1132bda90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1131be200 msgr2=0x55e1132ba7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55e1131be200 0x55e1132ba7e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e1132c0e60 msgr2=0x55e1132c3250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55e1132c0e60 0x55e1132c3250 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd1803c730 msgr2=0x7fdd1803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fdd1803c730 0x7fdd1803ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fde1c057000 tx=0x7fde1c052000 comp rx=0 tx=0).stop 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 msgr2=0x55e1132b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 --2- 172.21.15.145:0/598533298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e1131ba690 0x55e1132b3190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55e1131b9930 tx=0x7fde24000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde333a6640 1 -- 172.21.15.145:0/598533298 reap_dead start 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 shutdown_connections 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 >> 172.21.15.145:0/598533298 conn(0x55e1131b41f0 msgr2=0x55e1132a4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 shutdown_connections 2024-09-10T04:52:15.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.872+0000 7fde350bb800 1 -- 172.21.15.145:0/598533298 wait complete. 2024-09-10T04:52:15.882 ERROR:root:None 2024-09-10T04:52:15.882 ERROR:root:0 2024-09-10T04:52:15.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T04:52:15.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T04:52:15.882 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-10T04:52:15.928 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:15.928 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c0d726800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5629fc416210 0x5629fc41bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c0d726800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629fc2bfe40 con 0x5629fc414e00 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c0d726800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5629fc28a680 con 0x5629fc416210 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c08bd8640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5629fc416210 0x5629fc41bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c093d9640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5629fc414e00 0x5629fc415b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36938/0 (socket says 172.21.15.145:36938) 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c08bd8640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5629fc416210 0x5629fc41bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47630/0 (socket says 172.21.15.145:47630) 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c093d9640 1 -- 172.21.15.145:0/1119690471 learned_addr learned my addr 172.21.15.145:0/1119690471 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c08bd8640 1 -- 172.21.15.145:0/1119690471 >> v1:172.21.15.98:6789/0 conn(0x5629fc414e00 legacy=0x5629fc415b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.928+0000 7f4c08bd8640 1 -- 172.21.15.145:0/1119690471 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc2a66b0 con 0x5629fc416210 2024-09-10T04:52:15.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.930+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/1119690471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc416210 0x5629fc41bdb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000a470 tx=0x7f4c00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714e1a3b38018285 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.930+0000 7f4bfbfff640 1 -- 172.21.15.145:0/1119690471 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c00053570 con 0x5629fc416210 2024-09-10T04:52:15.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.930+0000 7f4bfbfff640 1 -- 172.21.15.145:0/1119690471 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c00058070 con 0x5629fc416210 2024-09-10T04:52:15.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.930+0000 7f4bfbfff640 1 -- 172.21.15.145:0/1119690471 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c00053880 con 0x5629fc416210 2024-09-10T04:52:15.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 -- 172.21.15.145:0/1119690471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc416210 msgr2=0x5629fc41bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1119690471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc416210 0x5629fc41bdb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000a470 tx=0x7f4c00045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:15.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 -- 172.21.15.145:0/1119690471 shutdown_connections 2024-09-10T04:52:15.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1119690471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc416210 0x5629fc41bdb0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 -- 172.21.15.145:0/1119690471 >> 172.21.15.145:0/1119690471 conn(0x5629fc4101d0 msgr2=0x5629fc412630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 -- 172.21.15.145:0/1119690471 shutdown_connections 2024-09-10T04:52:15.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.931+0000 7f4c0d726800 1 -- 172.21.15.145:0/1119690471 wait complete. 2024-09-10T04:52:15.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c0d726800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c0d726800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5629fc2aedd0 con 0x5629fc414e00 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47642/0 (socket says 172.21.15.145:47642) 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c093d9640 1 -- 172.21.15.145:0/1425345465 learned_addr learned my addr 172.21.15.145:0/1425345465 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.945+0000 7f4c093d9640 1 -- 172.21.15.145:0/1425345465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc2c7e10 con 0x5629fc414e00 2024-09-10T04:52:15.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4c093d9640 1 --2- 172.21.15.145:0/1425345465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc001e40 tx=0x7f4bfc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a037d120e031c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4af7606640 1 -- 172.21.15.145:0/1425345465 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc012020 con 0x5629fc414e00 2024-09-10T04:52:15.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4af7606640 1 -- 172.21.15.145:0/1425345465 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00e5a0 con 0x5629fc414e00 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4af7606640 1 -- 172.21.15.145:0/1425345465 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc00e8a0 con 0x5629fc414e00 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4c0d726800 1 -- 172.21.15.145:0/1425345465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 msgr2=0x5629fc388dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.946+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1425345465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc001e40 tx=0x7f4bfc001e70 comp rx=0 tx=0).stop 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- 172.21.15.145:0/1425345465 shutdown_connections 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1425345465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc388dc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- 172.21.15.145:0/1425345465 >> 172.21.15.145:0/1425345465 conn(0x5629fc4101d0 msgr2=0x5629fc4fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- 172.21.15.145:0/1425345465 shutdown_connections 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- 172.21.15.145:0/1425345465 wait complete. 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc50d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c0d726800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5629fc416900 con 0x5629fc414e00 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc50d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc50d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47644/0 (socket says 172.21.15.145:47644) 2024-09-10T04:52:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c093d9640 1 -- 172.21.15.145:0/1689903251 learned_addr learned my addr 172.21.15.145:0/1689903251 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.947+0000 7f4c093d9640 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc50d590 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4c093d9640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc50d030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0012b0 tx=0x7f4bfc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4af5e03640 1 -- 172.21.15.145:0/1689903251 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc012030 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4af5e03640 1 -- 172.21.15.145:0/1689903251 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc01a750 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4af5e03640 1 -- 172.21.15.145:0/1689903251 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc01aa70 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629fc50d820 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.948+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fc50e220 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4af5e03640 1 -- 172.21.15.145:0/1689903251 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4bfc015020 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4af5e03640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4af003c730 0x7f4af003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4af5e03640 1 -- 172.21.15.145:0/1689903251 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4bfc020030 con 0x5629fc414e00 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4af003c730 0x7f4af003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc416210 0x5629fc514680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc50ede0 con 0x5629fc416210 2024-09-10T04:52:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4c09bda640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc416210 0x5629fc514680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.949+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4af003c730 0x7f4af003ebf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c00057000 tx=0x7f4c00052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c09bda640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc416210 0x5629fc514680 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c09bda640 1 -- 172.21.15.145:0/1689903251 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc416210 2024-09-10T04:52:15.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc5155f0 0x5629fc5179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc518020 con 0x5629fc5155f0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c093d9640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc5155f0 0x5629fc5179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.950+0000 7f4c093d9640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc5155f0 0x5629fc5179e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c093d9640 1 -- 172.21.15.145:0/1689903251 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bfc018ce0 con 0x5629fc5155f0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5198d0 con 0x5629fc416210 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c09bda640 1 -- 172.21.15.145:0/1689903251 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc416210 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc518b00 con 0x5629fc5155f0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c093d9640 1 -- 172.21.15.145:0/1689903251 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bfc018ce0 con 0x5629fc5155f0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5629fc51ac80 0x5629fc51d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.951+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc51d5b0 con 0x5629fc51ac80 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.952+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5629fc51ac80 0x5629fc51d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.952+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5629fc51ac80 0x5629fc51d070 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.952+0000 7f4c08bd8640 1 -- 172.21.15.145:0/1689903251 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c00051070 con 0x5629fc51ac80 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.952+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.952+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c0d726800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c0d726800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5629fc30ca00 con 0x5629fc52b100 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47660/0 (socket says 172.21.15.145:47660) 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c093d9640 1 -- 172.21.15.145:0/4164139292 learned_addr learned my addr 172.21.15.145:0/4164139292 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c093d9640 1 -- 172.21.15.145:0/4164139292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc52bb60 con 0x5629fc52b100 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c093d9640 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc018f90 tx=0x7f4bfc04b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4aeeffd640 1 -- 172.21.15.145:0/4164139292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc016910 con 0x5629fc52b100 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4aeeffd640 1 -- 172.21.15.145:0/4164139292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc016ad0 con 0x5629fc52b100 2024-09-10T04:52:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629fc52c390 con 0x5629fc52b100 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4aeeffd640 1 -- 172.21.15.145:0/4164139292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc016df0 con 0x5629fc52b100 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.953+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fc52c930 con 0x5629fc52b100 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.954+0000 7f4aeeffd640 1 -- 172.21.15.145:0/4164139292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4bfc03d060 con 0x5629fc52b100 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.954+0000 7f4aeeffd640 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 0x7f4ae403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.954+0000 7f4aeeffd640 1 -- 172.21.15.145:0/4164139292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4bfc037dd0 con 0x5629fc52b100 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.954+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 0x7f4ae403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.954+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 0x7f4ae403ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5629fc50e620 tx=0x7f4c00005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c0d726800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c0d726800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5629fc508390 con 0x5629fc504270 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47662/0 (socket says 172.21.15.145:47662) 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c093d9640 1 -- 172.21.15.145:0/2951149901 learned_addr learned my addr 172.21.15.145:0/2951149901 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c093d9640 1 -- 172.21.15.145:0/2951149901 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc504c60 con 0x5629fc504270 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4c093d9640 1 --2- 172.21.15.145:0/2951149901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc035590 tx=0x7f4bfc02ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c23759dc7703830 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4aecff9640 1 -- 172.21.15.145:0/2951149901 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc067070 con 0x5629fc504270 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4aecff9640 1 -- 172.21.15.145:0/2951149901 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc024420 con 0x5629fc504270 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.955+0000 7f4aecff9640 1 -- 172.21.15.145:0/2951149901 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc05e040 con 0x5629fc504270 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- 172.21.15.145:0/2951149901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 msgr2=0x5629fc504670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 --2- 172.21.15.145:0/2951149901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc035590 tx=0x7f4bfc02ff70 comp rx=0 tx=0).stop 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- 172.21.15.145:0/2951149901 shutdown_connections 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 --2- 172.21.15.145:0/2951149901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc504670 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- 172.21.15.145:0/2951149901 >> 172.21.15.145:0/2951149901 conn(0x5629fc533de0 msgr2=0x5629fc532020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- 172.21.15.145:0/2951149901 shutdown_connections 2024-09-10T04:52:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- 172.21.15.145:0/2951149901 wait complete. 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 Processor -- start 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- start start 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc540fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.956+0000 7f4c0d726800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5629fc505150 con 0x5629fc504270 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc540fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c093d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc540fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47670/0 (socket says 172.21.15.145:47670) 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 learned_addr learned my addr 172.21.15.145:0/552576491 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fc541530 con 0x5629fc504270 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c093d9640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc540fd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc032fb0 tx=0x7f4bfc032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4adaffd640 1 -- 172.21.15.145:0/552576491 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc070020 con 0x5629fc504270 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4adaffd640 1 -- 172.21.15.145:0/552576491 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc04b780 con 0x5629fc504270 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629fc541530 con 0x5629fc504270 2024-09-10T04:52:15.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4adaffd640 1 -- 172.21.15.145:0/552576491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bfc067040 con 0x5629fc504270 2024-09-10T04:52:15.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.957+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fc541530 con 0x5629fc504270 2024-09-10T04:52:15.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.958+0000 7f4adaffd640 1 -- 172.21.15.145:0/552576491 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4bfc073020 con 0x5629fc504270 2024-09-10T04:52:15.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.958+0000 7f4adaffd640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ad403c730 0x7f4ad403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.958+0000 7f4adaffd640 1 -- 172.21.15.145:0/552576491 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4bfc076d80 con 0x5629fc504270 2024-09-10T04:52:15.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.958+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ad403c730 0x7f4ad403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ad403c730 0x7f4ad403ebf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c00053fd0 tx=0x7f4c00053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc54c590 0x5629fc54ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc54f1a0 con 0x5629fc54c590 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c09bda640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc54c590 0x5629fc54ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c09bda640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc54c590 0x5629fc54ea50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 20 realm 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.959+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc54b8c0 con 0x5629fc54c590 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc54fc30 con 0x5629fc54c590 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc550a10 0x5629fc552e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc553460 con 0x5629fc550a10 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.960+0000 7f4c093d9640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc550a10 0x5629fc552e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c093d9640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc550a10 0x5629fc552e00 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc553cb0 con 0x5629fc54c590 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 20 searching for the correct realm 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5629fc555a20 0x5629fc557e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5629fc555a20 0x5629fc557e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.961+0000 7f4c08bd8640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5629fc555a20 0x5629fc557e50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c093d9640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4bfc080040 0x7f4bfc0142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c09bda640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4bfc080040 0x7f4bfc0142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.962+0000 7f4c09bda640 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4bfc080040 0x7f4bfc0142c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c0400a4d0 con 0x7f4bfc080040 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.963+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0400a4d0 con 0x5629fc54c590 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.964+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.965+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.966+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.967+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc54c590 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x7f4bfc080040 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c04030040 con 0x7f4bfc080040 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.968+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc555a20 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.969+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5629fc558520 con 0x5629fc550a10 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc554630 con 0x5629fc54c590 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c04030040 con 0x5629fc54c590 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc554ed0 con 0x5629fc550a10 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.970+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc554270 con 0x7f4bfc080040 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 zone default found 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 4 Realm: () 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 zonegroup default 2024-09-10T04:52:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5589a0 con 0x7f4bfc080040 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55a820 con 0x5629fc555a20 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55ad30 con 0x5629fc555a20 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 started sync module instance, tier type = 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.971+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc559c70 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.973+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.973+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738327118224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc559c70 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.973+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55b7b0 con 0x5629fc54c590 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.974+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738327118224] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.974+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.974+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738327116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55b7b0 con 0x5629fc54c590 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.974+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55c200 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.975+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738327116192] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.975+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.975+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738327125232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55b7b0 con 0x5629fc550a10 2024-09-10T04:52:15.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.975+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55cc70 con 0x7f4bfc080040 2024-09-10T04:52:15.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.976+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738327125232] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.977+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.977+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738327127904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55cc30 con 0x7f4bfc080040 2024-09-10T04:52:15.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.977+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55d720 con 0x5629fc550a10 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.978+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738327127904] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.978+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.978+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738327130608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55d6e0 con 0x5629fc550a10 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.978+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55e130 con 0x5629fc555a20 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.979+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738327130608] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.979+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.979+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738327133312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55e520 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.979+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55ef20 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.980+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738327133312] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.981+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.981+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738327122688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55f310 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.981+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55fd50 con 0x7f4bfc080040 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738327122688] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738327140384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55fd10 con 0x7f4bfc080040 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=0 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=1 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=2 2024-09-10T04:52:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=3 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=4 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=5 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.982+0000 7f4c0d726800 20 add_watcher() i=6 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738327140384] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c0d726800 20 add_watcher() i=7 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c0d726800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc55fd10 con 0x5629fc54c590 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.983+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738327142640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5609c0 con 0x5629fc54c590 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738327142640] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4abf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 5 note: GC not initialized 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4abe7e4640 20 reqs_thread_entry: start 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 20 Filter name: none 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4a2ffff640 20 reqs_thread_entry: start 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.985+0000 7f4c0d726800 20 rados->read ofs=0 len=0 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc596290 con 0x5629fc54c590 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T04:52:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.986+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc59c6d0 con 0x5629fc54c590 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.987+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.987+0000 7f4c0d726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.987+0000 7f4c0d726800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.987+0000 7f4c0d726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.987+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94738327388368 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5629fc597d70 con 0x5629fc550a10 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94738327130608 notify 146028888115 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5629fc52c390 con 0x5629fc550a10 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4aecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888115 cookie 94738327130608 notifier 4874 bl.length()=666 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94738327388368 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4aecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:15.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4aecff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4aecff9640 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4acc003ea0 con 0x5629fc550a10 2024-09-10T04:52:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.988+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94738327388368 notify 146028888115 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5629fc52bb60 con 0x5629fc550a10 2024-09-10T04:52:15.999 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.989+0000 7f4abf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.989+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738327142640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc54c590 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.990+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94738327142640] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.990+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738327118224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc550a10 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.991+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94738327118224] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.991+0000 7f4c0d726800 20 remove_watcher() i=0 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.991+0000 7f4c0d726800 2 removed watcher, disabling cache 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.991+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738327116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc54c590 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.992+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94738327116192] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x5629fc54c590 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.992+0000 7f4c0d726800 20 remove_watcher() i=1 2024-09-10T04:52:16.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.992+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738327125232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc550a10 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.993+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94738327125232] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.993+0000 7f4c0d726800 20 remove_watcher() i=2 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.993+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738327127904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x7f4bfc080040 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.994+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94738327127904] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.994+0000 7f4c0d726800 20 remove_watcher() i=3 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.994+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738327130608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc550a10 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.995+0000 7f4c093d9640 1 -- 172.21.15.145:0/552576491 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94738327130608] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bfc06a040 con 0x5629fc550a10 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.995+0000 7f4c0d726800 20 remove_watcher() i=4 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.995+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738327133312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc555a20 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.996+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94738327133312] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.996+0000 7f4c0d726800 20 remove_watcher() i=5 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.996+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738327122688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x5629fc555a20 2024-09-10T04:52:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.997+0000 7f4c08bd8640 1 -- 172.21.15.145:0/552576491 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94738327122688] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0007c040 con 0x5629fc555a20 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.997+0000 7f4c0d726800 20 remove_watcher() i=6 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.997+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738327140384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5629fc5940c0 con 0x7f4bfc080040 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.998+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94738327140384] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c04041040 con 0x7f4bfc080040 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.998+0000 7f4c0d726800 20 remove_watcher() i=7 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc550a10 msgr2=0x5629fc552e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc550a10 0x5629fc552e00 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc54c590 msgr2=0x5629fc54ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc54c590 0x5629fc54ea50 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4bfc080040 msgr2=0x7f4bfc0142c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f4bfc080040 0x7f4bfc0142c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5629fc555a20 msgr2=0x5629fc557e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5629fc555a20 0x5629fc557e50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ad403c730 msgr2=0x7f4ad403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ad403c730 0x7f4ad403ebf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c00053fd0 tx=0x7f4c00053000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 msgr2=0x5629fc540fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/552576491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc504270 0x5629fc540fd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc032fb0 tx=0x7f4bfc032f40 comp rx=0 tx=0).stop 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 reap_dead start 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c09bda640 1 -- 172.21.15.145:0/552576491 reap_dead start 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 shutdown_connections 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 >> 172.21.15.145:0/552576491 conn(0x5629fc533de0 msgr2=0x5629fc531ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 shutdown_connections 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/552576491 wait complete. 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 msgr2=0x7f4ae403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 0x7f4ae403ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5629fc50e620 tx=0x7f4c00005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 msgr2=0x5629fc52b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc018f90 tx=0x7f4bfc04b2c0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 shutdown_connections 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4ae403c730 0x7f4ae403ebf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 --2- 172.21.15.145:0/4164139292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc52b100 0x5629fc52b520 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 >> 172.21.15.145:0/4164139292 conn(0x5629fc51f4b0 msgr2=0x5629fc51f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 shutdown_connections 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:15.999+0000 7f4c0d726800 1 -- 172.21.15.145:0/4164139292 wait complete. 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc5155f0 msgr2=0x5629fc5179e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5629fc5155f0 0x5629fc5179e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc416210 msgr2=0x5629fc514680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5629fc416210 0x5629fc514680 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5629fc51ac80 msgr2=0x5629fc51d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5629fc51ac80 0x5629fc51d070 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4af003c730 msgr2=0x7f4af003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4af003c730 0x7f4af003ebf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c00057000 tx=0x7f4c00052000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 msgr2=0x5629fc50d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 --2- 172.21.15.145:0/1689903251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5629fc414e00 0x5629fc50d030 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0012b0 tx=0x7f4bfc000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c09bda640 1 -- 172.21.15.145:0/1689903251 reap_dead start 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 shutdown_connections 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 >> 172.21.15.145:0/1689903251 conn(0x5629fc4101d0 msgr2=0x5629fc4fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 shutdown_connections 2024-09-10T04:52:16.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.000+0000 7f4c0d726800 1 -- 172.21.15.145:0/1689903251 wait complete. 2024-09-10T04:52:16.011 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.011 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.011 ERROR:root:0 2024-09-10T04:52:16.011 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:16.015 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T04:52:16.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T04:52:16.016 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-10T04:52:16.062 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.063 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acd240800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555adf7236f0 0x555adf725ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acd240800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555adf5cce40 con 0x555adf726020 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acd240800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x555adf597680 con 0x555adf7236f0 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acad2a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555adf7236f0 0x555adf725ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0aca529640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x555adf726020 0x555adf7284e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36948/0 (socket says 172.21.15.145:36948) 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0acad2a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555adf7236f0 0x555adf725ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47676/0 (socket says 172.21.15.145:47676) 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.062+0000 7f0aca529640 1 -- 172.21.15.145:0/1261485502 learned_addr learned my addr 172.21.15.145:0/1261485502 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:16.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.063+0000 7f0acad2a640 1 -- 172.21.15.145:0/1261485502 >> v1:172.21.15.98:6789/0 conn(0x555adf726020 legacy=0x555adf7284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.063+0000 7f0acad2a640 1 -- 172.21.15.145:0/1261485502 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf5b36b0 con 0x555adf7236f0 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.064+0000 7f0acad2a640 1 --2- 172.21.15.145:0/1261485502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf725ae0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00a470 tx=0x7f0abc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5992b485f6f63ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0ac9d28640 1 -- 172.21.15.145:0/1261485502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc053570 con 0x555adf7236f0 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0ac9d28640 1 -- 172.21.15.145:0/1261485502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc058070 con 0x555adf7236f0 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0ac9d28640 1 -- 172.21.15.145:0/1261485502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc053880 con 0x555adf7236f0 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 -- 172.21.15.145:0/1261485502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 msgr2=0x555adf725ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 --2- 172.21.15.145:0/1261485502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf725ae0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00a470 tx=0x7f0abc045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 -- 172.21.15.145:0/1261485502 shutdown_connections 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 --2- 172.21.15.145:0/1261485502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf725ae0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 -- 172.21.15.145:0/1261485502 >> 172.21.15.145:0/1261485502 conn(0x555adf71d1d0 msgr2=0x555adf71f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 -- 172.21.15.145:0/1261485502 shutdown_connections 2024-09-10T04:52:16.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.065+0000 7f0acd240800 1 -- 172.21.15.145:0/1261485502 wait complete. 2024-09-10T04:52:16.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.079+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.079+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.079+0000 7f0acd240800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.079+0000 7f0acd240800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555adf5bbdd0 con 0x555adf7236f0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47684/0 (socket says 172.21.15.145:47684) 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f0acad2a640 1 -- 172.21.15.145:0/3065464000 learned_addr learned my addr 172.21.15.145:0/3065464000 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f0acad2a640 1 -- 172.21.15.145:0/3065464000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf5d4e10 con 0x555adf7236f0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f0acad2a640 1 --2- 172.21.15.145:0/3065464000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0abc025c20 tx=0x7f0abc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fe5096e6c46337 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f09b8e09640 1 -- 172.21.15.145:0/3065464000 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc053a20 con 0x555adf7236f0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f09b8e09640 1 -- 172.21.15.145:0/3065464000 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc063070 con 0x555adf7236f0 2024-09-10T04:52:16.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.080+0000 7f09b8e09640 1 -- 172.21.15.145:0/3065464000 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc053cf0 con 0x555adf7236f0 2024-09-10T04:52:16.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 -- 172.21.15.145:0/3065464000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 msgr2=0x555adf722e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 --2- 172.21.15.145:0/3065464000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0abc025c20 tx=0x7f0abc051000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 -- 172.21.15.145:0/3065464000 shutdown_connections 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 --2- 172.21.15.145:0/3065464000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf722e80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 -- 172.21.15.145:0/3065464000 >> 172.21.15.145:0/3065464000 conn(0x555adf71d1d0 msgr2=0x555adf80e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 -- 172.21.15.145:0/3065464000 shutdown_connections 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 -- 172.21.15.145:0/3065464000 wait complete. 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.081+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acd240800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf81c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acd240800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555adf72a040 con 0x555adf7236f0 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf81c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf81c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47696/0 (socket says 172.21.15.145:47696) 2024-09-10T04:52:16.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acad2a640 1 -- 172.21.15.145:0/1854660096 learned_addr learned my addr 172.21.15.145:0/1854660096 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acad2a640 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf81c6b0 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.082+0000 7f0acad2a640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf81c150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0abc025c20 tx=0x7f0abc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f09b7606640 1 -- 172.21.15.145:0/1854660096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc06c030 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f09b7606640 1 -- 172.21.15.145:0/1854660096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc068660 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555adf81c940 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f09b7606640 1 -- 172.21.15.145:0/1854660096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc068940 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adf81d340 con 0x555adf7236f0 2024-09-10T04:52:16.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.083+0000 7f09b7606640 1 -- 172.21.15.145:0/1854660096 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0abc068ae0 con 0x555adf7236f0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f09b7606640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09b003c730 0x7f09b003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f09b7606640 1 -- 172.21.15.145:0/1854660096 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f0abc098120 con 0x555adf7236f0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0aca529640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09b003c730 0x7f09b003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf726020 0x555adf8237a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf823ce0 con 0x555adf726020 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0acb52b640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf726020 0x555adf8237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0aca529640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09b003c730 0x7f09b003ebf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001d70 tx=0x7f0ab40012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.084+0000 7f0acb52b640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf726020 0x555adf8237a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acb52b640 1 -- 172.21.15.145:0/1854660096 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf726020 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf824590 0x555adf826a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf8271c0 con 0x555adf824590 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acad2a640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf824590 0x555adf826a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acad2a640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf824590 0x555adf826a50 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acad2a640 1 -- 172.21.15.145:0/1854660096 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0abc051070 con 0x555adf824590 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.085+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf828a70 con 0x555adf726020 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0acb52b640 1 -- 172.21.15.145:0/1854660096 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf726020 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf827ca0 con 0x555adf824590 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0acad2a640 1 -- 172.21.15.145:0/1854660096 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0abc051070 con 0x555adf824590 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555adf829e20 0x555adf82c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf82c750 con 0x555adf829e20 2024-09-10T04:52:16.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0aca529640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555adf829e20 0x555adf82c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.086+0000 7f0aca529640 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555adf829e20 0x555adf82c210 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0aca529640 1 -- 172.21.15.145:0/1854660096 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf829e20 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0acd240800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0acd240800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555adf619a00 con 0x555adf83a2e0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.087+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47704/0 (socket says 172.21.15.145:47704) 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acad2a640 1 -- 172.21.15.145:0/1813116224 learned_addr learned my addr 172.21.15.145:0/1813116224 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acad2a640 1 -- 172.21.15.145:0/1813116224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf83ad40 con 0x555adf83a2e0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acad2a640 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07b8e0 tx=0x7f0abc052460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f09b4e01640 1 -- 172.21.15.145:0/1813116224 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc08c020 con 0x555adf83a2e0 2024-09-10T04:52:16.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f09b4e01640 1 -- 172.21.15.145:0/1813116224 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc07bbd0 con 0x555adf83a2e0 2024-09-10T04:52:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555adf83b570 con 0x555adf83a2e0 2024-09-10T04:52:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f09b4e01640 1 -- 172.21.15.145:0/1813116224 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc05daf0 con 0x555adf83a2e0 2024-09-10T04:52:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.088+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adf83bb10 con 0x555adf83a2e0 2024-09-10T04:52:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.089+0000 7f09b4e01640 1 -- 172.21.15.145:0/1813116224 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0abc086040 con 0x555adf83a2e0 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.089+0000 7f09b4e01640 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 0x7f09a403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.089+0000 7f09b4e01640 1 -- 172.21.15.145:0/1813116224 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f0abc083040 con 0x555adf83a2e0 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.089+0000 7f0aca529640 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 0x7f09a403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0aca529640 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 0x7f09a403ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400bf40 tx=0x7f0ab400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acd240800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acd240800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555adf721720 con 0x555adf846c00 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47714/0 (socket says 172.21.15.145:47714) 2024-09-10T04:52:16.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acad2a640 1 -- 172.21.15.145:0/742484036 learned_addr learned my addr 172.21.15.145:0/742484036 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acad2a640 1 -- 172.21.15.145:0/742484036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf8475d0 con 0x555adf846c00 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f0acad2a640 1 --2- 172.21.15.145:0/742484036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07cfd0 tx=0x7f0abc04d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fd37b570b711d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f09ae7fc640 1 -- 172.21.15.145:0/742484036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc05ed40 con 0x555adf846c00 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f09ae7fc640 1 -- 172.21.15.145:0/742484036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc05dc90 con 0x555adf846c00 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.090+0000 7f09ae7fc640 1 -- 172.21.15.145:0/742484036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc08fd00 con 0x555adf846c00 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- 172.21.15.145:0/742484036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 msgr2=0x555adf846fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 --2- 172.21.15.145:0/742484036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07cfd0 tx=0x7f0abc04d840 comp rx=0 tx=0).stop 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- 172.21.15.145:0/742484036 shutdown_connections 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 --2- 172.21.15.145:0/742484036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf846fe0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- 172.21.15.145:0/742484036 >> 172.21.15.145:0/742484036 conn(0x555adf843000 msgr2=0x555adf841240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- 172.21.15.145:0/742484036 shutdown_connections 2024-09-10T04:52:16.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- 172.21.15.145:0/742484036 wait complete. 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 Processor -- start 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- start start 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.091+0000 7f0acd240800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555adf847a60 con 0x555adf846c00 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acad2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47730/0 (socket says 172.21.15.145:47730) 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 learned_addr learned my addr 172.21.15.145:0/2187258089 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf84e560 con 0x555adf846c00 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acad2a640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07cfd0 tx=0x7f0abc060f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f09acff9640 1 -- 172.21.15.145:0/2187258089 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc05e5f0 con 0x555adf846c00 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f09acff9640 1 -- 172.21.15.145:0/2187258089 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc05e7b0 con 0x555adf846c00 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555adf84e7f0 con 0x555adf846c00 2024-09-10T04:52:16.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f09acff9640 1 -- 172.21.15.145:0/2187258089 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc05ea90 con 0x555adf846c00 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.092+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adf84e7f0 con 0x555adf846c00 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.093+0000 7f09acff9640 1 -- 172.21.15.145:0/2187258089 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0abc0ba020 con 0x555adf846c00 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.093+0000 7f09acff9640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f099403c730 0x7f099403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.093+0000 7f09acff9640 1 -- 172.21.15.145:0/2187258089 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f0abc0bdd70 con 0x555adf846c00 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.093+0000 7f0aca529640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f099403c730 0x7f099403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0aca529640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f099403c730 0x7f099403ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c010 tx=0x7f0ab4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf859620 0x555adf85bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf85c230 con 0x555adf859620 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0acb52b640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf859620 0x555adf85bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.094+0000 7f0acb52b640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf859620 0x555adf85bae0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 realm 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf858950 con 0x555adf859620 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf85ccc0 con 0x555adf859620 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf85daa0 0x555adf85fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf8604f0 con 0x555adf85daa0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acad2a640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf85daa0 0x555adf85fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.095+0000 7f0acad2a640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf85daa0 0x555adf85fe90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf860d40 con 0x555adf859620 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 20 searching for the correct realm 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555adf862ab0 0x555adf864ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0aca529640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555adf862ab0 0x555adf864ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.096+0000 7f0aca529640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555adf862ab0 0x555adf864ee0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0acad2a640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0abc0a3040 0x7f0abc096760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0acb52b640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0abc0a3040 0x7f0abc096760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.097+0000 7f0acb52b640 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0abc0a3040 0x7f0abc096760 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ac400a4d0 con 0x7f0abc0a3040 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.098+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac400a4d0 con 0x555adf859620 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.099+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.100+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.101+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.102+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x7f0abc0a3040 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ac4030040 con 0x7f0abc0a3040 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.103+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf862ab0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555adf8655b0 con 0x555adf85daa0 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.104+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf8616f0 con 0x555adf859620 2024-09-10T04:52:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ac4030040 con 0x555adf859620 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf861f90 con 0x555adf85daa0 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf861330 con 0x7f0abc0a3040 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 zone default found 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 4 Realm: () 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 zonegroup default 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.105+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf865a30 con 0x7f0abc0a3040 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf867520 con 0x555adf862ab0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf867aa0 con 0x555adf862ab0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 started sync module instance, tier type = 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.106+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8668c0 con 0x555adf85daa0 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.107+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.107+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93848785546688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8668c0 con 0x555adf85daa0 2024-09-10T04:52:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.107+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf868520 con 0x555adf859620 2024-09-10T04:52:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.108+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93848785546688] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.108+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.108+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93848785544208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf868520 con 0x555adf859620 2024-09-10T04:52:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.108+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf868fa0 con 0x555adf85daa0 2024-09-10T04:52:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.109+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93848785544208] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.109+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.109+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93848785554064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf868520 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.109+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf869a60 con 0x7f0abc0a3040 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.110+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93848785554064] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.111+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.111+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93848785556784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf868520 con 0x7f0abc0a3040 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.111+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86a4b0 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.112+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.112+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93848785559488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86a3e0 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.112+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86b3e0 con 0x555adf862ab0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.112+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93848785556784] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.113+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93848785559488] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.113+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.113+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93848785561760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86aef0 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.113+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86bda0 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.114+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93848785561760] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.114+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.114+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93848785551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86c5f0 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.114+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86ce40 con 0x7f0abc0a3040 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93848785551472] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93848785570192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86cdb0 con 0x7f0abc0a3040 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=0 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=1 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=2 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=3 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=4 2024-09-10T04:52:16.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=5 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.115+0000 7f0acd240800 20 add_watcher() i=6 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93848785570192] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acd240800 20 add_watcher() i=7 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acd240800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf870710 con 0x555adf859620 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.117+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93848785572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf86dbd0 con 0x555adf859620 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.118+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93848785572320] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.118+0000 7f0981fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 5 note: GC not initialized 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0980fe1640 20 reqs_thread_entry: start 2024-09-10T04:52:16.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 20 Filter name: none 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0979ffb640 20 reqs_thread_entry: start 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.119+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a3780 con 0x555adf859620 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acd240800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acd240800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acd240800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acd240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.120+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a9d10 con 0x555adf859620 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acd240800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acd240800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acd240800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93848785819344 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a5350 con 0x555adf85daa0 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93848785559488 notify 146028888116 ret 0) ==== 708+0+0 (crc 0 0 0) 0x555adf83b570 con 0x555adf85daa0 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f09ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888116 cookie 93848785559488 notifier 4881 bl.length()=666 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93848785819344 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f09ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f09ae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f09ae7fc640 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0990003ea0 con 0x555adf85daa0 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.121+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.122+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93848785819344 notify 146028888116 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555adf83ad40 con 0x555adf85daa0 2024-09-10T04:52:16.134 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.122+0000 7f0981fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.122+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93848785572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf859620 2024-09-10T04:52:16.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.123+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93848785572320] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.123+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93848785546688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf85daa0 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.124+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93848785546688] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.124+0000 7f0acd240800 20 remove_watcher() i=0 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.124+0000 7f0acd240800 2 removed watcher, disabling cache 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.124+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93848785544208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf859620 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.125+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93848785544208] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x555adf859620 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.125+0000 7f0acd240800 20 remove_watcher() i=1 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.125+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93848785554064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf85daa0 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.126+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93848785554064] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.126+0000 7f0acd240800 20 remove_watcher() i=2 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.126+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93848785556784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x7f0abc0a3040 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.127+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93848785556784] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.127+0000 7f0acd240800 20 remove_watcher() i=3 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.127+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93848785559488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf85daa0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.129+0000 7f0acad2a640 1 -- 172.21.15.145:0/2187258089 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93848785559488] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0abc08e020 con 0x555adf85daa0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.129+0000 7f0acd240800 20 remove_watcher() i=4 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.129+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93848785561760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf862ab0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.130+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93848785561760] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.130+0000 7f0acd240800 20 remove_watcher() i=5 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.130+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93848785551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x555adf862ab0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.131+0000 7f0aca529640 1 -- 172.21.15.145:0/2187258089 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93848785551472] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ab4009050 con 0x555adf862ab0 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.131+0000 7f0acd240800 20 remove_watcher() i=6 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.131+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93848785570192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555adf8a15f0 con 0x7f0abc0a3040 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.131+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93848785570192] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ac4041040 con 0x7f0abc0a3040 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 20 remove_watcher() i=7 2024-09-10T04:52:16.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf85daa0 msgr2=0x555adf85fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf85daa0 0x555adf85fe90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf859620 msgr2=0x555adf85bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf859620 0x555adf85bae0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0abc0a3040 msgr2=0x7f0abc096760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f0abc0a3040 0x7f0abc096760 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555adf862ab0 msgr2=0x555adf864ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555adf862ab0 0x555adf864ee0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f099403c730 msgr2=0x7f099403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f099403c730 0x7f099403ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c010 tx=0x7f0ab4010000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 msgr2=0x555adf84e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acb52b640 1 -- 172.21.15.145:0/2187258089 reap_dead start 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07cfd0 tx=0x7f0abc060f90 comp rx=0 tx=0).stop 2024-09-10T04:52:16.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 shutdown_connections 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/2187258089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf846c00 0x555adf84e000 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 >> 172.21.15.145:0/2187258089 conn(0x555adf843000 msgr2=0x555adf841210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 shutdown_connections 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/2187258089 wait complete. 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 msgr2=0x7f09a403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 0x7f09a403ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400bf40 tx=0x7f0ab400f000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 msgr2=0x555adf83a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0abc07b8e0 tx=0x7f0abc052460 comp rx=0 tx=0).stop 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 shutdown_connections 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09a403c780 0x7f09a403ec40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 --2- 172.21.15.145:0/1813116224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf83a2e0 0x555adf83a700 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 >> 172.21.15.145:0/1813116224 conn(0x555adf82e690 msgr2=0x555adf82ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 shutdown_connections 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.132+0000 7f0acd240800 1 -- 172.21.15.145:0/1813116224 wait complete. 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf824590 msgr2=0x555adf826a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555adf824590 0x555adf826a50 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf726020 msgr2=0x555adf8237a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555adf726020 0x555adf8237a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555adf829e20 msgr2=0x555adf82c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555adf829e20 0x555adf82c210 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09b003c730 msgr2=0x7f09b003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f09b003c730 0x7f09b003ebf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001d70 tx=0x7f0ab40012d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 msgr2=0x555adf81c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 --2- 172.21.15.145:0/1854660096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555adf7236f0 0x555adf81c150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0abc025c20 tx=0x7f0abc002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acb52b640 1 -- 172.21.15.145:0/1854660096 reap_dead start 2024-09-10T04:52:16.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 shutdown_connections 2024-09-10T04:52:16.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 >> 172.21.15.145:0/1854660096 conn(0x555adf71d1d0 msgr2=0x555adf80dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 shutdown_connections 2024-09-10T04:52:16.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.133+0000 7f0acd240800 1 -- 172.21.15.145:0/1854660096 wait complete. 2024-09-10T04:52:16.145 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.145 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.145 ERROR:root:0 2024-09-10T04:52:16.145 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:16.150 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.150 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T04:52:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51f0546800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555e54d0b220 0x555e54d0d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51f0546800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e54bb0e40 con 0x555e54d07710 2024-09-10T04:52:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51f0546800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x555e54b7b680 con 0x555e54d0b220 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ed836640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555e54d0b220 0x555e54d0d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ee037640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x555e54d07710 0x555e54d09b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36954/0 (socket says 172.21.15.145:36954) 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ed836640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x555e54d0b220 0x555e54d0d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47732/0 (socket says 172.21.15.145:47732) 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ee037640 1 -- 172.21.15.145:0/36289531 learned_addr learned my addr 172.21.15.145:0/36289531 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ed836640 1 -- 172.21.15.145:0/36289531 >> v1:172.21.15.98:6789/0 conn(0x555e54d07710 legacy=0x555e54d09b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.197+0000 7f51ed836640 1 -- 172.21.15.145:0/36289531 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54b976b0 con 0x555e54d0b220 2024-09-10T04:52:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.199+0000 7f51ed836640 1 --2- 172.21.15.145:0/36289531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d0b220 0x555e54d0d6c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f51d800a470 tx=0x7f51d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73fb8a813ed2850 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.199+0000 7f51ed035640 1 -- 172.21.15.145:0/36289531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8053570 con 0x555e54d0b220 2024-09-10T04:52:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.199+0000 7f51ed035640 1 -- 172.21.15.145:0/36289531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d8058070 con 0x555e54d0b220 2024-09-10T04:52:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.199+0000 7f51ed035640 1 -- 172.21.15.145:0/36289531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8053880 con 0x555e54d0b220 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 -- 172.21.15.145:0/36289531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d0b220 msgr2=0x555e54d0d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 --2- 172.21.15.145:0/36289531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d0b220 0x555e54d0d6c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f51d800a470 tx=0x7f51d8045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 -- 172.21.15.145:0/36289531 shutdown_connections 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 --2- 172.21.15.145:0/36289531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d0b220 0x555e54d0d6c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 -- 172.21.15.145:0/36289531 >> 172.21.15.145:0/36289531 conn(0x555e54d011d0 msgr2=0x555e54d03630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 -- 172.21.15.145:0/36289531 shutdown_connections 2024-09-10T04:52:16.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.200+0000 7f51f0546800 1 -- 172.21.15.145:0/36289531 wait complete. 2024-09-10T04:52:16.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51f0546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51f0546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555e54b9fdd0 con 0x555e54d07710 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47738/0 (socket says 172.21.15.145:47738) 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.214+0000 7f51ee037640 1 -- 172.21.15.145:0/4215754680 learned_addr learned my addr 172.21.15.145:0/4215754680 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.215+0000 7f51ee037640 1 -- 172.21.15.145:0/4215754680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54bb8e10 con 0x555e54d07710 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.215+0000 7f51ee037640 1 --2- 172.21.15.145:0/4215754680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001800 tx=0x7f51e8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f525862c10851a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.215+0000 7f50dc608640 1 -- 172.21.15.145:0/4215754680 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8004520 con 0x555e54d07710 2024-09-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.215+0000 7f50dc608640 1 -- 172.21.15.145:0/4215754680 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80046c0 con 0x555e54d07710 2024-09-10T04:52:16.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.215+0000 7f50dc608640 1 -- 172.21.15.145:0/4215754680 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e80049e0 con 0x555e54d07710 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- 172.21.15.145:0/4215754680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 msgr2=0x555e54df66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 --2- 172.21.15.145:0/4215754680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001800 tx=0x7f51e8001cc0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- 172.21.15.145:0/4215754680 shutdown_connections 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 --2- 172.21.15.145:0/4215754680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54df66e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- 172.21.15.145:0/4215754680 >> 172.21.15.145:0/4215754680 conn(0x555e54d011d0 msgr2=0x555e54df2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- 172.21.15.145:0/4215754680 shutdown_connections 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- 172.21.15.145:0/4215754680 wait complete. 2024-09-10T04:52:16.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54dfe060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.216+0000 7f51f0546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555e54d0e040 con 0x555e54d07710 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54dfe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54dfe060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47746/0 (socket says 172.21.15.145:47746) 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51ee037640 1 -- 172.21.15.145:0/449587162 learned_addr learned my addr 172.21.15.145:0/449587162 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51ee037640 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54dfe5c0 con 0x555e54d07710 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51ee037640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54dfe060 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f80 tx=0x7f51e8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f50dae05640 1 -- 172.21.15.145:0/449587162 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8022020 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f50dae05640 1 -- 172.21.15.145:0/449587162 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8014890 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f50dae05640 1 -- 172.21.15.145:0/449587162 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8014bb0 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e54dfe850 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.217+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e54dff250 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f50dae05640 1 -- 172.21.15.145:0/449587162 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f51e8025020 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f50dae05640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50d403c730 0x7f50d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f50dae05640 1 -- 172.21.15.145:0/449587162 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f51e8018030 con 0x555e54d07710 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f51ed836640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50d403c730 0x7f50d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54d0b220 0x555e54e056b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e05bf0 con 0x555e54d0b220 2024-09-10T04:52:16.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.218+0000 7f51ee838640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54d0b220 0x555e54e056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51ed836640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50d403c730 0x7f50d403ebf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f51d8057000 tx=0x7f51d8052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51ee838640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54d0b220 0x555e54e056b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51ee838640 1 -- 172.21.15.145:0/449587162 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54d0b220 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e064a0 0x555e54e08960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e090d0 con 0x555e54e064a0 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.219+0000 7f51ee037640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e064a0 0x555e54e08960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51ee037640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e064a0 0x555e54e08960 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51ee037640 1 -- 172.21.15.145:0/449587162 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51e8046040 con 0x555e54e064a0 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e0a980 con 0x555e54d0b220 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51ee838640 1 -- 172.21.15.145:0/449587162 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54d0b220 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e09bb0 con 0x555e54e064a0 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.220+0000 7f51ee037640 1 -- 172.21.15.145:0/449587162 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51e8046040 con 0x555e54e064a0 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555e54e0bd30 0x555e54e0e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e0e660 con 0x555e54e0bd30 2024-09-10T04:52:16.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51ed836640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555e54e0bd30 0x555e54e0e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51ed836640 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555e54e0bd30 0x555e54e0e120 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51ed836640 1 -- 172.21.15.145:0/449587162 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51d8051070 con 0x555e54e0bd30 2024-09-10T04:52:16.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.221+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51f0546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51f0546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555e54bfda00 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47754/0 (socket says 172.21.15.145:47754) 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51ee037640 1 -- 172.21.15.145:0/4003185838 learned_addr learned my addr 172.21.15.145:0/4003185838 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.222+0000 7f51ee037640 1 -- 172.21.15.145:0/4003185838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54d073f0 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f51ee037640 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51e8051fc0 tx=0x7f51e8010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f50d3fff640 1 -- 172.21.15.145:0/4003185838 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e801e730 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f50d3fff640 1 -- 172.21.15.145:0/4003185838 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e801e8d0 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e54d05c80 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f50d3fff640 1 -- 172.21.15.145:0/4003185838 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e804af60 con 0x555e54d06ed0 2024-09-10T04:52:16.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e54d06220 con 0x555e54d06ed0 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.223+0000 7f50d3fff640 1 -- 172.21.15.145:0/4003185838 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f51e8010070 con 0x555e54d06ed0 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f50d3fff640 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 0x7f50c803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f50d3fff640 1 -- 172.21.15.145:0/4003185838 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f51e803dd90 con 0x555e54d06ed0 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51ed836640 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 0x7f50c803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51ed836640 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 0x7f50c803ebf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x555e54dfff90 tx=0x7f51d8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51f0546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51f0546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555e54df6f30 con 0x555e54e2ad00 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47760/0 (socket says 172.21.15.145:47760) 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.224+0000 7f51ee037640 1 -- 172.21.15.145:0/2932545146 learned_addr learned my addr 172.21.15.145:0/2932545146 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51ee037640 1 -- 172.21.15.145:0/2932545146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54e2b6f0 con 0x555e54e2ad00 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51ee037640 1 --2- 172.21.15.145:0/2932545146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51e8037fd0 tx=0x7f51e804b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93b066abf5b671f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f50d1ffb640 1 -- 172.21.15.145:0/2932545146 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8061020 con 0x555e54e2ad00 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f50d1ffb640 1 -- 172.21.15.145:0/2932545146 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8053e50 con 0x555e54e2ad00 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f50d1ffb640 1 -- 172.21.15.145:0/2932545146 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e80125b0 con 0x555e54e2ad00 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 -- 172.21.15.145:0/2932545146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 msgr2=0x555e54e2b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 --2- 172.21.15.145:0/2932545146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51e8037fd0 tx=0x7f51e804b4d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 -- 172.21.15.145:0/2932545146 shutdown_connections 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 --2- 172.21.15.145:0/2932545146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e2b100 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 -- 172.21.15.145:0/2932545146 >> 172.21.15.145:0/2932545146 conn(0x555e54e27100 msgr2=0x555e54e25340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 -- 172.21.15.145:0/2932545146 shutdown_connections 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.225+0000 7f51f0546800 1 -- 172.21.15.145:0/2932545146 wait complete. 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51f0546800 1 Processor -- start 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51f0546800 1 -- start start 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51f0546800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51f0546800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555e54e2bb60 con 0x555e54e2ad00 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51ee037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47774/0 (socket says 172.21.15.145:47774) 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 learned_addr learned my addr 172.21.15.145:0/2874959925 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e54e32680 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f51ee037640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f51e801ea80 tx=0x7f51e8048e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.226+0000 7f50bffff640 1 -- 172.21.15.145:0/2874959925 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8076070 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.227+0000 7f50bffff640 1 -- 172.21.15.145:0/2874959925 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e804bce0 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.227+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e54e32680 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.227+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e54e32680 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.227+0000 7f50bffff640 1 -- 172.21.15.145:0/2874959925 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51e8030430 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.227+0000 7f50bffff640 1 -- 172.21.15.145:0/2874959925 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f51e8079070 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f50bffff640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50b803c710 0x7f50b803ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f50bffff640 1 -- 172.21.15.145:0/2874959925 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f51e806c030 con 0x555e54e2ad00 2024-09-10T04:52:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51ed836640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50b803c710 0x7f50b803ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51ed836640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50b803c710 0x7f50b803ebd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51d8000c00 tx=0x7f51d8053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54e3d650 0x555e54e3fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e40260 con 0x555e54e3d650 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.228+0000 7f51ee838640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54e3d650 0x555e54e3fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51ee838640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54e3d650 0x555e54e3fb10 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54e3d650 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 realm 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e3c980 con 0x555e54e3d650 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54e3d650 2024-09-10T04:52:16.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e40cf0 con 0x555e54e3d650 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54e3d650 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e41ad0 0x555e54e43ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.229+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44520 con 0x555e54e41ad0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51ee037640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e41ad0 0x555e54e43ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51ee037640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e41ad0 0x555e54e43ec0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51f0546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.230+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54e3d650 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51f0546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51f0546800 20 searching for the correct realm 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555e54e46ae0 0x555e54e48f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e495e0 con 0x555e54e46ae0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51ed836640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555e54e46ae0 0x555e54e48f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51ed836640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555e54e46ae0 0x555e54e48f10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.231+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e495e0 con 0x555e54e41ad0 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee037640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f51e807b060 0x7f51e802f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e495e0 con 0x7f51e807b060 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f51e807b060 0x7f51e802f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f51e807b060 0x7f51e802f7f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f51e00083e0 con 0x7f51e807b060 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e00083e0 con 0x555e54e3d650 2024-09-10T04:52:16.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.232+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.233+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.234+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.235+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.236+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e3d650 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.237+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x7f51e807b060 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.238+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e46ae0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e54e44d70 con 0x555e54e41ad0 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.239+0000 7f51f0546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e455c0 con 0x555e54e3d650 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e459b0 con 0x555e54e41ad0 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e459b0 con 0x7f51e807b060 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 zone default found 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 4 Realm: () 2024-09-10T04:52:16.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 zonegroup default 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.240+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e45140 con 0x7f51e807b060 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4b450 con 0x555e54e46ae0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4b7f0 con 0x555e54e46ae0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 started sync module instance, tier type = 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.241+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4a8f0 con 0x555e54e41ad0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.243+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.243+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93863639559696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4a8f0 con 0x555e54e41ad0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.243+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4c1b0 con 0x555e54e3d650 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.244+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.244+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93863639563520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4c5d0 con 0x555e54e3d650 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.244+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4d0d0 con 0x555e54e41ad0 2024-09-10T04:52:16.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.244+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93863639559696] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.245+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.245+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93863639567296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4d090 con 0x555e54e41ad0 2024-09-10T04:52:16.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.245+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4db80 con 0x7f51e807b060 2024-09-10T04:52:16.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.245+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93863639563520] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.246+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93863639567296] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.246+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.246+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93863639557184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4db80 con 0x7f51e807b060 2024-09-10T04:52:16.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.246+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4e450 con 0x555e54e41ad0 2024-09-10T04:52:16.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.247+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93863639557184] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.247+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.247+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93863639570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4db80 con 0x555e54e41ad0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.247+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4ea70 con 0x555e54e46ae0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.248+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.249+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93863639570064] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.249+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93863639573952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4f310 con 0x555e54e46ae0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.249+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4dfe0 con 0x555e54e46ae0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.250+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.250+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93863639578704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e50120 con 0x555e54e46ae0 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.250+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e50b80 con 0x7f51e807b060 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.250+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93863639573952] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93863639578704] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93863639576160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4fc70 con 0x7f51e807b060 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=0 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=1 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=2 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=3 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=4 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=5 2024-09-10T04:52:16.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.251+0000 7f51f0546800 20 add_watcher() i=6 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93863639576160] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51f0546800 20 add_watcher() i=7 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51f0546800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e4fc70 con 0x555e54e3d650 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.252+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93863639582304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e513d0 con 0x555e54e3d650 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.253+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93863639582304] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f50a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 5 note: GC not initialized 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f501f7fe640 20 reqs_thread_entry: start 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 20 Filter name: none 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f501d7fa640 20 reqs_thread_entry: start 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.254+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e86bd0 con 0x555e54e3d650 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51f0546800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51f0546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51f0546800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51f0546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.255+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e8d0c0 con 0x555e54e3d650 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.256+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.256+0000 7f51f0546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.256+0000 7f51f0546800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.256+0000 7f51f0546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.256+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93863639829184 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e54e88700 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93863639570064 notify 146028888117 ret 0) ==== 721+0+0 (crc 0 0 0) 0x555e54d05c80 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f50d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888117 cookie 93863639570064 notifier 4888 bl.length()=679 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f50d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f50d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93863639829184 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f50d1ffb640 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f50b4003ea0 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.257+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93863639829184 notify 146028888117 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555e54d073f0 con 0x555e54e41ad0 2024-09-10T04:52:16.275 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.258+0000 7f50a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.258+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93863639582304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e3d650 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.259+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93863639582304] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.259+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93863639559696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e41ad0 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.260+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93863639559696] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.260+0000 7f51f0546800 20 remove_watcher() i=0 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.260+0000 7f51f0546800 2 removed watcher, disabling cache 2024-09-10T04:52:16.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.260+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93863639563520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e3d650 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.261+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93863639563520] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x555e54e3d650 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.261+0000 7f51f0546800 20 remove_watcher() i=1 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.261+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93863639567296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e41ad0 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.262+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93863639567296] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.262+0000 7f51f0546800 20 remove_watcher() i=2 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.262+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93863639557184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x7f51e807b060 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.263+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93863639557184] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.263+0000 7f51f0546800 20 remove_watcher() i=3 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.263+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93863639570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e41ad0 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.264+0000 7f51ee037640 1 -- 172.21.15.145:0/2874959925 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93863639570064] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e8078030 con 0x555e54e41ad0 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.264+0000 7f51f0546800 20 remove_watcher() i=4 2024-09-10T04:52:16.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.264+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93863639573952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e46ae0 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.265+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93863639573952] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.265+0000 7f51f0546800 20 remove_watcher() i=5 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.265+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93863639578704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x555e54e46ae0 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.266+0000 7f51ed836640 1 -- 172.21.15.145:0/2874959925 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93863639578704] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d807c040 con 0x555e54e46ae0 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.267+0000 7f51f0546800 20 remove_watcher() i=6 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.267+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93863639576160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e54e84a00 con 0x7f51e807b060 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93863639576160] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51e0025040 con 0x7f51e807b060 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 20 remove_watcher() i=7 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e41ad0 msgr2=0x555e54e43ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e41ad0 0x555e54e43ec0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54e3d650 msgr2=0x555e54e3fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54e3d650 0x555e54e3fb10 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f51e807b060 msgr2=0x7f51e802f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f51e807b060 0x7f51e802f7f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555e54e46ae0 msgr2=0x555e54e48f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x555e54e46ae0 0x555e54e48f10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50b803c710 msgr2=0x7f50b803ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50b803c710 0x7f50b803ebd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51d8000c00 tx=0x7f51d8053000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51ee838640 1 -- 172.21.15.145:0/2874959925 reap_dead start 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 msgr2=0x555e54e32120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f51e801ea80 tx=0x7f51e8048e70 comp rx=0 tx=0).stop 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 shutdown_connections 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/2874959925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54e2ad00 0x555e54e32120 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 >> 172.21.15.145:0/2874959925 conn(0x555e54e27100 msgr2=0x555e54e25310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 shutdown_connections 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/2874959925 wait complete. 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 msgr2=0x7f50c803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 0x7f50c803ebf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x555e54dfff90 tx=0x7f51d8005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 msgr2=0x555e54d05740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51e8051fc0 tx=0x7f51e8010e80 comp rx=0 tx=0).stop 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 shutdown_connections 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50c803c730 0x7f50c803ebf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 --2- 172.21.15.145:0/4003185838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d06ed0 0x555e54d05740 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 >> 172.21.15.145:0/4003185838 conn(0x555e54e10560 msgr2=0x555e54e10940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 shutdown_connections 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.268+0000 7f51f0546800 1 -- 172.21.15.145:0/4003185838 wait complete. 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e064a0 msgr2=0x555e54e08960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x555e54e064a0 0x555e54e08960 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54d0b220 msgr2=0x555e54e056b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x555e54d0b220 0x555e54e056b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555e54e0bd30 msgr2=0x555e54e0e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x555e54e0bd30 0x555e54e0e120 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50d403c730 msgr2=0x7f50d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f50d403c730 0x7f50d403ebf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f51d8057000 tx=0x7f51d8052000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 msgr2=0x555e54dfe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 --2- 172.21.15.145:0/449587162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555e54d07710 0x555e54dfe060 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f80 tx=0x7f51e8001250 comp rx=0 tx=0).stop 2024-09-10T04:52:16.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51ee838640 1 -- 172.21.15.145:0/449587162 reap_dead start 2024-09-10T04:52:16.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 shutdown_connections 2024-09-10T04:52:16.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 >> 172.21.15.145:0/449587162 conn(0x555e54d011d0 msgr2=0x555e54df79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 shutdown_connections 2024-09-10T04:52:16.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.269+0000 7f51f0546800 1 -- 172.21.15.145:0/449587162 wait complete. 2024-09-10T04:52:16.287 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.287 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.288 ERROR:root:0 2024-09-10T04:52:16.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:16.292 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T04:52:16.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T04:52:16.293 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-10T04:52:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f5870926800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f099e17450 0x55f099e19e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f5870926800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f099cc2e40 con 0x55f099e1a3a0 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f5870926800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55f099c8d680 con 0x55f099e17450 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f586c509640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f099e17450 0x55f099e19e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f586c509640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55f099e17450 0x55f099e19e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47788/0 (socket says 172.21.15.145:47788) 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.339+0000 7f586c509640 1 -- 172.21.15.145:0/2463207854 learned_addr learned my addr 172.21.15.145:0/2463207854 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.340+0000 7f586c509640 1 -- 172.21.15.145:0/2463207854 >> v1:172.21.15.98:6789/0 conn(0x55f099e1a3a0 legacy=0x55f099e1eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.340+0000 7f586c509640 1 -- 172.21.15.145:0/2463207854 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099ca96b0 con 0x55f099e17450 2024-09-10T04:52:16.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.341+0000 7f586c509640 1 --2- 172.21.15.145:0/2463207854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099e19e60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f585c00a520 tx=0x7f585c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4c2834849d47b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f586bd08640 1 -- 172.21.15.145:0/2463207854 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c055070 con 0x55f099e17450 2024-09-10T04:52:16.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f586bd08640 1 -- 172.21.15.145:0/2463207854 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c0515b0 con 0x55f099e17450 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f586bd08640 1 -- 172.21.15.145:0/2463207854 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c0518d0 con 0x55f099e17450 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 -- 172.21.15.145:0/2463207854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 msgr2=0x55f099e19e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 --2- 172.21.15.145:0/2463207854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099e19e60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f585c00a520 tx=0x7f585c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 -- 172.21.15.145:0/2463207854 shutdown_connections 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 --2- 172.21.15.145:0/2463207854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099e19e60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 -- 172.21.15.145:0/2463207854 >> 172.21.15.145:0/2463207854 conn(0x55f099e12930 msgr2=0x55f099e14db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 -- 172.21.15.145:0/2463207854 shutdown_connections 2024-09-10T04:52:16.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.342+0000 7f5870926800 1 -- 172.21.15.145:0/2463207854 wait complete. 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f5870926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f5870926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f099cb1dd0 con 0x55f099e17450 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47800/0 (socket says 172.21.15.145:47800) 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.356+0000 7f586c509640 1 -- 172.21.15.145:0/1334391440 learned_addr learned my addr 172.21.15.145:0/1334391440 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.357+0000 7f586c509640 1 -- 172.21.15.145:0/1334391440 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099ccae10 con 0x55f099e17450 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.357+0000 7f586c509640 1 --2- 172.21.15.145:0/1334391440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f585c0460d0 tx=0x7f585c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4400978df80cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.357+0000 7f575a60c640 1 -- 172.21.15.145:0/1334391440 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c0519d0 con 0x55f099e17450 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.357+0000 7f575a60c640 1 -- 172.21.15.145:0/1334391440 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c051b70 con 0x55f099e17450 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.357+0000 7f575a60c640 1 -- 172.21.15.145:0/1334391440 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c051e50 con 0x55f099e17450 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- 172.21.15.145:0/1334391440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 msgr2=0x55f099f08930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 --2- 172.21.15.145:0/1334391440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f585c0460d0 tx=0x7f585c051000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- 172.21.15.145:0/1334391440 shutdown_connections 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 --2- 172.21.15.145:0/1334391440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f08930 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- 172.21.15.145:0/1334391440 >> 172.21.15.145:0/1334391440 conn(0x55f099e12930 msgr2=0x55f099f042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- 172.21.15.145:0/1334391440 shutdown_connections 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- 172.21.15.145:0/1334391440 wait complete. 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.358+0000 7f5870926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f099e1ac10 con 0x55f099e17450 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47814/0 (socket says 172.21.15.145:47814) 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f586c509640 1 -- 172.21.15.145:0/332959716 learned_addr learned my addr 172.21.15.145:0/332959716 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f586c509640 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099f10630 con 0x55f099e17450 2024-09-10T04:52:16.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f586c509640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f100d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f585c0460d0 tx=0x7f585c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f5758e09640 1 -- 172.21.15.145:0/332959716 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c073020 con 0x55f099e17450 2024-09-10T04:52:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f099f108c0 con 0x55f099e17450 2024-09-10T04:52:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f099f114d0 con 0x55f099e17450 2024-09-10T04:52:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f5758e09640 1 -- 172.21.15.145:0/332959716 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c06f580 con 0x55f099e17450 2024-09-10T04:52:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.359+0000 7f5758e09640 1 -- 172.21.15.145:0/332959716 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c06f860 con 0x55f099e17450 2024-09-10T04:52:16.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.360+0000 7f5758e09640 1 -- 172.21.15.145:0/332959716 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f585c076020 con 0x55f099e17450 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.360+0000 7f5758e09640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f575403c730 0x7f575403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.360+0000 7f5758e09640 1 -- 172.21.15.145:0/332959716 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f585c06b040 con 0x55f099e17450 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5863fff640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f575403c730 0x7f575403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099e1a3a0 0x55f099f17720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f17c60 con 0x55f099e1a3a0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f586cd0a640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099e1a3a0 0x55f099f17720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5863fff640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f575403c730 0x7f575403ebf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5854001e50 tx=0x7f58540013d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f586cd0a640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099e1a3a0 0x55f099f17720 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f586cd0a640 1 -- 172.21.15.145:0/332959716 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099e1a3a0 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f18560 0x55f099f1aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.361+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f1b170 con 0x55f099f18560 2024-09-10T04:52:16.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f586c509640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f18560 0x55f099f1aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f586c509640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f18560 0x55f099f1aa00 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f586c509640 1 -- 172.21.15.145:0/332959716 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f585c057030 con 0x55f099f18560 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f1ca20 con 0x55f099e1a3a0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f586cd0a640 1 -- 172.21.15.145:0/332959716 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099e1a3a0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.362+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f1bc50 con 0x55f099f18560 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f586c509640 1 -- 172.21.15.145:0/332959716 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f585c057030 con 0x55f099f18560 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f099f1ddd0 0x55f099f201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f20700 con 0x55f099f1ddd0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f5863fff640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f099f1ddd0 0x55f099f201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f5863fff640 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f099f1ddd0 0x55f099f201c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.363+0000 7f5863fff640 1 -- 172.21.15.145:0/332959716 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5854010600 con 0x55f099f1ddd0 2024-09-10T04:52:16.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f5870926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f5870926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f099d0fa00 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47822/0 (socket says 172.21.15.145:47822) 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f586c509640 1 -- 172.21.15.145:0/2093659380 learned_addr learned my addr 172.21.15.145:0/2093659380 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.364+0000 7f586c509640 1 -- 172.21.15.145:0/2093659380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099e19b20 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f586c509640 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f585c05ae70 tx=0x7f585c05a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5751ffb640 1 -- 172.21.15.145:0/2093659380 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c050a50 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5751ffb640 1 -- 172.21.15.145:0/2093659380 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c050bf0 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f099e183b0 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5751ffb640 1 -- 172.21.15.145:0/2093659380 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c097050 con 0x55f099e19600 2024-09-10T04:52:16.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f099e18900 con 0x55f099e19600 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.365+0000 7f5751ffb640 1 -- 172.21.15.145:0/2093659380 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f585c058070 con 0x55f099e19600 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5751ffb640 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 0x7f574403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5751ffb640 1 -- 172.21.15.145:0/2093659380 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f585c062070 con 0x55f099e19600 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5863fff640 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 0x7f574403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5863fff640 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 0x7f574403ebf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55f099f1c990 tx=0x7f5854006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5870926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f5870926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f099f090c0 con 0x55f099f3cd70 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47832/0 (socket says 172.21.15.145:47832) 2024-09-10T04:52:16.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.366+0000 7f586c509640 1 -- 172.21.15.145:0/4237342704 learned_addr learned my addr 172.21.15.145:0/4237342704 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f586c509640 1 -- 172.21.15.145:0/4237342704 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099f3d740 con 0x55f099f3cd70 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f586c509640 1 --2- 172.21.15.145:0/4237342704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f585c083fd0 tx=0x7f585c084130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c1b276f650ce3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f574b7fe640 1 -- 172.21.15.145:0/4237342704 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c083440 con 0x55f099f3cd70 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f574b7fe640 1 -- 172.21.15.145:0/4237342704 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c081470 con 0x55f099f3cd70 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f574b7fe640 1 -- 172.21.15.145:0/4237342704 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c0835e0 con 0x55f099f3cd70 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 -- 172.21.15.145:0/4237342704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 msgr2=0x55f099f3d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 --2- 172.21.15.145:0/4237342704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f585c083fd0 tx=0x7f585c084130 comp rx=0 tx=0).stop 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 -- 172.21.15.145:0/4237342704 shutdown_connections 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 --2- 172.21.15.145:0/4237342704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f3d150 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 -- 172.21.15.145:0/4237342704 >> 172.21.15.145:0/4237342704 conn(0x55f099f39170 msgr2=0x55f099f373b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 -- 172.21.15.145:0/4237342704 shutdown_connections 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.367+0000 7f5870926800 1 -- 172.21.15.145:0/4237342704 wait complete. 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f5870926800 1 Processor -- start 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f5870926800 1 -- start start 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f5870926800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f44190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f5870926800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f099f3dbd0 con 0x55f099f3cd70 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f44190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f586c509640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f44190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47838/0 (socket says 172.21.15.145:47838) 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 learned_addr learned my addr 172.21.15.145:0/2232157740 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.368+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f099f446f0 con 0x55f099f3cd70 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f586c509640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f44190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f585c007cc0 tx=0x7f585c056f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5749ffb640 1 -- 172.21.15.145:0/2232157740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c0bb070 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5749ffb640 1 -- 172.21.15.145:0/2232157740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c081620 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f099f446f0 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5749ffb640 1 -- 172.21.15.145:0/2232157740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c007ec0 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f099f446f0 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.369+0000 7f5749ffb640 1 -- 172.21.15.145:0/2232157740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f585c0be070 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5749ffb640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f573c03c730 0x7f573c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5749ffb640 1 -- 172.21.15.145:0/2232157740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f585c0c1da0 con 0x55f099f3cd70 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5863fff640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f573c03c730 0x7f573c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5863fff640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f573c03c730 0x7f573c03ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f585400bf70 tx=0x7f5854011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099f4f6e0 0x55f099f51ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.370+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f522f0 con 0x55f099f4f6e0 2024-09-10T04:52:16.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f586cd0a640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099f4f6e0 0x55f099f51ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f586cd0a640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099f4f6e0 0x55f099f51ba0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 20 realm 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f4ea10 con 0x55f099f4f6e0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.371+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f52d80 con 0x55f099f4f6e0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f53b60 0x55f099f55f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f565b0 con 0x55f099f53b60 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f586c509640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f53b60 0x55f099f55f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.372+0000 7f586c509640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f53b60 0x55f099f55f50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f56e00 con 0x55f099f4f6e0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 20 searching for the correct realm 2024-09-10T04:52:16.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f099f58b70 0x55f099f5af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5863fff640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f099f58b70 0x55f099f5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5863fff640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f099f58b70 0x55f099f5af60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.373+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f586c509640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f585c0c0060 0x7f585c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f586cd0a640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f585c0c0060 0x7f585c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.374+0000 7f586cd0a640 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f585c0c0060 0x7f585c0b0740 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f586400a4d0 con 0x7f585c0c0060 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.375+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f586400a4d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.376+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.377+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.378+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.379+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f4f6e0 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.380+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x7f585c0c0060 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5864030040 con 0x7f585c0c0060 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f58b70 2024-09-10T04:52:16.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.381+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5b630 con 0x55f099f53b60 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f577b0 con 0x55f099f4f6e0 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5864030040 con 0x55f099f4f6e0 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.382+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f58050 con 0x55f099f53b60 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f573f0 con 0x7f585c0c0060 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 zone default found 2024-09-10T04:52:16.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 4 Realm: () 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 zonegroup default 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5bab0 con 0x7f585c0c0060 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5d950 con 0x55f099f58b70 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.383+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5dcf0 con 0x55f099f58b70 2024-09-10T04:52:16.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.384+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.384+0000 7f5870926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.384+0000 7f5870926800 20 started sync module instance, tier type = 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.384+0000 7f5870926800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.384+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5cde0 con 0x55f099f53b60 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.385+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.385+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491863536384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5cde0 con 0x55f099f53b60 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.385+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5e740 con 0x55f099f4f6e0 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.386+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94491863536384] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.386+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.386+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491863540848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5cde0 con 0x55f099f4f6e0 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.386+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5f1c0 con 0x55f099f53b60 2024-09-10T04:52:16.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.387+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94491863540848] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.387+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.387+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94491863542992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5cde0 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.387+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5fc90 con 0x7f585c0c0060 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.389+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.389+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94491863542992] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.389+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94491863545728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5fc50 con 0x7f585c0c0060 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.389+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5c950 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.390+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94491863545728] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.390+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.390+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491863548032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f5c950 con 0x55f099f53b60 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.390+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f610e0 con 0x55f099f58b70 2024-09-10T04:52:16.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.391+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.391+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94491863551024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f61980 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.391+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f62480 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.391+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94491863548032] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.392+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94491863551024] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.392+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.392+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94491863553232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f60780 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.392+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f62e90 con 0x7f585c0c0060 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.393+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94491863553232] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94491863555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f62e90 con 0x7f585c0c0060 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=0 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=1 2024-09-10T04:52:16.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=2 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=3 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=4 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=5 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=6 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94491863555952] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 20 add_watcher() i=7 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.394+0000 7f5870926800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.395+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f660d0 con 0x55f099f4f6e0 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.395+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.395+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94491863558992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f63420 con 0x55f099f4f6e0 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.396+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94491863558992] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f57227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 5 note: GC not initialized 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f57217e2640 20 reqs_thread_entry: start 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 20 Filter name: none 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5692ffd640 20 reqs_thread_entry: start 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.397+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f991f0 con 0x55f099f4f6e0 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f5870926800 20 rados_obj.operate() r=0 bl.length=503 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f5870926800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f5870926800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f5870926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.398+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f9fa10 con 0x55f099f4f6e0 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f5870926800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f5870926800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f5870926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94491863807024 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f099f9b130 con 0x55f099f53b60 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94491863548032 notify 146028888118 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55f099e183b0 con 0x55f099f53b60 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f574b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888118 cookie 94491863548032 notifier 4895 bl.length()=636 2024-09-10T04:52:16.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f574b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f574b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94491863807024 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.399+0000 7f574b7fe640 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5730003ea0 con 0x55f099f53b60 2024-09-10T04:52:16.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.400+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.400+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94491863807024 notify 146028888118 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f099e19b20 con 0x55f099f53b60 2024-09-10T04:52:16.420 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.400+0000 7f57227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.401+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94491863558992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f4f6e0 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.402+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94491863558992] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.402+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94491863536384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f53b60 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.403+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94491863536384] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.403+0000 7f5870926800 20 remove_watcher() i=0 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.403+0000 7f5870926800 2 removed watcher, disabling cache 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.403+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94491863540848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f4f6e0 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.404+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94491863540848] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x55f099f4f6e0 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.404+0000 7f5870926800 20 remove_watcher() i=1 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.404+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94491863542992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f53b60 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.405+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94491863542992] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.405+0000 7f5870926800 20 remove_watcher() i=2 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.405+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94491863545728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x7f585c0c0060 2024-09-10T04:52:16.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.406+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94491863545728] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.406+0000 7f5870926800 20 remove_watcher() i=3 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.406+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94491863548032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f53b60 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.407+0000 7f586c509640 1 -- 172.21.15.145:0/2232157740 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94491863548032] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c0bd030 con 0x55f099f53b60 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.407+0000 7f5870926800 20 remove_watcher() i=4 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.407+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94491863551024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f58b70 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.408+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94491863551024] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.408+0000 7f5870926800 20 remove_watcher() i=5 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.408+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94491863553232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x55f099f58b70 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.409+0000 7f5863fff640 1 -- 172.21.15.145:0/2232157740 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94491863553232] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5854036040 con 0x55f099f58b70 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.409+0000 7f5870926800 20 remove_watcher() i=6 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.409+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94491863555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f099f97090 con 0x7f585c0c0060 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94491863555952] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5864041040 con 0x7f585c0c0060 2024-09-10T04:52:16.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 20 remove_watcher() i=7 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f53b60 msgr2=0x55f099f55f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f53b60 0x55f099f55f50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099f4f6e0 msgr2=0x55f099f51ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099f4f6e0 0x55f099f51ba0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f585c0c0060 msgr2=0x7f585c0b0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f585c0c0060 0x7f585c0b0740 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f099f58b70 msgr2=0x55f099f5af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55f099f58b70 0x55f099f5af60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f573c03c730 msgr2=0x7f573c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f573c03c730 0x7f573c03ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f585400bf70 tx=0x7f5854011000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 msgr2=0x55f099f44190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 --2- 172.21.15.145:0/2232157740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099f3cd70 0x55f099f44190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f585c007cc0 tx=0x7f585c056f10 comp rx=0 tx=0).stop 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 reap_dead start 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f586cd0a640 1 -- 172.21.15.145:0/2232157740 reap_dead start 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 shutdown_connections 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 >> 172.21.15.145:0/2232157740 conn(0x55f099f39170 msgr2=0x55f099f37380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 shutdown_connections 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.410+0000 7f5870926800 1 -- 172.21.15.145:0/2232157740 wait complete. 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 msgr2=0x7f574403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 0x7f574403ebf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55f099f1c990 tx=0x7f5854006000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 msgr2=0x55f099e17e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f585c05ae70 tx=0x7f585c05a740 comp rx=0 tx=0).stop 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 shutdown_connections 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f574403c730 0x7f574403ebf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/2093659380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e19600 0x55f099e17e70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 >> 172.21.15.145:0/2093659380 conn(0x55f099f22630 msgr2=0x55f099f22a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 shutdown_connections 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/2093659380 wait complete. 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f18560 msgr2=0x55f099f1aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55f099f18560 0x55f099f1aa00 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099e1a3a0 msgr2=0x55f099f17720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55f099e1a3a0 0x55f099f17720 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f099f1ddd0 msgr2=0x55f099f201c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55f099f1ddd0 0x55f099f201c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f575403c730 msgr2=0x7f575403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f575403c730 0x7f575403ebf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5854001e50 tx=0x7f58540013d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 msgr2=0x55f099f100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 --2- 172.21.15.145:0/332959716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f099e17450 0x55f099f100d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f585c0460d0 tx=0x7f585c002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f586cd0a640 1 -- 172.21.15.145:0/332959716 reap_dead start 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 shutdown_connections 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 >> 172.21.15.145:0/332959716 conn(0x55f099e12930 msgr2=0x55f099f02aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 shutdown_connections 2024-09-10T04:52:16.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.411+0000 7f5870926800 1 -- 172.21.15.145:0/332959716 wait complete. 2024-09-10T04:52:16.432 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.432 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.432 ERROR:root:0 2024-09-10T04:52:16.432 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T04:52:16.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T04:52:16.432 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-10T04:52:16.479 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.479 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.478+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.478+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.478+0000 7f56f6923800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55eefd5e8320 0x55eefd5e8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.478+0000 7f56f6923800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eefd493e40 con 0x55eefd5ed050 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56f6923800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55eefd45e680 con 0x55eefd5e8320 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56f260c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55eefd5e8320 0x55eefd5e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56e9e0b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x55eefd5ed050 0x55eefd5ef4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36970/0 (socket says 172.21.15.145:36970) 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56e9e0b640 1 -- 172.21.15.145:0/453130358 learned_addr learned my addr 172.21.15.145:0/453130358 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56f260c640 1 -- 172.21.15.145:0/453130358 >> v1:172.21.15.98:6789/0 conn(0x55eefd5ed050 legacy=0x55eefd5ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.479+0000 7f56f260c640 1 -- 172.21.15.145:0/453130358 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd47a6b0 con 0x55eefd5e8320 2024-09-10T04:52:16.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.481+0000 7f56f260c640 1 --2- 172.21.15.145:0/453130358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd5e8720 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a470 tx=0x7f56e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4856edd364d54a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.481+0000 7f56f1e0b640 1 -- 172.21.15.145:0/453130358 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053570 con 0x55eefd5e8320 2024-09-10T04:52:16.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.481+0000 7f56f1e0b640 1 -- 172.21.15.145:0/453130358 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4058070 con 0x55eefd5e8320 2024-09-10T04:52:16.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.481+0000 7f56f1e0b640 1 -- 172.21.15.145:0/453130358 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053880 con 0x55eefd5e8320 2024-09-10T04:52:16.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 -- 172.21.15.145:0/453130358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 msgr2=0x55eefd5e8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 --2- 172.21.15.145:0/453130358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd5e8720 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a470 tx=0x7f56e4045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:16.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 -- 172.21.15.145:0/453130358 shutdown_connections 2024-09-10T04:52:16.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 --2- 172.21.15.145:0/453130358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd5e8720 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 -- 172.21.15.145:0/453130358 >> 172.21.15.145:0/453130358 conn(0x55eefd5e3930 msgr2=0x55eefd5e5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 -- 172.21.15.145:0/453130358 shutdown_connections 2024-09-10T04:52:16.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.482+0000 7f56f6923800 1 -- 172.21.15.145:0/453130358 wait complete. 2024-09-10T04:52:16.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.495+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.495+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.495+0000 7f56f6923800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f6923800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55eefd482dd0 con 0x55eefd5e8320 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47858/0 (socket says 172.21.15.145:47858) 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f260c640 1 -- 172.21.15.145:0/1378104926 learned_addr learned my addr 172.21.15.145:0/1378104926 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f260c640 1 -- 172.21.15.145:0/1378104926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd49be10 con 0x55eefd5e8320 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f56f260c640 1 --2- 172.21.15.145:0/1378104926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56e4025c20 tx=0x7f56e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb3d444259e40b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f55e0608640 1 -- 172.21.15.145:0/1378104926 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053570 con 0x55eefd5e8320 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f55e0608640 1 -- 172.21.15.145:0/1378104926 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4063070 con 0x55eefd5e8320 2024-09-10T04:52:16.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.496+0000 7f55e0608640 1 -- 172.21.15.145:0/1378104926 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053840 con 0x55eefd5e8320 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 -- 172.21.15.145:0/1378104926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 msgr2=0x55eefd6d9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 --2- 172.21.15.145:0/1378104926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56e4025c20 tx=0x7f56e4051000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 -- 172.21.15.145:0/1378104926 shutdown_connections 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 --2- 172.21.15.145:0/1378104926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6d9710 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 -- 172.21.15.145:0/1378104926 >> 172.21.15.145:0/1378104926 conn(0x55eefd5e3930 msgr2=0x55eefd6d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 -- 172.21.15.145:0/1378104926 shutdown_connections 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.497+0000 7f56f6923800 1 -- 172.21.15.145:0/1378104926 wait complete. 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f6923800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6e1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f6923800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55eefd5f1050 con 0x55eefd5e8320 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6e1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47868/0 (socket says 172.21.15.145:47868) 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f260c640 1 -- 172.21.15.145:0/108056907 learned_addr learned my addr 172.21.15.145:0/108056907 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f260c640 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd6e1560 con 0x55eefd5e8320 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.498+0000 7f56f260c640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6e1000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56e4025c20 tx=0x7f56e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f55dee05640 1 -- 172.21.15.145:0/108056907 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4074480 con 0x55eefd5e8320 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f55dee05640 1 -- 172.21.15.145:0/108056907 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4074620 con 0x55eefd5e8320 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefd6e17f0 con 0x55eefd5e8320 2024-09-10T04:52:16.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f55dee05640 1 -- 172.21.15.145:0/108056907 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4074900 con 0x55eefd5e8320 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefd6e2400 con 0x55eefd5e8320 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.499+0000 7f55dee05640 1 -- 172.21.15.145:0/108056907 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56e4074aa0 con 0x55eefd5e8320 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f55dee05640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55d803c780 0x7f55d803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f55dee05640 1 -- 172.21.15.145:0/108056907 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f56e40981b0 con 0x55eefd5e8320 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55d803c780 0x7f55d803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd5ed050 0x55eefd6e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd6e2dc0 con 0x55eefd5ed050 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd5ed050 0x55eefd6e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55d803c780 0x7f55d803ec40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56dc001d70 tx=0x7f56dc0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd5ed050 0x55eefd6e8650 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.500+0000 7f56f2e0d640 1 -- 172.21.15.145:0/108056907 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd5ed050 2024-09-10T04:52:16.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.501+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd6e95c0 0x55eefd6eb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.501+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd6ec010 con 0x55eefd6e95c0 2024-09-10T04:52:16.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.501+0000 7f56f260c640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd6e95c0 0x55eefd6eb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.501+0000 7f56f260c640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd6e95c0 0x55eefd6eb9b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f260c640 1 -- 172.21.15.145:0/108056907 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56e4051070 con 0x55eefd6e95c0 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd6ed8c0 con 0x55eefd5ed050 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f2e0d640 1 -- 172.21.15.145:0/108056907 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd5ed050 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd6ec9a0 con 0x55eefd6e95c0 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f260c640 1 -- 172.21.15.145:0/108056907 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56e4051070 con 0x55eefd6e95c0 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55eefd6ed490 0x55eefd6f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd6f1430 con 0x55eefd6ed490 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.502+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55eefd6ed490 0x55eefd6f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55eefd6ed490 0x55eefd6f0ca0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56e9e0b640 1 -- 172.21.15.145:0/108056907 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd6ed490 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56f6923800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.503+0000 7f56f6923800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55eefd4e0a00 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47878/0 (socket says 172.21.15.145:47878) 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f260c640 1 -- 172.21.15.145:0/442949759 learned_addr learned my addr 172.21.15.145:0/442949759 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f260c640 1 -- 172.21.15.145:0/442949759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd6ffb30 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f260c640 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56e405d910 tx=0x7f56e405d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f55d7fff640 1 -- 172.21.15.145:0/442949759 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e408c070 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f55d7fff640 1 -- 172.21.15.145:0/442949759 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e405e630 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefd700360 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f55d7fff640 1 -- 172.21.15.145:0/442949759 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e405dd00 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.504+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefd700900 con 0x55eefd6ff0d0 2024-09-10T04:52:16.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.505+0000 7f55d7fff640 1 -- 172.21.15.145:0/442949759 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56e405c5d0 con 0x55eefd6ff0d0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.505+0000 7f55d7fff640 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 0x7f55cc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.505+0000 7f55d7fff640 1 -- 172.21.15.145:0/442949759 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f56e4099db0 con 0x55eefd6ff0d0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.505+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 0x7f55cc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 0x7f55cc03ebf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00bf40 tx=0x7f56dc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f6923800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f6923800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55eefd6d9f00 con 0x55eefd70b9d0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47884/0 (socket says 172.21.15.145:47884) 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f260c640 1 -- 172.21.15.145:0/3408874119 learned_addr learned my addr 172.21.15.145:0/3408874119 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f260c640 1 -- 172.21.15.145:0/3408874119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd70c3a0 con 0x55eefd70b9d0 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f56f260c640 1 --2- 172.21.15.145:0/3408874119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56e405df20 tx=0x7f56e40a1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa841a2ee3b17c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.506+0000 7f55d5ffb640 1 -- 172.21.15.145:0/3408874119 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4088410 con 0x55eefd70b9d0 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f55d5ffb640 1 -- 172.21.15.145:0/3408874119 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4088990 con 0x55eefd70b9d0 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f55d5ffb640 1 -- 172.21.15.145:0/3408874119 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e40a1430 con 0x55eefd70b9d0 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- 172.21.15.145:0/3408874119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 msgr2=0x55eefd70bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 --2- 172.21.15.145:0/3408874119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56e405df20 tx=0x7f56e40a1f50 comp rx=0 tx=0).stop 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- 172.21.15.145:0/3408874119 shutdown_connections 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 --2- 172.21.15.145:0/3408874119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd70bdb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- 172.21.15.145:0/3408874119 >> 172.21.15.145:0/3408874119 conn(0x55eefd707dd0 msgr2=0x55eefd706010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- 172.21.15.145:0/3408874119 shutdown_connections 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- 172.21.15.145:0/3408874119 wait complete. 2024-09-10T04:52:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 Processor -- start 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- start start 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.507+0000 7f56f6923800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55eefd70c830 con 0x55eefd70b9d0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f260c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47898/0 (socket says 172.21.15.145:47898) 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 learned_addr learned my addr 172.21.15.145:0/1546333800 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd713370 con 0x55eefd70b9d0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f260c640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56e405d3c0 tx=0x7f56e405df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f55c3fff640 1 -- 172.21.15.145:0/1546333800 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4088410 con 0x55eefd70b9d0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f55c3fff640 1 -- 172.21.15.145:0/1546333800 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e407d5c0 con 0x55eefd70b9d0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f55c3fff640 1 -- 172.21.15.145:0/1546333800 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4068470 con 0x55eefd70b9d0 2024-09-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefd713370 con 0x55eefd70b9d0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.508+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefd713370 con 0x55eefd70b9d0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.509+0000 7f55c3fff640 1 -- 172.21.15.145:0/1546333800 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56e40a03e0 con 0x55eefd70b9d0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.509+0000 7f55c3fff640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55bc03c6e0 0x7f55bc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.509+0000 7f55c3fff640 1 -- 172.21.15.145:0/1546333800 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f56e40a8070 con 0x55eefd70b9d0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.509+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55bc03c6e0 0x7f55bc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55bc03c6e0 0x7f55bc03eba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c010 tx=0x7f56dc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd71e400 0x55eefd7208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd721010 con 0x55eefd71e400 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd71e400 0x55eefd7208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.510+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd71e400 0x55eefd7208c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 realm 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd71d730 con 0x55eefd71e400 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd721aa0 con 0x55eefd71e400 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd722880 0x55eefd724c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd725300 con 0x55eefd722880 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.511+0000 7f56f260c640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd722880 0x55eefd724c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f260c640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd722880 0x55eefd724c70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd725b50 con 0x55eefd71e400 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 20 searching for the correct realm 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55eefd7278c0 0x55eefd729d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.512+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55eefd7278c0 0x55eefd729d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56e9e0b640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55eefd7278c0 0x55eefd729d10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56f260c640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f56e40b6040 0x7f56e40714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f56e40b6040 0x7f56e40714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.513+0000 7f56f2e0d640 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f56e40b6040 0x7f56e40714f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56ec00a4d0 con 0x7f56e40b6040 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.514+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.515+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.515+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.515+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.515+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec00a4d0 con 0x55eefd71e400 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.516+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.517+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.518+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd71e400 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.519+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x7f56e40b6040 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec030040 con 0x7f56e40b6040 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd7278c0 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.520+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72a3e0 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd7264d0 con 0x55eefd71e400 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56ec030040 con 0x55eefd71e400 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.521+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd726110 con 0x55eefd722880 2024-09-10T04:52:16.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd726df0 con 0x7f56e40b6040 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 zone default found 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 4 Realm: () 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 zonegroup default 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd726e30 con 0x7f56e40b6040 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72c2f0 con 0x55eefd7278c0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.522+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72c820 con 0x55eefd7278c0 2024-09-10T04:52:16.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.523+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.523+0000 7f56f6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.523+0000 7f56f6923800 20 started sync module instance, tier type = 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.523+0000 7f56f6923800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.523+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72b790 con 0x55eefd722880 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.524+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.524+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94484942732432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72b790 con 0x55eefd722880 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.524+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72d380 con 0x55eefd71e400 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.525+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x55eefd71e400 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.525+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94484942736976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72d380 con 0x55eefd71e400 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.525+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94484942732432] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.525+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72b300 con 0x55eefd722880 2024-09-10T04:52:16.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.526+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94484942736976] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x55eefd71e400 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.526+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.526+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94484942739312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72b300 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.526+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72e940 con 0x7f56e40b6040 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.527+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.527+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94484942742672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72ed60 con 0x7f56e40b6040 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.527+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72f820 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.528+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94484942739312] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.528+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94484942742672] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.529+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.529+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94484942746352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72e8b0 con 0x55eefd722880 2024-09-10T04:52:16.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.529+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd7300c0 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.530+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.530+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94484942748688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd72e8b0 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.530+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd731010 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.530+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94484942746352] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.531+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94484942748688] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.531+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.531+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94484942752512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd731400 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.531+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd731c50 con 0x7f56e40b6040 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94484942752512] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94484942755744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd731bc0 con 0x7f56e40b6040 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=0 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=1 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=2 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=3 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=4 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=5 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.532+0000 7f56f6923800 20 add_watcher() i=6 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.533+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94484942755744] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x7f56e40b6040 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.533+0000 7f56f6923800 20 add_watcher() i=7 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.533+0000 7f56f6923800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.533+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd735550 con 0x55eefd71e400 2024-09-10T04:52:16.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.534+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56ec041040 con 0x55eefd71e400 2024-09-10T04:52:16.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.534+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94484942757920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd732990 con 0x55eefd71e400 2024-09-10T04:52:16.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94484942757920] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56ec041040 con 0x55eefd71e400 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f55a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f6923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f6923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f6923800 5 note: GC not initialized 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f55237fe640 20 reqs_thread_entry: start 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f6923800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.535+0000 7f56f6923800 20 Filter name: none 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.536+0000 7f55217fa640 20 reqs_thread_entry: start 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.536+0000 7f56f6923800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.536+0000 7f56f6923800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.536+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd7685b0 con 0x55eefd71e400 2024-09-10T04:52:16.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f56ec041040 con 0x55eefd71e400 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f6923800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f6923800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f6923800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f6923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.537+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd76ea50 con 0x55eefd71e400 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f56ec048040 con 0x55eefd71e400 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f6923800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f6923800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f6923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94484943004688 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefd76a090 con 0x55eefd722880 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94484942746352 notify 146028888119 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55eefd700360 con 0x55eefd722880 2024-09-10T04:52:16.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f55d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888119 cookie 94484942746352 notifier 4902 bl.length()=666 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f55d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f55d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f55d5ffb640 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f55b8003ea0 con 0x55eefd722880 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.538+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94484943004688 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.539+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.539+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94484943004688 notify 146028888119 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eefd6ffb30 con 0x55eefd722880 2024-09-10T04:52:16.552 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.539+0000 7f55a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.539+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94484942757920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd71e400 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.540+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94484942757920] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56ec048040 con 0x55eefd71e400 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.540+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94484942732432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd722880 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.542+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94484942732432] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.542+0000 7f56f6923800 20 remove_watcher() i=0 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.542+0000 7f56f6923800 2 removed watcher, disabling cache 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.542+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94484942736976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd71e400 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.543+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94484942736976] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec048040 con 0x55eefd71e400 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.543+0000 7f56f6923800 20 remove_watcher() i=1 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.543+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94484942739312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd722880 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.544+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94484942739312] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.544+0000 7f56f6923800 20 remove_watcher() i=2 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.544+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94484942742672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x7f56e40b6040 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.545+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94484942742672] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec048040 con 0x7f56e40b6040 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.545+0000 7f56f6923800 20 remove_watcher() i=3 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.545+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94484942746352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd722880 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.546+0000 7f56f260c640 1 -- 172.21.15.145:0/1546333800 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94484942746352] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e40c5020 con 0x55eefd722880 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.546+0000 7f56f6923800 20 remove_watcher() i=4 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.546+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94484942748688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd7278c0 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.547+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94484942748688] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.547+0000 7f56f6923800 20 remove_watcher() i=5 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.547+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94484942752512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x55eefd7278c0 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.548+0000 7f56e9e0b640 1 -- 172.21.15.145:0/1546333800 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94484942752512] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56dc009050 con 0x55eefd7278c0 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.548+0000 7f56f6923800 20 remove_watcher() i=6 2024-09-10T04:52:16.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.548+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94484942755744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefd766420 con 0x7f56e40b6040 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94484942755744] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec048040 con 0x7f56e40b6040 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 20 remove_watcher() i=7 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd722880 msgr2=0x55eefd724c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd722880 0x55eefd724c70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd71e400 msgr2=0x55eefd7208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd71e400 0x55eefd7208c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f56e40b6040 msgr2=0x7f56e40714f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f56e40b6040 0x7f56e40714f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55eefd7278c0 msgr2=0x55eefd729d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55eefd7278c0 0x55eefd729d10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55bc03c6e0 msgr2=0x7f55bc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55bc03c6e0 0x7f55bc03eba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c010 tx=0x7f56dc010000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 msgr2=0x55eefd712e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56e405d3c0 tx=0x7f56e405df50 comp rx=0 tx=0).stop 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f2e0d640 1 -- 172.21.15.145:0/1546333800 reap_dead start 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 shutdown_connections 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 --2- 172.21.15.145:0/1546333800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd70b9d0 0x55eefd712e10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 >> 172.21.15.145:0/1546333800 conn(0x55eefd707dd0 msgr2=0x55eefd705fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 shutdown_connections 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.550+0000 7f56f6923800 1 -- 172.21.15.145:0/1546333800 wait complete. 2024-09-10T04:52:16.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 msgr2=0x7f55cc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 0x7f55cc03ebf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00bf40 tx=0x7f56dc00f000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 msgr2=0x55eefd6ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56e405d910 tx=0x7f56e405d7b0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 shutdown_connections 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55cc03c730 0x7f55cc03ebf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/442949759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd6ff0d0 0x55eefd6ff4f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 >> 172.21.15.145:0/442949759 conn(0x55eefd6f3480 msgr2=0x55eefd6f3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 shutdown_connections 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/442949759 wait complete. 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd6e95c0 msgr2=0x55eefd6eb9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55eefd6e95c0 0x55eefd6eb9b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd5ed050 msgr2=0x55eefd6e8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55eefd5ed050 0x55eefd6e8650 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55eefd6ed490 msgr2=0x55eefd6f0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55eefd6ed490 0x55eefd6f0ca0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55d803c780 msgr2=0x7f55d803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f55d803c780 0x7f55d803ec40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56dc001d70 tx=0x7f56dc0012d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 msgr2=0x55eefd6e1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 --2- 172.21.15.145:0/108056907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55eefd5e8320 0x55eefd6e1000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56e4025c20 tx=0x7f56e4002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f2e0d640 1 -- 172.21.15.145:0/108056907 reap_dead start 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 shutdown_connections 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 >> 172.21.15.145:0/108056907 conn(0x55eefd5e3930 msgr2=0x55eefd6d3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 shutdown_connections 2024-09-10T04:52:16.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.551+0000 7f56f6923800 1 -- 172.21.15.145:0/108056907 wait complete. 2024-09-10T04:52:16.564 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.564 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.565 ERROR:root:0 2024-09-10T04:52:16.565 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:16.568 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000005bd0d4f0675603cb-0066dfd080-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:52:16.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T04:52:16.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T04:52:16.569 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-10T04:52:16.615 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.616 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f064c420800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a96b609610 0x55a96b60ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f064c420800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a96b4b2e40 con 0x55a96b60c030 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f064c420800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55a96b47d680 con 0x55a96b609610 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f0649f0a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a96b609610 0x55a96b60ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f0649f0a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x55a96b609610 0x55a96b60ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47910/0 (socket says 172.21.15.145:47910) 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f0649f0a640 1 -- 172.21.15.145:0/3685270627 learned_addr learned my addr 172.21.15.145:0/3685270627 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f0649f0a640 1 -- 172.21.15.145:0/3685270627 >> v1:172.21.15.98:6789/0 conn(0x55a96b60c030 legacy=0x55a96b60e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.615+0000 7f0649f0a640 1 -- 172.21.15.145:0/3685270627 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b4996b0 con 0x55a96b609610 2024-09-10T04:52:16.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.617+0000 7f0649f0a640 1 --2- 172.21.15.145:0/3685270627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b60ba00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f063c00a520 tx=0x7f063c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8937411cf04d01ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.617+0000 7f0649709640 1 -- 172.21.15.145:0/3685270627 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c055070 con 0x55a96b609610 2024-09-10T04:52:16.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.617+0000 7f0649709640 1 -- 172.21.15.145:0/3685270627 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c0515b0 con 0x55a96b609610 2024-09-10T04:52:16.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.617+0000 7f0649709640 1 -- 172.21.15.145:0/3685270627 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c0518d0 con 0x55a96b609610 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 -- 172.21.15.145:0/3685270627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 msgr2=0x55a96b60ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 --2- 172.21.15.145:0/3685270627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b60ba00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f063c00a520 tx=0x7f063c045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 -- 172.21.15.145:0/3685270627 shutdown_connections 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 --2- 172.21.15.145:0/3685270627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b60ba00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 -- 172.21.15.145:0/3685270627 >> 172.21.15.145:0/3685270627 conn(0x55a96b6031d0 msgr2=0x55a96b605630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 -- 172.21.15.145:0/3685270627 shutdown_connections 2024-09-10T04:52:16.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.618+0000 7f064c420800 1 -- 172.21.15.145:0/3685270627 wait complete. 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f064c420800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f064c420800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a96b4a1dd0 con 0x55a96b609610 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47912/0 (socket says 172.21.15.145:47912) 2024-09-10T04:52:16.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f0649f0a640 1 -- 172.21.15.145:0/383473101 learned_addr learned my addr 172.21.15.145:0/383473101 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.632+0000 7f0649f0a640 1 -- 172.21.15.145:0/383473101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b4bae10 con 0x55a96b609610 2024-09-10T04:52:16.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f0649f0a640 1 --2- 172.21.15.145:0/383473101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f063c0460d0 tx=0x7f063c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7364ab3bdef83bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f0537e07640 1 -- 172.21.15.145:0/383473101 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c0519d0 con 0x55a96b609610 2024-09-10T04:52:16.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f0537e07640 1 -- 172.21.15.145:0/383473101 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c051b70 con 0x55a96b609610 2024-09-10T04:52:16.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f0537e07640 1 -- 172.21.15.145:0/383473101 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c051e50 con 0x55a96b609610 2024-09-10T04:52:16.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f064c420800 1 -- 172.21.15.145:0/383473101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 msgr2=0x55a96b6f8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f064c420800 1 --2- 172.21.15.145:0/383473101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f063c0460d0 tx=0x7f063c051000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f064c420800 1 -- 172.21.15.145:0/383473101 shutdown_connections 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f064c420800 1 --2- 172.21.15.145:0/383473101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6f8710 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.633+0000 7f064c420800 1 -- 172.21.15.145:0/383473101 >> 172.21.15.145:0/383473101 conn(0x55a96b6031d0 msgr2=0x55a96b6f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 -- 172.21.15.145:0/383473101 shutdown_connections 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 -- 172.21.15.145:0/383473101 wait complete. 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f064c420800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a96b610050 con 0x55a96b609610 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47916/0 (socket says 172.21.15.145:47916) 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f0649f0a640 1 -- 172.21.15.145:0/2821740626 learned_addr learned my addr 172.21.15.145:0/2821740626 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.634+0000 7f0649f0a640 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b700410 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f0649f0a640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6ffeb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f063c0460d0 tx=0x7f063c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f0536604640 1 -- 172.21.15.145:0/2821740626 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c073020 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f0536604640 1 -- 172.21.15.145:0/2821740626 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c06f580 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a96b7006a0 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f0536604640 1 -- 172.21.15.145:0/2821740626 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c06f8a0 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.635+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a96b7012b0 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f0536604640 1 -- 172.21.15.145:0/2821740626 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f063c076020 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f0536604640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f053003c730 0x7f053003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f0536604640 1 -- 172.21.15.145:0/2821740626 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f063c06b040 con 0x55a96b609610 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f0643fff640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f053003c730 0x7f053003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b60c030 0x55a96b707500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b707a40 con 0x55a96b60c030 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f064a70b640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b60c030 0x55a96b707500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.636+0000 7f0643fff640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f053003c730 0x7f053003ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0634001e50 tx=0x7f06340013d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f064a70b640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b60c030 0x55a96b707500 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f064a70b640 1 -- 172.21.15.145:0/2821740626 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b60c030 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b708340 0x55a96b70a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b70af50 con 0x55a96b708340 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f0649f0a640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b708340 0x55a96b70a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.637+0000 7f0649f0a640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b708340 0x55a96b70a7e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f0649f0a640 1 -- 172.21.15.145:0/2821740626 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063c057030 con 0x55a96b708340 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b70c800 con 0x55a96b60c030 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f064a70b640 1 -- 172.21.15.145:0/2821740626 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b60c030 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b70ba30 con 0x55a96b708340 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f0649f0a640 1 -- 172.21.15.145:0/2821740626 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063c057030 con 0x55a96b708340 2024-09-10T04:52:16.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a96b70dbb0 0x55a96b70ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b7104e0 con 0x55a96b70dbb0 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.638+0000 7f0643fff640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a96b70dbb0 0x55a96b70ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f0643fff640 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a96b70dbb0 0x55a96b70ffa0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f0643fff640 1 -- 172.21.15.145:0/2821740626 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0634010600 con 0x55a96b70dbb0 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f064c420800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.639+0000 7f064c420800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a96b4ffa00 con 0x55a96b71e090 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47922/0 (socket says 172.21.15.145:47922) 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f0649f0a640 1 -- 172.21.15.145:0/748041816 learned_addr learned my addr 172.21.15.145:0/748041816 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f0649f0a640 1 -- 172.21.15.145:0/748041816 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b71eaf0 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f0649f0a640 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f063c095f60 tx=0x7f063c05aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f052f7fe640 1 -- 172.21.15.145:0/748041816 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c08ef00 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f052f7fe640 1 -- 172.21.15.145:0/748041816 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c08f0a0 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a96b71f320 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f052f7fe640 1 -- 172.21.15.145:0/748041816 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c050810 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.640+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a96b71f8c0 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f052f7fe640 1 -- 172.21.15.145:0/748041816 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f063c058070 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f052f7fe640 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 0x7f052403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f052f7fe640 1 -- 172.21.15.145:0/748041816 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f063c062070 con 0x55a96b71e090 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f0643fff640 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 0x7f052403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.641+0000 7f0643fff640 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 0x7f052403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a96b70bdd0 tx=0x7f0634006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f064c420800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f064c420800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a96b6f8ea0 con 0x55a96b607610 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47928/0 (socket says 172.21.15.145:47928) 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f0649f0a640 1 -- 172.21.15.145:0/128758673 learned_addr learned my addr 172.21.15.145:0/128758673 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f0649f0a640 1 -- 172.21.15.145:0/128758673 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b608000 con 0x55a96b607610 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f0649f0a640 1 --2- 172.21.15.145:0/128758673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f063c0646c0 tx=0x7f063c0814d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415405e8e153ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f052d7fa640 1 -- 172.21.15.145:0/128758673 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c077ca0 con 0x55a96b607610 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f052d7fa640 1 -- 172.21.15.145:0/128758673 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c0b0070 con 0x55a96b607610 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.642+0000 7f052d7fa640 1 -- 172.21.15.145:0/128758673 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c085e10 con 0x55a96b607610 2024-09-10T04:52:16.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- 172.21.15.145:0/128758673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 msgr2=0x55a96b607a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 --2- 172.21.15.145:0/128758673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f063c0646c0 tx=0x7f063c0814d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- 172.21.15.145:0/128758673 shutdown_connections 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 --2- 172.21.15.145:0/128758673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b607a10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- 172.21.15.145:0/128758673 >> 172.21.15.145:0/128758673 conn(0x55a96b726e50 msgr2=0x55a96b725090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- 172.21.15.145:0/128758673 shutdown_connections 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- 172.21.15.145:0/128758673 wait complete. 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 Processor -- start 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- start start 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f064c420800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a96b6084f0 con 0x55a96b607610 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f0649f0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47934/0 (socket says 172.21.15.145:47934) 2024-09-10T04:52:16.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.643+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 learned_addr learned my addr 172.21.15.145:0/185455157 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a96b7345a0 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f0649f0a640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f063c0ad040 tx=0x7f063c07fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f051b7fe640 1 -- 172.21.15.145:0/185455157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c0bd030 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f051b7fe640 1 -- 172.21.15.145:0/185455157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c078400 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a96b7345a0 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f051b7fe640 1 -- 172.21.15.145:0/185455157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c07c390 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.644+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a96b7345a0 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.645+0000 7f051b7fe640 1 -- 172.21.15.145:0/185455157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f063c0c0030 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.645+0000 7f051b7fe640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f051403c730 0x7f051403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.645+0000 7f051b7fe640 1 -- 172.21.15.145:0/185455157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f063c0be070 con 0x55a96b607610 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.645+0000 7f0643fff640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f051403c730 0x7f051403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f0643fff640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f051403c730 0x7f051403ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0634010fd0 tx=0x7f0634011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b73f490 0x55a96b741950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b7420a0 con 0x55a96b73f490 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064a70b640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b73f490 0x55a96b741950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064a70b640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b73f490 0x55a96b741950 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 20 realm 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.646+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b73e7c0 con 0x55a96b73f490 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b742b30 con 0x55a96b73f490 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b743910 0x55a96b745d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b746390 con 0x55a96b743910 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f0649f0a640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b743910 0x55a96b745d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.647+0000 7f0649f0a640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b743910 0x55a96b745d00 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b746be0 con 0x55a96b73f490 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 20 searching for the correct realm 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a96b748950 0x55a96b74ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f0643fff640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a96b748950 0x55a96b74ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f0643fff640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a96b748950 0x55a96b74ad80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.648+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f0649f0a640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f063c078020 0x7f063c0a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f064a70b640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f063c078020 0x7f063c0a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f064a70b640 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f063c078020 0x7f063c0a47c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f064400a4d0 con 0x7f063c078020 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.649+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.650+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064400a4d0 con 0x55a96b73f490 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.651+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.652+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.653+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.654+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x7f063c078020 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0644030040 con 0x7f063c078020 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.655+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b748950 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b450 con 0x55a96b743910 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.656+0000 7f064c420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b747590 con 0x55a96b73f490 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0644030040 con 0x55a96b73f490 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b7471d0 con 0x55a96b743910 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b747f30 con 0x7f063c078020 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 zone default found 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 4 Realm: () 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 zonegroup default 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74b930 con 0x7f063c078020 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.657+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74d760 con 0x55a96b748950 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74dc80 con 0x55a96b748950 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 started sync module instance, tier type = 2024-09-10T04:52:16.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.658+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74cc00 con 0x55a96b743910 2024-09-10T04:52:16.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.659+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.659+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186140651504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74e590 con 0x55a96b743910 2024-09-10T04:52:16.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.659+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74ede0 con 0x55a96b73f490 2024-09-10T04:52:16.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.660+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.660+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186140657968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74f340 con 0x55a96b73f490 2024-09-10T04:52:16.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.660+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74fe40 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.661+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186140651504] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.661+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186140657968] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.662+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.662+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186140662064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b74fe00 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.662+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b750710 con 0x7f063c078020 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.663+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.663+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186140664416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b750b30 con 0x7f063c078020 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.663+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b751380 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.663+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186140662064] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.667+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186140664416] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.667+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.667+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186140665472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b750f50 con 0x55a96b743910 2024-09-10T04:52:16.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.667+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b751c20 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.668+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.668+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186140665472] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.668+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186140669808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b750f50 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.668+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b750ae0 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.671+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186140669808] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.671+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.671+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186140671936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b752b70 con 0x55a96b748950 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.671+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b753460 con 0x7f063c078020 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186140674928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b752fd0 con 0x7f063c078020 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=0 2024-09-10T04:52:16.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=1 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=2 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=3 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=4 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=5 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186140671936] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.672+0000 7f064c420800 20 add_watcher() i=6 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186140674928] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064c420800 20 add_watcher() i=7 2024-09-10T04:52:16.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064c420800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b7526c0 con 0x55a96b73f490 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.673+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186140678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b7526c0 con 0x55a96b73f490 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.674+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186140678144] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.674+0000 7f04fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 5 note: GC not initialized 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f04fa7fc640 20 reqs_thread_entry: start 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 20 Filter name: none 2024-09-10T04:52:16.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f046bfff640 20 reqs_thread_entry: start 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.675+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b789960 con 0x55a96b73f490 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064c420800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064c420800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064c420800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064c420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.676+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b78fe10 con 0x55a96b73f490 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f064c420800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f064c420800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f064c420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94186140923856 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a96b78b430 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94186140665472 notify 146028888120 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55a96b71f320 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f052d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888120 cookie 94186140665472 notifier 4909 bl.length()=636 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f052d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f052d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94186140923856 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.677+0000 7f052d7fa640 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f050c003ea0 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.678+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.678+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94186140923856 notify 146028888120 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a96b71eaf0 con 0x55a96b743910 2024-09-10T04:52:16.689 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.678+0000 7f04fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.678+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186140678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b73f490 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.680+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94186140678144] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.680+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186140651504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b743910 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.681+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94186140651504] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.681+0000 7f064c420800 20 remove_watcher() i=0 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.681+0000 7f064c420800 2 removed watcher, disabling cache 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.681+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186140657968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b73f490 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.682+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94186140657968] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x55a96b73f490 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.682+0000 7f064c420800 20 remove_watcher() i=1 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.682+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186140662064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b743910 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.683+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94186140662064] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.683+0000 7f064c420800 20 remove_watcher() i=2 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.683+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186140664416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x7f063c078020 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.684+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94186140664416] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.684+0000 7f064c420800 20 remove_watcher() i=3 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.684+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186140665472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b743910 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.685+0000 7f0649f0a640 1 -- 172.21.15.145:0/185455157 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94186140665472] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c08b070 con 0x55a96b743910 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.685+0000 7f064c420800 20 remove_watcher() i=4 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.685+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186140669808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b748950 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.686+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94186140669808] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.686+0000 7f064c420800 20 remove_watcher() i=5 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.686+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186140671936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x55a96b748950 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.687+0000 7f0643fff640 1 -- 172.21.15.145:0/185455157 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94186140671936] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634036040 con 0x55a96b748950 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.687+0000 7f064c420800 20 remove_watcher() i=6 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.687+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186140674928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a96b787790 con 0x7f063c078020 2024-09-10T04:52:16.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94186140674928] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0644041040 con 0x7f063c078020 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 20 remove_watcher() i=7 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b743910 msgr2=0x55a96b745d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b743910 0x55a96b745d00 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b73f490 msgr2=0x55a96b741950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b73f490 0x55a96b741950 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f063c078020 msgr2=0x7f063c0a47c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f063c078020 0x7f063c0a47c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a96b748950 msgr2=0x55a96b74ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x55a96b748950 0x55a96b74ad80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f051403c730 msgr2=0x7f051403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f051403c730 0x7f051403ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0634010fd0 tx=0x7f0634011000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 msgr2=0x55a96b734040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064a70b640 1 -- 172.21.15.145:0/185455157 reap_dead start 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f063c0ad040 tx=0x7f063c07fee0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 shutdown_connections 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 --2- 172.21.15.145:0/185455157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b607610 0x55a96b734040 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 >> 172.21.15.145:0/185455157 conn(0x55a96b726e50 msgr2=0x55a96b725060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.688+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 shutdown_connections 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/185455157 wait complete. 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 msgr2=0x7f052403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 0x7f052403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a96b70bdd0 tx=0x7f0634006000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 msgr2=0x55a96b71e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f063c095f60 tx=0x7f063c05aab0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 shutdown_connections 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f052403c780 0x7f052403ec40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/748041816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b71e090 0x55a96b71e4b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 >> 172.21.15.145:0/748041816 conn(0x55a96b712440 msgr2=0x55a96b712820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 shutdown_connections 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/748041816 wait complete. 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b708340 msgr2=0x55a96b70a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55a96b708340 0x55a96b70a7e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b60c030 msgr2=0x55a96b707500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55a96b60c030 0x55a96b707500 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a96b70dbb0 msgr2=0x55a96b70ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x55a96b70dbb0 0x55a96b70ffa0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f053003c730 msgr2=0x7f053003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f053003c730 0x7f053003ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0634001e50 tx=0x7f06340013d0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 msgr2=0x55a96b6ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 --2- 172.21.15.145:0/2821740626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a96b609610 0x55a96b6ffeb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f063c0460d0 tx=0x7f063c002fb0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064a70b640 1 -- 172.21.15.145:0/2821740626 reap_dead start 2024-09-10T04:52:16.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 shutdown_connections 2024-09-10T04:52:16.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 >> 172.21.15.145:0/2821740626 conn(0x55a96b6031d0 msgr2=0x55a96b6f2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 shutdown_connections 2024-09-10T04:52:16.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.689+0000 7f064c420800 1 -- 172.21.15.145:0/2821740626 wait complete. 2024-09-10T04:52:16.701 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.701 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.701 ERROR:root:0 2024-09-10T04:52:16.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.701 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T04:52:16.747 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.747 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f6997f3d800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563328ded210 0x563328df2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f6997f3d800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563328c96e40 con 0x563328debe00 2024-09-10T04:52:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f6997f3d800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x563328c61680 con 0x563328ded210 2024-09-10T04:52:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.747+0000 7f698bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563328ded210 0x563328df2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.748+0000 7f698bfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x563328ded210 0x563328df2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47950/0 (socket says 172.21.15.145:47950) 2024-09-10T04:52:16.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.748+0000 7f698bfff640 1 -- 172.21.15.145:0/1338650953 learned_addr learned my addr 172.21.15.145:0/1338650953 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.748+0000 7f698bfff640 1 -- 172.21.15.145:0/1338650953 >> v1:172.21.15.98:6789/0 conn(0x563328debe00 legacy=0x563328decb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.748+0000 7f698bfff640 1 -- 172.21.15.145:0/1338650953 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328c7d6b0 con 0x563328ded210 2024-09-10T04:52:16.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f698bfff640 1 --2- 172.21.15.145:0/1338650953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328ded210 0x563328df2db0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f698400a520 tx=0x7f6984045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bbeb337dafcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6993429640 1 -- 172.21.15.145:0/1338650953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6984055070 con 0x563328ded210 2024-09-10T04:52:16.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6993429640 1 -- 172.21.15.145:0/1338650953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69840515b0 con 0x563328ded210 2024-09-10T04:52:16.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6993429640 1 -- 172.21.15.145:0/1338650953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69840518d0 con 0x563328ded210 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 -- 172.21.15.145:0/1338650953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328ded210 msgr2=0x563328df2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 --2- 172.21.15.145:0/1338650953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328ded210 0x563328df2db0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f698400a520 tx=0x7f6984045ba0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 -- 172.21.15.145:0/1338650953 shutdown_connections 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 --2- 172.21.15.145:0/1338650953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328ded210 0x563328df2db0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 -- 172.21.15.145:0/1338650953 >> 172.21.15.145:0/1338650953 conn(0x563328de71d0 msgr2=0x563328de9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 -- 172.21.15.145:0/1338650953 shutdown_connections 2024-09-10T04:52:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.750+0000 7f6997f3d800 1 -- 172.21.15.145:0/1338650953 wait complete. 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.764+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.764+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.764+0000 7f6997f3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.764+0000 7f6997f3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563328c85dd0 con 0x563328debe00 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47952/0 (socket says 172.21.15.145:47952) 2024-09-10T04:52:16.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6993c2a640 1 -- 172.21.15.145:0/819130410 learned_addr learned my addr 172.21.15.145:0/819130410 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6993c2a640 1 -- 172.21.15.145:0/819130410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328c9ee10 con 0x563328debe00 2024-09-10T04:52:16.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6993c2a640 1 --2- 172.21.15.145:0/819130410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f697c001da0 tx=0x7f697c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff66cc356e3a4014 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6881e0b640 1 -- 172.21.15.145:0/819130410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c00f400 con 0x563328debe00 2024-09-10T04:52:16.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6881e0b640 1 -- 172.21.15.145:0/819130410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c00f5a0 con 0x563328debe00 2024-09-10T04:52:16.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.765+0000 7f6881e0b640 1 -- 172.21.15.145:0/819130410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c00f8c0 con 0x563328debe00 2024-09-10T04:52:16.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 -- 172.21.15.145:0/819130410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 msgr2=0x563328d5fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 --2- 172.21.15.145:0/819130410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f697c001da0 tx=0x7f697c00b5b0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 -- 172.21.15.145:0/819130410 shutdown_connections 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 --2- 172.21.15.145:0/819130410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328d5fdc0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 -- 172.21.15.145:0/819130410 >> 172.21.15.145:0/819130410 conn(0x563328de71d0 msgr2=0x563328ed6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 -- 172.21.15.145:0/819130410 shutdown_connections 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.766+0000 7f6997f3d800 1 -- 172.21.15.145:0/819130410 wait complete. 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6997f3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328ee4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6997f3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563328ded900 con 0x563328debe00 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328ee4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328ee4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47962/0 (socket says 172.21.15.145:47962) 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6993c2a640 1 -- 172.21.15.145:0/3842546524 learned_addr learned my addr 172.21.15.145:0/3842546524 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6993c2a640 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328ee4590 con 0x563328debe00 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.767+0000 7f6993c2a640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328ee4030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x563328d5f8f0 tx=0x7f697c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f687bfff640 1 -- 172.21.15.145:0/3842546524 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c01a7c0 con 0x563328debe00 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f687bfff640 1 -- 172.21.15.145:0/3842546524 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c01a960 con 0x563328debe00 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f687bfff640 1 -- 172.21.15.145:0/3842546524 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c01ac80 con 0x563328debe00 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563328ee4820 con 0x563328debe00 2024-09-10T04:52:16.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563328ee5430 con 0x563328debe00 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.768+0000 7f687bfff640 1 -- 172.21.15.145:0/3842546524 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f697c017070 con 0x563328debe00 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f687bfff640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f687c03c730 0x7f687c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f687bfff640 1 -- 172.21.15.145:0/3842546524 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f697c015020 con 0x563328debe00 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f698bfff640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f687c03c730 0x7f687c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328ded210 0x563328eeb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328eebbc0 con 0x563328ded210 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f699442b640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328ded210 0x563328eeb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f698bfff640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f687c03c730 0x7f687c03ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6984057000 tx=0x7f6984052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.769+0000 7f699442b640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328ded210 0x563328eeb680 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.770+0000 7f699442b640 1 -- 172.21.15.145:0/3842546524 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328ded210 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.770+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328eec4c0 0x563328eee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.770+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328eef0c0 con 0x563328eec4c0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.770+0000 7f6993c2a640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328eec4c0 0x563328eee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.770+0000 7f6993c2a640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328eec4c0 0x563328eee950 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6993c2a640 1 -- 172.21.15.145:0/3842546524 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f697c02e070 con 0x563328eec4c0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328ef0970 con 0x563328ded210 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f699442b640 1 -- 172.21.15.145:0/3842546524 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328ded210 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328eefba0 con 0x563328eec4c0 2024-09-10T04:52:16.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6993c2a640 1 -- 172.21.15.145:0/3842546524 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f697c02e070 con 0x563328eec4c0 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563328ef1d20 0x563328ef4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.771+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328ef4650 con 0x563328ef1d20 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.772+0000 7f698bfff640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563328ef1d20 0x563328ef4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.772+0000 7f698bfff640 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563328ef1d20 0x563328ef4110 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.772+0000 7f698bfff640 1 -- 172.21.15.145:0/3842546524 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6984057030 con 0x563328ef1d20 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.772+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6997f3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6997f3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563328ce3a00 con 0x563328f021e0 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47966/0 (socket says 172.21.15.145:47966) 2024-09-10T04:52:16.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6993c2a640 1 -- 172.21.15.145:0/2917944910 learned_addr learned my addr 172.21.15.145:0/2917944910 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6993c2a640 1 -- 172.21.15.145:0/2917944910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328f02c40 con 0x563328f021e0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.773+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e6b0 tx=0x7f697c017ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f68797fa640 1 -- 172.21.15.145:0/2917944910 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c01b3d0 con 0x563328f021e0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f68797fa640 1 -- 172.21.15.145:0/2917944910 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c01b570 con 0x563328f021e0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f68797fa640 1 -- 172.21.15.145:0/2917944910 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c01b850 con 0x563328f021e0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563328f03470 con 0x563328f021e0 2024-09-10T04:52:16.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563328f03470 con 0x563328f021e0 2024-09-10T04:52:16.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.774+0000 7f68797fa640 1 -- 172.21.15.145:0/2917944910 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f697c00e070 con 0x563328f021e0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f68797fa640 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 0x7f686c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f68797fa640 1 -- 172.21.15.145:0/2917944910 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f697c03fb20 con 0x563328f021e0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f698bfff640 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 0x7f686c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f698bfff640 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 0x7f686c03ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x563328ee5f70 tx=0x7f6984005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6997f3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6997f3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563328edf390 con 0x563328f0e8e0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47978/0 (socket says 172.21.15.145:47978) 2024-09-10T04:52:16.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.775+0000 7f6993c2a640 1 -- 172.21.15.145:0/2197517959 learned_addr learned my addr 172.21.15.145:0/2197517959 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6993c2a640 1 -- 172.21.15.145:0/2197517959 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328f0f2d0 con 0x563328f0e8e0 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2197517959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e4d0 tx=0x7f697c03a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872f30ecb9af8012 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6872ffd640 1 -- 172.21.15.145:0/2197517959 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c062070 con 0x563328f0e8e0 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6872ffd640 1 -- 172.21.15.145:0/2197517959 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c00aa00 con 0x563328f0e8e0 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6872ffd640 1 -- 172.21.15.145:0/2197517959 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c027430 con 0x563328f0e8e0 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6997f3d800 1 -- 172.21.15.145:0/2197517959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 msgr2=0x563328f0ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.776+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2197517959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e4d0 tx=0x7f697c03a4b0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- 172.21.15.145:0/2197517959 shutdown_connections 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2197517959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f0ece0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- 172.21.15.145:0/2197517959 >> 172.21.15.145:0/2197517959 conn(0x563328f0ace0 msgr2=0x563328f08f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- 172.21.15.145:0/2197517959 shutdown_connections 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- 172.21.15.145:0/2197517959 wait complete. 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 Processor -- start 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- start start 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f15d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6997f3d800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563328f0f740 con 0x563328f0e8e0 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f15d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6993c2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f15d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:47988/0 (socket says 172.21.15.145:47988) 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.777+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 learned_addr learned my addr 172.21.15.145:0/2833860092 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563328f162c0 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f15d60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f697c00fdc0 tx=0x7f697c00a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f68717fa640 1 -- 172.21.15.145:0/2833860092 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c06d020 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f68717fa640 1 -- 172.21.15.145:0/2833860092 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c04cc40 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563328f162c0 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f68717fa640 1 -- 172.21.15.145:0/2833860092 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697c062030 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.778+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563328f162c0 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.779+0000 7f68717fa640 1 -- 172.21.15.145:0/2833860092 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f697c070020 con 0x563328f0e8e0 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.779+0000 7f68717fa640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f685c03c780 0x7f685c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.779+0000 7f68717fa640 1 -- 172.21.15.145:0/2833860092 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f697c063070 con 0x563328f0e8e0 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.779+0000 7f698bfff640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f685c03c780 0x7f685c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f698bfff640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f685c03c780 0x7f685c03ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6984000c00 tx=0x7f698406d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328f21270 0x563328f23730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f23e80 con 0x563328f21270 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f699442b640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328f21270 0x563328f23730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f699442b640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328f21270 0x563328f23730 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 20 realm 2024-09-10T04:52:16.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.780+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f205a0 con 0x563328f21270 2024-09-10T04:52:16.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f24910 con 0x563328f21270 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328f256f0 0x563328f27ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f28140 con 0x563328f256f0 2024-09-10T04:52:16.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.781+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328f256f0 0x563328f27ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328f256f0 0x563328f27ae0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f28990 con 0x563328f21270 2024-09-10T04:52:16.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 20 searching for the correct realm 2024-09-10T04:52:16.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563328f2a700 0x563328f2caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.782+0000 7f698bfff640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563328f2a700 0x563328f2caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f698bfff640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563328f2a700 0x563328f2caf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f6993c2a640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f697c07d040 0x7f697c05d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.783+0000 7f699442b640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f697c07d040 0x7f697c05d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f697c07d040 0x7f697c05d6b0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f698c00a4d0 con 0x7f697c07d040 2024-09-10T04:52:16.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.784+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.785+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c00a4d0 con 0x563328f21270 2024-09-10T04:52:16.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.786+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.787+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.788+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f21270 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.789+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x7f697c07d040 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f698c030040 con 0x7f697c07d040 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.790+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f2a700 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d1c0 con 0x563328f256f0 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f29310 con 0x563328f21270 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f698c030040 con 0x563328f21270 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.791+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f29bb0 con 0x563328f256f0 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f28f50 con 0x7f697c07d040 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 zone default found 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 4 Realm: () 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 zonegroup default 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f2d680 con 0x7f697c07d040 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.792+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f2f500 con 0x563328f2a700 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f2f9e0 con 0x563328f2a700 2024-09-10T04:52:16.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 20 started sync module instance, tier type = 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.793+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f2e950 con 0x563328f256f0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.794+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.794+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777730329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f302f0 con 0x563328f256f0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.795+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f30b40 con 0x563328f21270 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.796+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777730329920] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.796+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x563328f21270 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.796+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777730334272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f30790 con 0x563328f21270 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.796+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31280 con 0x563328f256f0 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.797+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777730334272] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x563328f21270 2024-09-10T04:52:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.797+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.797+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777730338128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31240 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.797+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31cf0 con 0x7f697c07d040 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.798+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777730338128] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.798+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.798+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777730335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31cf0 con 0x7f697c07d040 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.798+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f32760 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.799+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777730335328] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.799+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.799+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777730343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31cf0 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.799+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f33170 con 0x563328f2a700 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.800+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777730343472] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.800+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.800+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777730340928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f31c60 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.800+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f33fe0 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.801+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777730340928] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.801+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.801+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777730348304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f34830 con 0x563328f2a700 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f350e0 con 0x7f697c07d040 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777730354128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f35980 con 0x7f697c07d040 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=0 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=1 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=2 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=3 2024-09-10T04:52:16.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=4 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.802+0000 7f6997f3d800 20 add_watcher() i=5 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.803+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777730348304] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.803+0000 7f6997f3d800 20 add_watcher() i=6 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.803+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777730354128] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c041040 con 0x7f697c07d040 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.803+0000 7f6997f3d800 20 add_watcher() i=7 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.803+0000 7f6997f3d800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.804+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f35980 con 0x563328f21270 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.804+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f698c041040 con 0x563328f21270 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.804+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777730356352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f358d0 con 0x563328f21270 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.805+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777730356352] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f698c041040 con 0x563328f21270 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.805+0000 7f6849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.805+0000 7f6997f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.805+0000 7f6997f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.805+0000 7f6997f3d800 5 note: GC not initialized 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6848fe1640 20 reqs_thread_entry: start 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6997f3d800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6997f3d800 20 Filter name: none 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f67c27fc640 20 reqs_thread_entry: start 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6997f3d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6997f3d800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.806+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f6ba00 con 0x563328f21270 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f698c041040 con 0x563328f21270 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f6997f3d800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f6997f3d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f6997f3d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f6997f3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.807+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f71df0 con 0x563328f21270 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f698c048040 con 0x563328f21270 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6997f3d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6997f3d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6997f3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94777730602992 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563328f6d470 con 0x563328f256f0 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 94777730343472 notify 146028888121 ret 0) ==== 691+0+0 (crc 0 0 0) 0x563328f02c40 con 0x563328f256f0 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6872ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888121 cookie 94777730343472 notifier 4916 bl.length()=649 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6872ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6872ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 94777730602992 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6872ffd640 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6858003ea0 con 0x563328f256f0 2024-09-10T04:52:16.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.808+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 94777730602992 notify 146028888121 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f697c091020 con 0x563328f256f0 2024-09-10T04:52:16.832 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.809+0000 7f6849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.809+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777730356352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f710d0 con 0x563328f21270 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.810+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94777730356352] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f698c048040 con 0x563328f21270 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.810+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777730329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f710d0 con 0x563328f256f0 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.811+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94777730329920] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.812+0000 7f6997f3d800 20 remove_watcher() i=0 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.812+0000 7f6997f3d800 2 removed watcher, disabling cache 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.812+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777730334272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f710d0 con 0x563328f21270 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.812+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94777730334272] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c048040 con 0x563328f21270 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.812+0000 7f6997f3d800 20 remove_watcher() i=1 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.813+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777730338128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f710d0 con 0x563328f256f0 2024-09-10T04:52:16.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.814+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94777730338128] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.814+0000 7f6997f3d800 20 remove_watcher() i=2 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.814+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777730335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f69830 con 0x7f697c07d040 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.815+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94777730335328] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c048040 con 0x7f697c07d040 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.815+0000 7f6997f3d800 20 remove_watcher() i=3 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.815+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777730343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f69830 con 0x563328f256f0 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.816+0000 7f6993c2a640 1 -- 172.21.15.145:0/2833860092 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94777730343472] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f697c02e070 con 0x563328f256f0 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.816+0000 7f6997f3d800 20 remove_watcher() i=4 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.816+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777730340928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f69830 con 0x563328f2a700 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.817+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94777730340928] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.817+0000 7f6997f3d800 20 remove_watcher() i=5 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.817+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777730348304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f69830 con 0x563328f2a700 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.818+0000 7f698bfff640 1 -- 172.21.15.145:0/2833860092 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94777730348304] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6984057030 con 0x563328f2a700 2024-09-10T04:52:16.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.818+0000 7f6997f3d800 20 remove_watcher() i=6 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.818+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777730354128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563328f69830 con 0x7f697c07d040 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94777730354128] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f698c048040 con 0x7f697c07d040 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 20 remove_watcher() i=7 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328f256f0 msgr2=0x563328f27ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328f256f0 0x563328f27ae0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328f21270 msgr2=0x563328f23730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328f21270 0x563328f23730 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f697c07d040 msgr2=0x7f697c05d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f697c07d040 0x7f697c05d6b0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563328f2a700 msgr2=0x563328f2caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x563328f2a700 0x563328f2caf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f685c03c780 msgr2=0x7f685c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f685c03c780 0x7f685c03ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6984000c00 tx=0x7f698406d040 comp rx=0 tx=0).stop 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 msgr2=0x563328f15d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2833860092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f0e8e0 0x563328f15d60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f697c00fdc0 tx=0x7f697c00a880 comp rx=0 tx=0).stop 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 reap_dead start 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f699442b640 1 -- 172.21.15.145:0/2833860092 reap_dead start 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 shutdown_connections 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 >> 172.21.15.145:0/2833860092 conn(0x563328f0ace0 msgr2=0x563328f08ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 shutdown_connections 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2833860092 wait complete. 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 msgr2=0x7f686c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 0x7f686c03ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x563328ee5f70 tx=0x7f6984005ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 msgr2=0x563328f02600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.819+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e6b0 tx=0x7f697c017ac0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 shutdown_connections 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f686c03c780 0x7f686c03ec40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/2917944910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328f021e0 0x563328f02600 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 >> 172.21.15.145:0/2917944910 conn(0x563328ef6590 msgr2=0x563328ef6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 shutdown_connections 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/2917944910 wait complete. 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328eec4c0 msgr2=0x563328eee950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x563328eec4c0 0x563328eee950 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328ded210 msgr2=0x563328eeb680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x563328ded210 0x563328eeb680 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563328ef1d20 msgr2=0x563328ef4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x563328ef1d20 0x563328ef4110 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f687c03c730 msgr2=0x7f687c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f687c03c730 0x7f687c03ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6984057000 tx=0x7f6984052000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 msgr2=0x563328ee4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 --2- 172.21.15.145:0/3842546524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563328debe00 0x563328ee4030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x563328d5f8f0 tx=0x7f697c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f699442b640 1 -- 172.21.15.145:0/3842546524 reap_dead start 2024-09-10T04:52:16.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 shutdown_connections 2024-09-10T04:52:16.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 >> 172.21.15.145:0/3842546524 conn(0x563328de71d0 msgr2=0x563328ed5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 shutdown_connections 2024-09-10T04:52:16.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.820+0000 7f6997f3d800 1 -- 172.21.15.145:0/3842546524 wait complete. 2024-09-10T04:52:16.844 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.844 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.844 ERROR:root:0 2024-09-10T04:52:16.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T04:52:16.845 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T04:52:16.893 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:52:16.893 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:52:16.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6aad40800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5567287f7fd0 0x556728800af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6aad40800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567286a1e40 con 0x5567287f64b0 2024-09-10T04:52:16.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6aad40800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x55672866c680 con 0x5567287f7fd0 2024-09-10T04:52:16.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe69ffff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x5567287f7fd0 0x556728800af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.893+0000 7fe6a6ac0640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x5567287f64b0 0x5567287f68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:36982/0 (socket says 172.21.15.145:36982) 2024-09-10T04:52:16.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.894+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/4252546007 learned_addr learned my addr 172.21.15.145:0/4252546007 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-10T04:52:16.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.894+0000 7fe69ffff640 1 -- 172.21.15.145:0/4252546007 >> v1:172.21.15.98:6789/0 conn(0x5567287f64b0 legacy=0x5567287f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.894+0000 7fe69ffff640 1 -- 172.21.15.145:0/4252546007 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567286886b0 con 0x5567287f7fd0 2024-09-10T04:52:16.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe69ffff640 1 --2- 172.21.15.145:0/4252546007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f7fd0 0x556728800af0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a470 tx=0x7fe690045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacc8d670b7f5129 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6a62bf640 1 -- 172.21.15.145:0/4252546007 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe690053570 con 0x5567287f7fd0 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6a62bf640 1 -- 172.21.15.145:0/4252546007 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690058070 con 0x5567287f7fd0 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6a62bf640 1 -- 172.21.15.145:0/4252546007 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe690053880 con 0x5567287f7fd0 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 -- 172.21.15.145:0/4252546007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f7fd0 msgr2=0x556728800af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 --2- 172.21.15.145:0/4252546007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f7fd0 0x556728800af0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a470 tx=0x7fe690045a20 comp rx=0 tx=0).stop 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 -- 172.21.15.145:0/4252546007 shutdown_connections 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 --2- 172.21.15.145:0/4252546007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f7fd0 0x556728800af0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 -- 172.21.15.145:0/4252546007 >> 172.21.15.145:0/4252546007 conn(0x5567287f21c0 msgr2=0x5567287f4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 -- 172.21.15.145:0/4252546007 shutdown_connections 2024-09-10T04:52:16.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.896+0000 7fe6aad40800 1 -- 172.21.15.145:0/4252546007 wait complete. 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.910+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.910+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.910+0000 7fe6aad40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.910+0000 7fe6aad40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556728690dd0 con 0x5567287f64b0 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:48012/0 (socket says 172.21.15.145:48012) 2024-09-10T04:52:16.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/2118433105 learned_addr learned my addr 172.21.15.145:0/2118433105 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/2118433105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567286a9e10 con 0x5567287f64b0 2024-09-10T04:52:16.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/2118433105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe698001e40 tx=0x7fe698001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb37b0821d86322 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe594e09640 1 -- 172.21.15.145:0/2118433105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe698012020 con 0x5567287f64b0 2024-09-10T04:52:16.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe594e09640 1 -- 172.21.15.145:0/2118433105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69800e5a0 con 0x5567287f64b0 2024-09-10T04:52:16.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.911+0000 7fe594e09640 1 -- 172.21.15.145:0/2118433105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800e8a0 con 0x5567287f64b0 2024-09-10T04:52:16.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 -- 172.21.15.145:0/2118433105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 msgr2=0x5567288e98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 --2- 172.21.15.145:0/2118433105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe698001e40 tx=0x7fe698001e70 comp rx=0 tx=0).stop 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 -- 172.21.15.145:0/2118433105 shutdown_connections 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 --2- 172.21.15.145:0/2118433105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288e98f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 -- 172.21.15.145:0/2118433105 >> 172.21.15.145:0/2118433105 conn(0x5567287f21c0 msgr2=0x5567288e5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 -- 172.21.15.145:0/2118433105 shutdown_connections 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.912+0000 7fe6aad40800 1 -- 172.21.15.145:0/2118433105 wait complete. 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6aad40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6aad40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556728801330 con 0x5567287f64b0 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:48014/0 (socket says 172.21.15.145:48014) 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/635862253 learned_addr learned my addr 172.21.15.145:0/635862253 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567288f17d0 con 0x5567287f64b0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288f1270 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c010 tx=0x7fe698000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.913+0000 7fe593606640 1 -- 172.21.15.145:0/635862253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe698012030 con 0x5567287f64b0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.914+0000 7fe593606640 1 -- 172.21.15.145:0/635862253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6980014a0 con 0x5567287f64b0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.914+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567288f1a60 con 0x5567287f64b0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.914+0000 7fe593606640 1 -- 172.21.15.145:0/635862253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69801a7a0 con 0x5567287f64b0 2024-09-10T04:52:16.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.914+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567288f2460 con 0x5567287f64b0 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.914+0000 7fe593606640 1 -- 172.21.15.145:0/635862253 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe698015020 con 0x5567287f64b0 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe593606640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58c03c780 0x7fe58c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe593606640 1 -- 172.21.15.145:0/635862253 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe698020030 con 0x5567287f64b0 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe69ffff640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58c03c780 0x7fe58c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5567287f7fd0 0x5567288f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567288f2ff0 con 0x5567287f7fd0 2024-09-10T04:52:16.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5567287f7fd0 0x5567288f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe69ffff640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58c03c780 0x7fe58c03ec40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe690057000 tx=0x7fe690052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.915+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5567287f7fd0 0x5567288f88c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.916+0000 7fe6a72c1640 1 -- 172.21.15.145:0/635862253 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a000a4d0 con 0x5567287f7fd0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.916+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5567288f97f0 0x5567288fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.916+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567288fc210 con 0x5567288f97f0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.916+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5567288f97f0 0x5567288fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.916+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5567288f97f0 0x5567288fbbe0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/635862253 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6980187b0 con 0x5567288f97f0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567288fdac0 con 0x5567287f7fd0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6a72c1640 1 -- 172.21.15.145:0/635862253 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6a000a4d0 con 0x5567287f7fd0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567288fccf0 con 0x5567288f97f0 2024-09-10T04:52:16.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/635862253 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6980187b0 con 0x5567288f97f0 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5567288fee70 0x556728901260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567289017a0 con 0x5567288fee70 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.917+0000 7fe69ffff640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5567288fee70 0x556728901260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe69ffff640 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5567288fee70 0x556728901260 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe69ffff640 1 -- 172.21.15.145:0/635862253 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe690051070 con 0x5567288fee70 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe6aad40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.918+0000 7fe6aad40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5567286eea00 con 0x55672890f320 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:48028/0 (socket says 172.21.15.145:48028) 2024-09-10T04:52:16.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1657209108 learned_addr learned my addr 172.21.15.145:0/1657209108 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1657209108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672890fd80 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe698051f50 tx=0x7fe698017f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe590e01640 1 -- 172.21.15.145:0/1657209108 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800cdf0 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe590e01640 1 -- 172.21.15.145:0/1657209108 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe698045070 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567289105b0 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe590e01640 1 -- 172.21.15.145:0/1657209108 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6980163b0 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.919+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556728910b50 con 0x55672890f320 2024-09-10T04:52:16.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.920+0000 7fe590e01640 1 -- 172.21.15.145:0/1657209108 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe698053040 con 0x55672890f320 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.920+0000 7fe590e01640 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 0x7fe58003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.920+0000 7fe590e01640 1 -- 172.21.15.145:0/1657209108 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe698050e90 con 0x55672890f320 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.920+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 0x7fe58003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 0x7fe58003ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5567288f2860 tx=0x7fe690005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6aad40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6aad40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5567288ea140 con 0x55672891bbe0 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:48030/0 (socket says 172.21.15.145:48030) 2024-09-10T04:52:16.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/3089864749 learned_addr learned my addr 172.21.15.145:0/3089864749 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/3089864749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672891c5d0 con 0x55672891bbe0 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/3089864749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe698024810 tx=0x7fe698050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af89466e7cbba8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe58a7fc640 1 -- 172.21.15.145:0/3089864749 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69805a050 con 0x55672891bbe0 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe58a7fc640 1 -- 172.21.15.145:0/3089864749 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69805b040 con 0x55672891bbe0 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.921+0000 7fe58a7fc640 1 -- 172.21.15.145:0/3089864749 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69804be30 con 0x55672891bbe0 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- 172.21.15.145:0/3089864749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 msgr2=0x55672891bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 --2- 172.21.15.145:0/3089864749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe698024810 tx=0x7fe698050830 comp rx=0 tx=0).stop 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- 172.21.15.145:0/3089864749 shutdown_connections 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 --2- 172.21.15.145:0/3089864749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x55672891bfe0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- 172.21.15.145:0/3089864749 >> 172.21.15.145:0/3089864749 conn(0x556728917fe0 msgr2=0x556728916220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- 172.21.15.145:0/3089864749 shutdown_connections 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- 172.21.15.145:0/3089864749 wait complete. 2024-09-10T04:52:16.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 Processor -- start 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- start start 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x556728923040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.922+0000 7fe6aad40800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55672891ca40 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x556728923040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6a6ac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x556728923040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:48032/0 (socket says 172.21.15.145:48032) 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 learned_addr learned my addr 172.21.15.145:0/1446520378 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567289235a0 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x556728923040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe698050d70 tx=0x7fe698026fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe588ff9640 1 -- 172.21.15.145:0/1446520378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69806f070 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe588ff9640 1 -- 172.21.15.145:0/1446520378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe698050620 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567289235a0 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe588ff9640 1 -- 172.21.15.145:0/1446520378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800d5f0 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.923+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567289235a0 con 0x55672891bbe0 2024-09-10T04:52:16.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.924+0000 7fe588ff9640 1 -- 172.21.15.145:0/1446520378 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe698072070 con 0x55672891bbe0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.924+0000 7fe588ff9640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe57003c6e0 0x7fe57003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.924+0000 7fe588ff9640 1 -- 172.21.15.145:0/1446520378 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe698075db0 con 0x55672891bbe0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.924+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe57003c6e0 0x7fe57003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe57003c6e0 0x7fe57003eba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe690053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55672892e630 0x556728930af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728931240 con 0x55672892e630 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55672892e630 0x556728930af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.925+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55672892e630 0x556728930af0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 realm 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672892d960 con 0x55672892e630 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728931cd0 con 0x55672892e630 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556728932ab0 0x556728934ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728935500 con 0x556728932ab0 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556728932ab0 0x556728934ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.926+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556728932ab0 0x556728934ea0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728935d50 con 0x55672892e630 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 20 searching for the correct realm 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556728937ac0 0x556728939ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556728937ac0 0x556728939ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.927+0000 7fe69ffff640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556728937ac0 0x556728939ef0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe6a6ac0640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe698074070 0x7fe698025030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe698074070 0x7fe698025030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.928+0000 7fe6a72c1640 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe698074070 0x7fe698025030 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6a000a4d0 con 0x7fe698074070 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.929+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a000a4d0 con 0x55672892e630 2024-09-10T04:52:16.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.930+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.931+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.932+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x55672892e630 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.933+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0030040 con 0x7fe698074070 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.934+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728937ac0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55672893a5c0 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:52:16.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.935+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567289366d0 con 0x55672892e630 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a0030040 con 0x55672892e630 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728936f70 con 0x556728932ab0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728936310 con 0x7fe698074070 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 zone default found 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 4 Realm: () 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 zonegroup default 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.936+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672893aa80 con 0x7fe698074070 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672893c900 con 0x556728937ac0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672893cde0 con 0x556728937ac0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 started sync module instance, tier type = 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.937+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893bd50 con 0x556728932ab0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.939+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.939+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901550764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893bd50 con 0x556728932ab0 2024-09-10T04:52:16.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.939+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893d860 con 0x55672892e630 2024-09-10T04:52:16.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.940+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.940+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901550769072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893d810 con 0x55672892e630 2024-09-10T04:52:16.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.940+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893e830 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.940+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901550764656] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.941+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901550769072] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.941+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.941+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901550771280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893e7f0 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.941+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893f0d0 con 0x7fe698074070 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.942+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901550771280] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.942+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.942+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901550773024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893e7f0 con 0x7fe698074070 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.942+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893f7e0 con 0x556728932ab0 2024-09-10T04:52:16.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.944+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901550773024] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.944+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.944+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901550777024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672893fbd0 con 0x556728932ab0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.944+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728940420 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.945+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901550777024] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.945+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.945+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901550774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567289407c0 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.945+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728941010 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.946+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901550774736] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.946+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.946+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901550783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728941430 con 0x556728937ac0 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.946+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728941e30 con 0x7fe698074070 2024-09-10T04:52:16.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901550783328] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901550786880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728941430 con 0x7fe698074070 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=0 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=1 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=2 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=3 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=4 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=5 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.947+0000 7fe6aad40800 20 add_watcher() i=6 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.948+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901550786880] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.948+0000 7fe6aad40800 20 add_watcher() i=7 2024-09-10T04:52:16.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.948+0000 7fe6aad40800 2 all 8 watchers are set, enabling cache 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.948+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728945330 con 0x55672892e630 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.949+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.949+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901550785008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728942700 con 0x55672892e630 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901550785008] v34'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe55d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe6aad40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe6aad40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe6aad40800 5 note: GC not initialized 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.950+0000 7fe4d7fff640 20 reqs_thread_entry: start 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 20 init_complete bucket index max shards: 11 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 20 Filter name: none 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe4d5ffb640 20 reqs_thread_entry: start 2024-09-10T04:52:16.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 20 rados->read ofs=0 len=0 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556728978390 con 0x55672892e630 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.951+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672897ea90 con 0x55672892e630 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.952+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.952+0000 7fe6aad40800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.952+0000 7fe6aad40800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.952+0000 7fe6aad40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T04:52:16.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.952+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93901551035536 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672897a0f0 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== watch-notify(notify (1) cookie 93901550777024 notify 146028888122 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5567289105b0 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe58a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888122 cookie 93901550777024 notifier 4923 bl.length()=649 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(64 notify.4 [notify cookie 93901551035536 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe58a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe58a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe58a7fc640 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe56c003ea0 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.953+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== watch-notify(notify_complete (2) cookie 93901551035536 notify 146028888122 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55672890fd80 con 0x556728932ab0 2024-09-10T04:52:16.966 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T04:52:15.028354Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T04:52:15.028339Z","tags":[],"group_ids":[]} 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.954+0000 7fe55d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.954+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901550785008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x55672892e630 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.955+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93901550785008] v34'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.955+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901550764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x556728932ab0 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.956+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93901550764656] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.956+0000 7fe6aad40800 20 remove_watcher() i=0 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.956+0000 7fe6aad40800 2 removed watcher, disabling cache 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.956+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901550769072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x55672892e630 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.957+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93901550769072] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x55672892e630 2024-09-10T04:52:16.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.957+0000 7fe6aad40800 20 remove_watcher() i=1 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.957+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901550771280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x556728932ab0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.961+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93901550771280] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.961+0000 7fe6aad40800 20 remove_watcher() i=2 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.961+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901550773024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x7fe698074070 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.962+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93901550773024] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.962+0000 7fe6aad40800 20 remove_watcher() i=3 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.962+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901550777024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x556728932ab0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.963+0000 7fe6a6ac0640 1 -- 172.21.15.145:0/1446520378 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93901550777024] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe698071030 con 0x556728932ab0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.963+0000 7fe6aad40800 20 remove_watcher() i=4 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.963+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901550774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x556728937ac0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.964+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93901550774736] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.964+0000 7fe6aad40800 20 remove_watcher() i=5 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.964+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901550783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x556728937ac0 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.965+0000 7fe69ffff640 1 -- 172.21.15.145:0/1446520378 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93901550783328] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69007c040 con 0x556728937ac0 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.965+0000 7fe6aad40800 20 remove_watcher() i=6 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.965+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901550786880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556728976220 con 0x7fe698074070 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93901550786880] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a0041040 con 0x7fe698074070 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 20 remove_watcher() i=7 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556728932ab0 msgr2=0x556728934ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556728932ab0 0x556728934ea0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55672892e630 msgr2=0x556728930af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x55672892e630 0x556728930af0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe698074070 msgr2=0x7fe698025030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7fe698074070 0x7fe698025030 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556728937ac0 msgr2=0x556728939ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x556728937ac0 0x556728939ef0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe57003c6e0 msgr2=0x7fe57003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe57003c6e0 0x7fe57003eba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe690053000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 msgr2=0x556728923040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1446520378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672891bbe0 0x556728923040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe698050d70 tx=0x7fe698026fc0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 reap_dead start 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6a72c1640 1 -- 172.21.15.145:0/1446520378 reap_dead start 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 shutdown_connections 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 >> 172.21.15.145:0/1446520378 conn(0x556728917fe0 msgr2=0x5567289161f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 shutdown_connections 2024-09-10T04:52:16.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.966+0000 7fe6aad40800 1 -- 172.21.15.145:0/1446520378 wait complete. 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 msgr2=0x7fe58003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 0x7fe58003ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5567288f2860 tx=0x7fe690005a00 comp rx=0 tx=0).stop 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 msgr2=0x55672890f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe698051f50 tx=0x7fe698017f10 comp rx=0 tx=0).stop 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 shutdown_connections 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58003c730 0x7fe58003ebf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/1657209108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55672890f320 0x55672890f740 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 >> 172.21.15.145:0/1657209108 conn(0x5567289036d0 msgr2=0x556728903ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 shutdown_connections 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/1657209108 wait complete. 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5567288f97f0 msgr2=0x5567288fbbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x5567288f97f0 0x5567288fbbe0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5567287f7fd0 msgr2=0x5567288f88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x5567287f7fd0 0x5567288f88c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5567288fee70 msgr2=0x556728901260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x5567288fee70 0x556728901260 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58c03c780 msgr2=0x7fe58c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe58c03c780 0x7fe58c03ec40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe690057000 tx=0x7fe690052000 comp rx=0 tx=0).stop 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 msgr2=0x5567288f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 --2- 172.21.15.145:0/635862253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5567287f64b0 0x5567288f1270 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c010 tx=0x7fe698000ed0 comp rx=0 tx=0).stop 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6a72c1640 1 -- 172.21.15.145:0/635862253 reap_dead start 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 shutdown_connections 2024-09-10T04:52:16.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 >> 172.21.15.145:0/635862253 conn(0x5567287f21c0 msgr2=0x5567288eabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:52:16.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 shutdown_connections 2024-09-10T04:52:16.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:52:16.967+0000 7fe6aad40800 1 -- 172.21.15.145:0/635862253 wait complete. 2024-09-10T04:52:16.979 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.979 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T04:52:15.028354Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T04:52:15.028339Z', 'tags': [], 'group_ids': []} 2024-09-10T04:52:16.979 ERROR:root:0 2024-09-10T04:52:16.979 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T04:52:16.986 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.987 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:16.990 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.991 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T04:52:16.997 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:16.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.000 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-10T04:52:17.008 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-10T04:52:17.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.012 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.012 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-10T04:52:17.019 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.020 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.023 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-10T04:52:17.031 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-10T04:52:17.031 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.034 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.035 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-10T04:52:17.042 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-10T04:52:17.042 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.046 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.046 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-10T04:52:17.053 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.053 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.057 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.057 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-10T04:52:17.063 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.063 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.066 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.067 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-10T04:52:17.073 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.074 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.077 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.077 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.084 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T04:52:17.085 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T04:52:17.089 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T04:52:17.101 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T04:52:17.108 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-10T04:52:17.108 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T04:52:17.113 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:52:17.096703Z', 'creation_time': '2024-09-10T04:52:17.092875Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T04:52:17.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T04:52:17.118 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:52:17.096703Z', 'creation_time': '2024-09-10T04:52:17.092875Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T04:52:17.123 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T04:52:17.127 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:52:17.096703Z', 'creation_time': '2024-09-10T04:52:17.092875Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T04:52:17.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-10T04:52:17.131 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000420d8fb0887424de-0066dfd081-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:52:17.136 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-10T04:52:17.142 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.143 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-10T04:52:17.151 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:52:17.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11'} 2024-09-10T04:52:17.212 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11'} 2024-09-10T04:52:17.227 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.228 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-10T04:52:17.236 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-10T04:52:17.249 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:52:17.250 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T04:52:17.254 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'marker': 'df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T04:52:17.222692Z', 'creation_time': '2024-09-10T04:52:17.092875Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-10T04:53:17.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-10T04:53:17.321 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.321 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-10T04:53:17.336 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T04:53:17.340 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-10T04:53:17.345 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.345 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-10T04:53:17.349 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.349 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-10T04:53:17.353 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-10T04:53:17.358 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T04:00:00.000000Z', 'epoch': 1725940800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T04:53:17.358 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-10T04:53:17.364 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:17.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T04:53:17.369 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-10T04:53:17.370 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T04:53:17.378 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:53:17.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T04:53:17.392 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:53:17.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T04:53:17.643 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000025c0b7c807c121d5-0066dfd0bd-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:17.746 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T04:53:17.750 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T04:53:17.755 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T04:53:17.759 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T04:53:17.869 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-10T04:53:17.911 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:17.912 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T04:53:17.918 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-10T04:53:17.919 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T04:53:17.924 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T04:53:17.939 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T04:53:17.943 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000489a1666d6023e31-0066dfd0bd-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:17.962 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-10T04:53:17.989 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:17.989 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T04:53:17.993 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000001156bd33e5e4a077-0066dfd0bd-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:17.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-10T04:53:17.997 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '06b8cc4b-d741-4e82-9b7a-3e23bf79f786'}]}} 2024-09-10T04:53:17.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-10T04:53:18.006 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T04:53:18.006 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T04:53:18.010 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T04:53:18.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-10T04:53:18.014 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000001ef3220adcb3d993-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.014 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-10T04:53:18.018 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000298bc44e07db5675-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.027 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T04:53:18.031 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T04:53:18.031 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-10T04:53:18.034 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002d326dd65ec93529-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.034 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-10T04:53:18.038 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000082d9daeace01990b-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.038 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-10T04:53:18.041 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T04:53:18.042 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-10T04:53:18.045 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fb4cc662edb9d585-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.045 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-10T04:53:18.049 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d73f1ddb84896139-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.049 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-10T04:53:18.052 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000cd4cad7594f0a789-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.052 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-10T04:53:18.056 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000064f1e9e8f8a18823-0066dfd0be-4230-default', 'HostId': '4230-default-default'} 2024-09-10T04:53:18.056 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-10T04:53:18.065 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:18.065 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T04:53:18.068 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-10T04:53:18.069 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-10T04:53:18.074 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:18.074 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T04:53:18.077 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-10T04:53:18.078 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-10T04:53:18.083 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T04:53:18.088 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T04:53:18.098 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T04:53:18.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:53:18.099 INFO:tasks.rgw.client.0.smithi145.stdout:2024-09-10T04:53:18.098+0000 7fe84a45e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35585) UID: 0 2024-09-10T04:53:18.100 INFO:tasks.rgw.client.0.smithi145.stdout:2024-09-10T04:53:18.098+0000 7fe84dcb7880 -1 shutting down 2024-09-10T04:53:24.201 INFO:tasks.rgw.client.0:Stopped 2024-09-10T04:53:24.201 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T04:53:24.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T04:53:24.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T04:53:24.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T04:53:24.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T04:53:24.359 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T04:53:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-10T04:53:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564e542800 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556106362fd0 0x55610636baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564e542800 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55610620ce40 con 0x5561063614b0 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564e542800 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x5561061d7680 con 0x556106362fd0 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f5641a85640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556106362fd0 0x55610636baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f5641a85640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x556106362fd0 0x55610636baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35906/0 (socket says 172.21.15.145:35906) 2024-09-10T04:53:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f5641a85640 1 -- 172.21.15.145:0/1440476990 learned_addr learned my addr 172.21.15.145:0/1440476990 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.445+0000 7f564a286640 1 --1- 172.21.15.145:0/1440476990 >> v1:172.21.15.98:6789/0 conn(0x5561063614b0 0x5561063618b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.145:44458/0 (socket says 172.21.15.145:44458) 2024-09-10T04:53:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.446+0000 7f5641a85640 1 -- 172.21.15.145:0/1440476990 >> v1:172.21.15.98:6789/0 conn(0x5561063614b0 legacy=0x5561063618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.446+0000 7f5641a85640 1 -- 172.21.15.145:0/1440476990 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561061f36b0 con 0x556106362fd0 2024-09-10T04:53:24.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.447+0000 7f5641a85640 1 --2- 172.21.15.145:0/1440476990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106362fd0 0x55610636baf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f563400a520 tx=0x7f5634045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32130a01b7a05f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f5649a85640 1 -- 172.21.15.145:0/1440476990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5634055070 con 0x556106362fd0 2024-09-10T04:53:24.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f5649a85640 1 -- 172.21.15.145:0/1440476990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56340515b0 con 0x556106362fd0 2024-09-10T04:53:24.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f5649a85640 1 -- 172.21.15.145:0/1440476990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56340518d0 con 0x556106362fd0 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 -- 172.21.15.145:0/1440476990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106362fd0 msgr2=0x55610636baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 --2- 172.21.15.145:0/1440476990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106362fd0 0x55610636baf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f563400a520 tx=0x7f5634045ba0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 -- 172.21.15.145:0/1440476990 shutdown_connections 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 --2- 172.21.15.145:0/1440476990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106362fd0 0x55610636baf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 -- 172.21.15.145:0/1440476990 >> 172.21.15.145:0/1440476990 conn(0x55610635d1c0 msgr2=0x55610635f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 -- 172.21.15.145:0/1440476990 shutdown_connections 2024-09-10T04:53:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.448+0000 7f564e542800 1 -- 172.21.15.145:0/1440476990 wait complete. 2024-09-10T04:53:24.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.463+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.463+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.463+0000 7f564e542800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.463+0000 7f564e542800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561061fbdd0 con 0x5561063614b0 2024-09-10T04:53:24.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.464+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.464+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35916/0 (socket says 172.21.15.145:35916) 2024-09-10T04:53:24.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.464+0000 7f564a286640 1 -- 172.21.15.145:0/1213343619 learned_addr learned my addr 172.21.15.145:0/1213343619 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.464+0000 7f564a286640 1 -- 172.21.15.145:0/1213343619 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556106214e10 con 0x5561063614b0 2024-09-10T04:53:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.464+0000 7f564a286640 1 --2- 172.21.15.145:0/1213343619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f563c00b260 tx=0x7f563c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693cf51d9d0ea738 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f5538608640 1 -- 172.21.15.145:0/1213343619 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c00be60 con 0x5561063614b0 2024-09-10T04:53:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f5538608640 1 -- 172.21.15.145:0/1213343619 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c006070 con 0x5561063614b0 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f5538608640 1 -- 172.21.15.145:0/1213343619 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c00e710 con 0x5561063614b0 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 -- 172.21.15.145:0/1213343619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 msgr2=0x556106454870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 --2- 172.21.15.145:0/1213343619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f563c00b260 tx=0x7f563c00b660 comp rx=0 tx=0).stop 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 -- 172.21.15.145:0/1213343619 shutdown_connections 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 --2- 172.21.15.145:0/1213343619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x556106454870 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 -- 172.21.15.145:0/1213343619 >> 172.21.15.145:0/1213343619 conn(0x55610635d1c0 msgr2=0x5561064501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 -- 172.21.15.145:0/1213343619 shutdown_connections 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.465+0000 7f564e542800 1 -- 172.21.15.145:0/1213343619 wait complete. 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564e542800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x55610645c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564e542800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55610636c330 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x55610645c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x55610645c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35928/0 (socket says 172.21.15.145:35928) 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564a286640 1 -- 172.21.15.145:0/3413013227 learned_addr learned my addr 172.21.15.145:0/3413013227 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.466+0000 7f564a286640 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610645c780 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f564a286640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x55610645c220 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x556106455800 tx=0x7f563c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f5536e05640 1 -- 172.21.15.145:0/3413013227 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c00ee10 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f5536e05640 1 -- 172.21.15.145:0/3413013227 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c00fa30 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55610645ca10 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f5536e05640 1 -- 172.21.15.145:0/3413013227 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c00fd30 con 0x5561063614b0 2024-09-10T04:53:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.467+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610645d410 con 0x5561063614b0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f5536e05640 1 -- 172.21.15.145:0/3413013227 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f563c017070 con 0x5561063614b0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f5536e05640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f553003c730 0x7f553003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f5536e05640 1 -- 172.21.15.145:0/3413013227 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f563c015020 con 0x5561063614b0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f5641a85640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f553003c730 0x7f553003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106362fd0 0x556106463870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556106463db0 con 0x556106362fd0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f564aa87640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106362fd0 0x556106463870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.468+0000 7f5641a85640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f553003c730 0x7f553003ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5634057000 tx=0x7f5634052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.469+0000 7f564aa87640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106362fd0 0x556106463870 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.469+0000 7f564aa87640 1 -- 172.21.15.145:0/3413013227 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564400a4d0 con 0x556106362fd0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.469+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556106464660 0x556106466b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.469+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556106467290 con 0x556106464660 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.469+0000 7f564a286640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556106464660 0x556106466b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.470+0000 7f564a286640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556106464660 0x556106466b20 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.470+0000 7f564a286640 1 -- 172.21.15.145:0/3413013227 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f563c02e070 con 0x556106464660 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.470+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556106468b40 con 0x556106362fd0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.470+0000 7f564aa87640 1 -- 172.21.15.145:0/3413013227 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(3 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f564400a4d0 con 0x556106362fd0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.470+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556106467d70 con 0x556106464660 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.471+0000 7f564a286640 1 -- 172.21.15.145:0/3413013227 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f563c02e070 con 0x556106464660 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.471+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556106469ef0 0x55610646c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.471+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:5 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55610646c820 con 0x556106469ef0 2024-09-10T04:53:24.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.471+0000 7f5641a85640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556106469ef0 0x55610646c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f5641a85640 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556106469ef0 0x55610646c2e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f5641a85640 1 -- 172.21.15.145:0/3413013227 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(5 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5634057030 con 0x556106469ef0 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f564e542800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.472+0000 7f564e542800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556106259a00 con 0x55610647a3a0 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35944/0 (socket says 172.21.15.145:35944) 2024-09-10T04:53:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564a286640 1 -- 172.21.15.145:0/3193720202 learned_addr learned my addr 172.21.15.145:0/3193720202 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564a286640 1 -- 172.21.15.145:0/3193720202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610647ae00 con 0x55610647a3a0 2024-09-10T04:53:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564a286640 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f563c017ce0 tx=0x7f563c019e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f552ffff640 1 -- 172.21.15.145:0/3193720202 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c035070 con 0x55610647a3a0 2024-09-10T04:53:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f552ffff640 1 -- 172.21.15.145:0/3193720202 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c0540b0 con 0x55610647a3a0 2024-09-10T04:53:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f552ffff640 1 -- 172.21.15.145:0/3193720202 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c01ae60 con 0x55610647a3a0 2024-09-10T04:53:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55610647b630 con 0x55610647a3a0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.473+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610647bbd0 con 0x55610647a3a0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.474+0000 7f552ffff640 1 -- 172.21.15.145:0/3193720202 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f563c038070 con 0x55610647a3a0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.474+0000 7f552ffff640 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 0x7f552403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.474+0000 7f552ffff640 1 -- 172.21.15.145:0/3193720202 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f563c03bdb0 con 0x55610647a3a0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.474+0000 7f5641a85640 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 0x7f552403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f5641a85640 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 0x7f552403eba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55610645e150 tx=0x7f5634005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564e542800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564e542800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5561064550c0 con 0x556106486ca0 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35948/0 (socket says 172.21.15.145:35948) 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564a286640 1 -- 172.21.15.145:0/2633964783 learned_addr learned my addr 172.21.15.145:0/2633964783 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.475+0000 7f564a286640 1 -- 172.21.15.145:0/2633964783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556106487690 con 0x556106486ca0 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564a286640 1 --2- 172.21.15.145:0/2633964783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f563c0307d0 tx=0x7f563c027e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cda76abc1e0c161 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f552dffb640 1 -- 172.21.15.145:0/2633964783 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c044cd0 con 0x556106486ca0 2024-09-10T04:53:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f552dffb640 1 -- 172.21.15.145:0/2633964783 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c044940 con 0x556106486ca0 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f552dffb640 1 -- 172.21.15.145:0/2633964783 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c051130 con 0x556106486ca0 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 -- 172.21.15.145:0/2633964783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 msgr2=0x5561064870a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 --2- 172.21.15.145:0/2633964783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f563c0307d0 tx=0x7f563c027e00 comp rx=0 tx=0).stop 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 -- 172.21.15.145:0/2633964783 shutdown_connections 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 --2- 172.21.15.145:0/2633964783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x5561064870a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 -- 172.21.15.145:0/2633964783 >> 172.21.15.145:0/2633964783 conn(0x5561064830a0 msgr2=0x5561064812e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 -- 172.21.15.145:0/2633964783 shutdown_connections 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.476+0000 7f564e542800 1 -- 172.21.15.145:0/2633964783 wait complete. 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564e542800 1 Processor -- start 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564e542800 1 -- start start 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564e542800 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564e542800 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556106487b00 con 0x556106486ca0 2024-09-10T04:53:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564a286640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.145:35954/0 (socket says 172.21.15.145:35954) 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 learned_addr learned my addr 172.21.15.145:0/2619604768 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.477+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610648e660 con 0x556106486ca0 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f564a286640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f563c01c020 tx=0x7f563c005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f551bfff640 1 -- 172.21.15.145:0/2619604768 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c04b1c0 con 0x556106486ca0 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f551bfff640 1 -- 172.21.15.145:0/2619604768 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c04b360 con 0x556106486ca0 2024-09-10T04:53:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55610648e660 con 0x556106486ca0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f551bfff640 1 -- 172.21.15.145:0/2619604768 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c01b890 con 0x556106486ca0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610648e660 con 0x556106486ca0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.478+0000 7f551bfff640 1 -- 172.21.15.145:0/2619604768 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f563c06c070 con 0x556106486ca0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f551bfff640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f551403c730 0x7f551403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f551bfff640 1 -- 172.21.15.145:0/2619604768 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f563c070d80 con 0x556106486ca0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f5641a85640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f551403c730 0x7f551403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f5641a85640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f551403c730 0x7f551403ebf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5634045be0 tx=0x7f563406d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106499570 0x55610649ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55610649c180 con 0x556106499570 2024-09-10T04:53:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.479+0000 7f564aa87640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106499570 0x55610649ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564aa87640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106499570 0x55610649ba30 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 realm 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064988a0 con 0x556106499570 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55610649cc10 con 0x556106499570 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55610649d9f0 0x55610649fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.480+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a0470 con 0x55610649d9f0 2024-09-10T04:53:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564a286640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55610649d9f0 0x55610649fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564a286640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55610649d9f0 0x55610649fde0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564e542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.481+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:5 5.c 5:32b017c4:::zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a0cc0 con 0x556106499570 2024-09-10T04:53:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 4 ==== osd_op_reply(5 zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f564e542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f564e542800 20 searching for the correct realm 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561064a2a30 0x5561064a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f5641a85640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561064a2a30 0x5561064a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f5641a85640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561064a2a30 0x5561064a4e80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.482+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564a286640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f563c03a070 0x7f563c0318d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564aa87640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f563c03a070 0x7f563c0318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564aa87640 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f563c03a070 0x7f563c0318d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f564400a4d0 con 0x7f563c03a070 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.483+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 7 ==== osd_op_reply(12 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.484+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 4 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564400a4d0 con 0x556106499570 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.485+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.486+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 10 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 11 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.487+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 4 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x556106499570 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.488+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5644030040 con 0x7f563c03a070 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.489+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x5561064a2a30 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 9 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.490+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5561064a5550 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 10 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got zone_info.df93e6a2-96e2-43a0-9951-5c4d01bc8580 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T04:53:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got period_config.default 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a1610 con 0x556106499570 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5644030040 con 0x556106499570 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a1250 con 0x55610649d9f0 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.491+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:40 5.8 5:13abc4be:::zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a1fb0 con 0x7f563c03a070 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 8 ==== osd_op_reply(40 zonegroup_info.aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 zone default found 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 4 Realm: () 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 4 ZoneGroup: default (aa1b7b62-51d6-4816-a0de-2c4e6dbe6ca3) 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 4 Zone: default (df93e6a2-96e2-43a0-9951-5c4d01bc8580) 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 zonegroup default 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a59f0 con 0x7f563c03a070 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 rados_obj.operate() r=0 bl.length=187 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a7950 con 0x5561064a2a30 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.492+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 20 rados->read ofs=0 len=0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064a7d70 con 0x5561064a2a30 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 20 started sync module instance, tier type = 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 20 started zone id=df93e6a2-96e2-43a0-9951-5c4d01bc8580 (name=default) with tier type = 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.493+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a6cc0 con 0x55610649d9f0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.494+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 12 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.494+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93875205730528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a8690 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.494+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a8ee0 con 0x556106499570 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.495+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93875205730528] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.495+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 15 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.495+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93875205734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a8ab0 con 0x556106499570 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.495+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a95b0 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.496+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93875205734880] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.496+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 14 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.496+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93875205738656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a8ab0 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.497+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064aa050 con 0x7f563c03a070 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.497+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 10 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.498+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93875205741376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064aa500 con 0x7f563c03a070 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.498+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064aaff0 con 0x55610649d9f0 2024-09-10T04:53:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.498+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93875205738656] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.499+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93875205741376] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.499+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 16 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.499+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93875205745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064aafb0 con 0x55610649d9f0 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.499+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ab890 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.500+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 10 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.500+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93875205745344] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.500+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93875205747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064aafb0 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.500+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a8620 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.501+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93875205747680] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.501+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.501+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93875205751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064acb80 con 0x5561064a2a30 2024-09-10T04:53:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.501+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ad3d0 con 0x7f563c03a070 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 12 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93875205755168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064adca0 con 0x7f563c03a070 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=0 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=1 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=2 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=3 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=4 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=5 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93875205751472] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.502+0000 7f564e542800 20 add_watcher() i=6 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.503+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93875205755168] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.503+0000 7f564e542800 20 add_watcher() i=7 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.503+0000 7f564e542800 2 all 8 watchers are set, enabling cache 2024-09-10T04:53:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.503+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064adca0 con 0x556106499570 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.504+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.504+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93875205756832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064adbc0 con 0x556106499570 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.505+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93875205756832] v34'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.505+0000 7f5500fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.505+0000 7f564e542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.505+0000 7f564e542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.505+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064b94c0 con 0x55610649d9f0 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.507+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 18 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.507+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064b94c0 con 0x7f563c03a070 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.508+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.508+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064b94c0 con 0x5561064a2a30 2024-09-10T04:53:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.509+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.509+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064b9f00 con 0x556106499570 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.510+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'281 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.510+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ba470 con 0x55610649d9f0 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.511+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 19 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'89 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.511+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ba470 con 0x5561064a2a30 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.512+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.512+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ba9e0 con 0x55610649d9f0 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.513+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 20 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.513+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ba9e0 con 0x556106499570 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.515+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'63 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.515+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064baf50 con 0x55610649d9f0 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.516+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 21 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.516+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064baf50 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.517+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 22 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.517+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064baf50 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.518+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 23 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'90 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.518+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064baf50 con 0x5561064a2a30 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.519+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.519+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb4c0 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.520+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 24 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'40 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.520+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb4c0 con 0x556106499570 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.521+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.521+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb550 con 0x556106499570 2024-09-10T04:53:24.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.522+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'282 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.522+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb550 con 0x55610649d9f0 2024-09-10T04:53:24.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.524+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 25 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.524+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb550 con 0x55610649d9f0 2024-09-10T04:53:24.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.526+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 26 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'91 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.526+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb590 con 0x5561064a2a30 2024-09-10T04:53:24.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.527+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.527+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb660 con 0x55610649d9f0 2024-09-10T04:53:24.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.528+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.528+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb660 con 0x556106499570 2024-09-10T04:53:24.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.529+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'283 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.529+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb660 con 0x55610649d9f0 2024-09-10T04:53:24.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.530+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 28 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.530+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb660 con 0x55610649d9f0 2024-09-10T04:53:24.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.532+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 29 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.532+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb6a0 con 0x5561064a2a30 2024-09-10T04:53:24.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.533+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.533+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb730 con 0x55610649d9f0 2024-09-10T04:53:24.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.534+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 30 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.534+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb770 con 0x5561064a2a30 2024-09-10T04:53:24.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.535+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.535+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb800 con 0x5561064a2a30 2024-09-10T04:53:24.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.536+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'69 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.536+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb840 con 0x5561064a2a30 2024-09-10T04:53:24.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.537+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.537+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb880 con 0x55610649d9f0 2024-09-10T04:53:24.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.538+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 31 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.538+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb880 con 0x556106499570 2024-09-10T04:53:24.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.540+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'64 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.540+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb880 con 0x55610649d9f0 2024-09-10T04:53:24.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.541+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 32 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.541+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb880 con 0x556106499570 2024-09-10T04:53:24.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.542+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.542+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064bb8c0 con 0x7f563c03a070 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.543+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 15 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5644041040 con 0x7f563c03a070 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.543+0000 7f547b7fe640 20 reqs_thread_entry: start 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.543+0000 7f564e542800 20 init_complete bucket index max shards: 11 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.544+0000 7f564e542800 20 Filter name: none 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.544+0000 7f54797fa640 20 reqs_thread_entry: start 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.544+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-10T04:53:24.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.544+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:94 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 33 ==== osd_op_reply(94 gc.27 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:95 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 34 ==== osd_op_reply(95 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:96 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 35 ==== osd_op_reply(96 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.545+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:97 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 36 ==== osd_op_reply(97 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:98 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 37 ==== osd_op_reply(98 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.546+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:99 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.547+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 38 ==== osd_op_reply(99 gc.27 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.547+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-10T04:53:24.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.547+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:100 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 26 ==== osd_op_reply(100 gc.28 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:101 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 27 ==== osd_op_reply(101 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:102 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 28 ==== osd_op_reply(102 gc.28 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.548+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:103 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 29 ==== osd_op_reply(103 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:104 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 30 ==== osd_op_reply(104 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.549+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:105 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.550+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 31 ==== osd_op_reply(105 gc.28 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.550+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-10T04:53:24.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.550+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:106 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 39 ==== osd_op_reply(106 gc.29 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:107 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 40 ==== osd_op_reply(107 gc.29 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:108 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 41 ==== osd_op_reply(108 gc.29 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.551+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:109 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 42 ==== osd_op_reply(109 gc.29 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:110 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 43 ==== osd_op_reply(110 gc.29 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.552+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:111 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.553+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 44 ==== osd_op_reply(111 gc.29 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.553+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-10T04:53:24.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.553+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:112 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 32 ==== osd_op_reply(112 gc.30 [call] v34'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:113 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 33 ==== osd_op_reply(113 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:114 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 34 ==== osd_op_reply(114 gc.30 [call out=24b] v0'0 uv77 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.554+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:115 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 35 ==== osd_op_reply(115 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:116 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 36 ==== osd_op_reply(116 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5644041040 con 0x556106499570 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.555+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:117 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.556+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 37 ==== osd_op_reply(117 gc.30 [call] v34'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.556+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-10T04:53:24.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.556+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:118 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 16 ==== osd_op_reply(118 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:119 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 17 ==== osd_op_reply(119 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:120 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 18 ==== osd_op_reply(120 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:121 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 19 ==== osd_op_reply(121 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:122 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 20 ==== osd_op_reply(122 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.557+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.558+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:123 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.558+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 21 ==== osd_op_reply(123 gc.31 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.558+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.558+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:124 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 45 ==== osd_op_reply(124 gc.0 [call] v34'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:125 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 46 ==== osd_op_reply(125 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:126 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 47 ==== osd_op_reply(126 gc.0 [call out=24b] v0'0 uv63 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.560+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:127 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 48 ==== osd_op_reply(127 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:128 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 49 ==== osd_op_reply(128 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.561+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:129 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.562+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 50 ==== osd_op_reply(129 gc.0 [call] v34'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.562+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-10T04:53:24.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.562+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:130 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 22 ==== osd_op_reply(130 gc.1 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:131 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 23 ==== osd_op_reply(131 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:132 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 24 ==== osd_op_reply(132 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.563+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:133 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 25 ==== osd_op_reply(133 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:134 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 26 ==== osd_op_reply(134 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.564+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:135 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x7f563c03a070 2024-09-10T04:53:24.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.565+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 27 ==== osd_op_reply(135 gc.1 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.565+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-10T04:53:24.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.565+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:136 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 22 ==== osd_op_reply(136 gc.2 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:137 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 23 ==== osd_op_reply(137 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:138 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 24 ==== osd_op_reply(138 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.566+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:139 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 25 ==== osd_op_reply(139 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:140 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 26 ==== osd_op_reply(140 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.567+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:141 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.568+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 27 ==== osd_op_reply(141 gc.2 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.568+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-10T04:53:24.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.568+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:142 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.569+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 38 ==== osd_op_reply(142 gc.3 [call] v34'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.569+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:143 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.569+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 39 ==== osd_op_reply(143 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.569+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.569+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:144 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 40 ==== osd_op_reply(144 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:145 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 41 ==== osd_op_reply(145 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:146 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 42 ==== osd_op_reply(146 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.570+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:147 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.571+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 43 ==== osd_op_reply(147 gc.3 [call] v34'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.571+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-10T04:53:24.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.571+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:148 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.572+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 51 ==== osd_op_reply(148 gc.4 [call] v34'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.572+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:149 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.572+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 52 ==== osd_op_reply(149 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.572+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.572+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:150 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 53 ==== osd_op_reply(150 gc.4 [call out=24b] v0'0 uv92 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:151 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 54 ==== osd_op_reply(151 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:152 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 55 ==== osd_op_reply(152 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.573+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:153 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.574+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 56 ==== osd_op_reply(153 gc.4 [call] v34'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.574+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.574+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:154 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 28 ==== osd_op_reply(154 gc.5 [call] v34'70 uv70 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:155 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 29 ==== osd_op_reply(155 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:156 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 30 ==== osd_op_reply(156 gc.5 [call out=24b] v0'0 uv70 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.575+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:157 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 31 ==== osd_op_reply(157 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:158 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 32 ==== osd_op_reply(158 gc.5 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.576+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:159 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.577+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 33 ==== osd_op_reply(159 gc.5 [call] v34'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.577+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-10T04:53:24.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.577+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:160 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.578+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 57 ==== osd_op_reply(160 gc.6 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.578+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:161 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.578+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 58 ==== osd_op_reply(161 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.578+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.578+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:162 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 59 ==== osd_op_reply(162 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:163 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 60 ==== osd_op_reply(163 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:164 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 61 ==== osd_op_reply(164 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.579+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:165 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.580+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 62 ==== osd_op_reply(165 gc.6 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.580+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-10T04:53:24.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.580+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:166 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.581+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 44 ==== osd_op_reply(166 gc.7 [call] v34'67 uv67 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.581+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:167 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.581+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 45 ==== osd_op_reply(167 gc.7 [call out=15b] v0'0 uv67 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.581+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.581+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:168 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 46 ==== osd_op_reply(168 gc.7 [call out=24b] v0'0 uv67 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:169 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 47 ==== osd_op_reply(169 gc.7 [call out=15b] v0'0 uv67 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:170 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 48 ==== osd_op_reply(170 gc.7 [call out=15b] v0'0 uv67 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.582+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:171 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.583+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 49 ==== osd_op_reply(171 gc.7 [call] v34'68 uv68 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.583+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.583+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:172 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 63 ==== osd_op_reply(172 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:173 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 64 ==== osd_op_reply(173 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:174 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 65 ==== osd_op_reply(174 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.584+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:175 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 66 ==== osd_op_reply(175 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:176 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 67 ==== osd_op_reply(176 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.585+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:177 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.586+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 68 ==== osd_op_reply(177 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.586+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.586+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:178 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 69 ==== osd_op_reply(178 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:179 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 70 ==== osd_op_reply(179 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:180 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 71 ==== osd_op_reply(180 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.587+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:181 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 72 ==== osd_op_reply(181 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:182 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 73 ==== osd_op_reply(182 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.588+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:183 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.589+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 74 ==== osd_op_reply(183 gc.9 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.589+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.589+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:184 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 75 ==== osd_op_reply(184 gc.10 [call] v34'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:185 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 76 ==== osd_op_reply(185 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:186 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 77 ==== osd_op_reply(186 gc.10 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:187 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 78 ==== osd_op_reply(187 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.590+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:188 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.591+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 79 ==== osd_op_reply(188 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.591+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.591+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:189 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.592+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 80 ==== osd_op_reply(189 gc.10 [call] v34'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.592+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-10T04:53:24.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.592+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:190 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 34 ==== osd_op_reply(190 gc.11 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:191 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 35 ==== osd_op_reply(191 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:192 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x5561064a2a30 2024-09-10T04:53:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 36 ==== osd_op_reply(192 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:193 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 37 ==== osd_op_reply(193 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.593+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:194 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.594+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 38 ==== osd_op_reply(194 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.594+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.594+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:195 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.595+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 39 ==== osd_op_reply(195 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.595+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-10T04:53:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.595+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:196 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 81 ==== osd_op_reply(196 gc.12 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:197 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 82 ==== osd_op_reply(197 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:198 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 83 ==== osd_op_reply(198 gc.12 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:199 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 84 ==== osd_op_reply(199 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.596+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:200 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.597+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 85 ==== osd_op_reply(200 gc.12 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.597+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.597+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:201 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.598+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 86 ==== osd_op_reply(201 gc.12 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.598+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.598+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:202 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 50 ==== osd_op_reply(202 gc.13 [call] v34'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:203 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 51 ==== osd_op_reply(203 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:204 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 52 ==== osd_op_reply(204 gc.13 [call out=24b] v0'0 uv79 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.599+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:205 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 53 ==== osd_op_reply(205 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:206 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 54 ==== osd_op_reply(206 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.600+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:207 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.601+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 55 ==== osd_op_reply(207 gc.13 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.601+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.601+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:208 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 56 ==== osd_op_reply(208 gc.14 [call] v34'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:209 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 57 ==== osd_op_reply(209 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:210 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x556106499570 2024-09-10T04:53:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 58 ==== osd_op_reply(210 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.602+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:211 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 59 ==== osd_op_reply(211 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:212 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 60 ==== osd_op_reply(212 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.603+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:213 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.604+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 61 ==== osd_op_reply(213 gc.14 [call] v34'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.604+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-10T04:53:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.604+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:214 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 87 ==== osd_op_reply(214 gc.15 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:215 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 88 ==== osd_op_reply(215 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:216 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 89 ==== osd_op_reply(216 gc.15 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:217 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 90 ==== osd_op_reply(217 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.605+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:218 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.606+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 91 ==== osd_op_reply(218 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.606+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.606+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:219 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.607+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 92 ==== osd_op_reply(219 gc.15 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.607+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.607+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:220 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.607+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 93 ==== osd_op_reply(220 gc.16 [call] v34'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.607+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:221 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 94 ==== osd_op_reply(221 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:222 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 95 ==== osd_op_reply(222 gc.16 [call out=24b] v0'0 uv96 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:223 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 96 ==== osd_op_reply(223 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:224 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 97 ==== osd_op_reply(224 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.608+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:225 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.609+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 98 ==== osd_op_reply(225 gc.16 [call] v34'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.609+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.609+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:226 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.610+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 40 ==== osd_op_reply(226 gc.17 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.610+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:227 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 41 ==== osd_op_reply(227 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:228 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 42 ==== osd_op_reply(228 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:229 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 43 ==== osd_op_reply(229 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:230 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 44 ==== osd_op_reply(230 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.611+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:231 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x5561064a2a30 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.612+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 45 ==== osd_op_reply(231 gc.17 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.612+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.612+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:232 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.613+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 99 ==== osd_op_reply(232 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.613+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:233 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e77f0 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.613+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 100 ==== osd_op_reply(233 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.613+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.613+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:234 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 101 ==== osd_op_reply(234 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:235 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 102 ==== osd_op_reply(235 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:236 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064e67e0 con 0x55610649d9f0 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 103 ==== osd_op_reply(236 gc.18 [call out=1715b] v0'0 uv41 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 20 garbage collection: RGWGC::process iterating over entry tag='df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.4344011977654610732', time=2024-09-10T04:53:32.634892+0000, chain.objs.size()=7 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__1 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:237 3.33s0 3:ccbd1a86:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064e5b20 con 0x5561064a2a30 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__2 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:238 3.26s0 3:6589970b:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064eaaf0 con 0x7f563c03a070 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__3 2024-09-10T04:53:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:239 3.3es0 3:7d7468a2:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ed460 con 0x556106499570 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__4 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:240 3.17s0 3:e86f30c1:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064efcd0 con 0x556106499570 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__5 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:241 3.2as0 3:565f3ee2:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f2660 con 0x55610649d9f0 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__6 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:242 3.1cs0 3:3b246120:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f4fc0 con 0x556106499570 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__7 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.614+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:243 3.33s0 3:ced30d9c:::df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x5561064a2a30 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.617+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 28 ==== osd_op_reply(238 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.617+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 104 ==== osd_op_reply(241 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.620+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 62 ==== osd_op_reply(239 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__3 [call] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.620+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 46 ==== osd_op_reply(237 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__1 [call] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.620+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 63 ==== osd_op_reply(242 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.620+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 64 ==== osd_op_reply(240 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__4 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.622+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 47 ==== osd_op_reply(243 df93e6a2-96e2-43a0-9951-5c4d01bc8580.4230.11__shadow_.wbDFwGN9PsdzIKmj7PyRNgQSyv0I1A__7 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.622+0000 7f564e542800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T04:53:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.622+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:244 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.628+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 105 ==== osd_op_reply(244 gc.18 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.628+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:245 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.631+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 106 ==== osd_op_reply(245 gc.18 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.631+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-10T04:53:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.631+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:246 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 65 ==== osd_op_reply(246 gc.19 [call] v34'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:247 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 66 ==== osd_op_reply(247 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:248 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 67 ==== osd_op_reply(248 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:249 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 68 ==== osd_op_reply(249 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.632+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:250 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.633+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 69 ==== osd_op_reply(250 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.633+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.633+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:251 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x556106499570 2024-09-10T04:53:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.634+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 70 ==== osd_op_reply(251 gc.19 [call] v34'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.634+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-10T04:53:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.634+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:252 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 107 ==== osd_op_reply(252 gc.20 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:253 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 108 ==== osd_op_reply(253 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:254 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 109 ==== osd_op_reply(254 gc.20 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:255 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.635+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 110 ==== osd_op_reply(255 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.636+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.636+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:256 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.636+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 111 ==== osd_op_reply(256 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.636+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.636+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:257 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.637+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 112 ==== osd_op_reply(257 gc.20 [call] v34'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.637+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-10T04:53:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.637+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:258 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 113 ==== osd_op_reply(258 gc.21 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:259 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 114 ==== osd_op_reply(259 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:260 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 115 ==== osd_op_reply(260 gc.21 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.638+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:261 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 116 ==== osd_op_reply(261 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:262 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 117 ==== osd_op_reply(262 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.639+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:263 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.640+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 118 ==== osd_op_reply(263 gc.21 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.640+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-10T04:53:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.640+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:264 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064f7a80 con 0x5561064a2a30 2024-09-10T04:53:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 48 ==== osd_op_reply(264 gc.22 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:265 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064f73d0 con 0x5561064a2a30 2024-09-10T04:53:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 49 ==== osd_op_reply(265 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:266 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 50 ==== osd_op_reply(266 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:267 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 51 ==== osd_op_reply(267 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.641+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:268 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.642+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 52 ==== osd_op_reply(268 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.642+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.642+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:269 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.643+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 53 ==== osd_op_reply(269 gc.22 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.643+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-10T04:53:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.643+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:270 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x55610649d9f0 2024-09-10T04:53:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 119 ==== osd_op_reply(270 gc.23 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:271 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x55610649d9f0 2024-09-10T04:53:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 120 ==== osd_op_reply(271 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:272 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 121 ==== osd_op_reply(272 gc.23 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:273 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 122 ==== osd_op_reply(273 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.644+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:274 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.645+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 123 ==== osd_op_reply(274 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.645+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.645+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:275 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.646+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 124 ==== osd_op_reply(275 gc.23 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.646+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-10T04:53:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.646+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:276 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 54 ==== osd_op_reply(276 gc.24 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:277 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 55 ==== osd_op_reply(277 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:278 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 56 ==== osd_op_reply(278 gc.24 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:279 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 57 ==== osd_op_reply(279 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.647+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:280 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.648+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 58 ==== osd_op_reply(280 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.648+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.648+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:281 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.649+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 59 ==== osd_op_reply(281 gc.24 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.649+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-10T04:53:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.649+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:282 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 60 ==== osd_op_reply(282 gc.25 [call] v34'72 uv72 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:283 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 61 ==== osd_op_reply(283 gc.25 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:284 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 62 ==== osd_op_reply(284 gc.25 [call out=24b] v0'0 uv72 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:285 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 63 ==== osd_op_reply(285 gc.25 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:286 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.650+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 64 ==== osd_op_reply(286 gc.25 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.651+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.651+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:287 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.651+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 65 ==== osd_op_reply(287 gc.25 [call] v34'73 uv73 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.651+0000 7f564e542800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.651+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:288 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 66 ==== osd_op_reply(288 gc.26 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:289 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 67 ==== osd_op_reply(289 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:290 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 68 ==== osd_op_reply(290 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:291 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 69 ==== osd_op_reply(291 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T04:53:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.653+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:292 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5561064ebf00 con 0x5561064a2a30 2024-09-10T04:53:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.654+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 70 ==== osd_op_reply(292 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.654+0000 7f564e542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T04:53:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.654+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:293 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ecf10 con 0x5561064a2a30 2024-09-10T04:53:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.655+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 71 ==== osd_op_reply(293 gc.26 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.656+0000 7f5500fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T04:53:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.656+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93875205756832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064b7e70 con 0x556106499570 2024-09-10T04:53:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.657+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 71 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93875205756832] v34'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.657+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93875205730528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ad7a0 con 0x55610649d9f0 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.658+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 125 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93875205730528] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.658+0000 7f564e542800 20 remove_watcher() i=0 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.658+0000 7f564e542800 2 removed watcher, disabling cache 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.658+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93875205734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ad7a0 con 0x556106499570 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.659+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.1 v2:172.21.15.145:6808/819540050 72 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93875205734880] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564404e040 con 0x556106499570 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.659+0000 7f564e542800 20 remove_watcher() i=1 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.659+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93875205738656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a81e0 con 0x55610649d9f0 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.660+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 126 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93875205738656] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.660+0000 7f564e542800 20 remove_watcher() i=2 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.660+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93875205741376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ad7a0 con 0x7f563c03a070 2024-09-10T04:53:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.661+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 29 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93875205741376] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.661+0000 7f564e542800 20 remove_watcher() i=3 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.661+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93875205745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a90a0 con 0x55610649d9f0 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.662+0000 7f564a286640 1 -- 172.21.15.145:0/2619604768 <== osd.0 v2:172.21.15.98:6800/733739603 127 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93875205745344] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f563c075020 con 0x55610649d9f0 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.662+0000 7f564e542800 20 remove_watcher() i=4 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.662+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93875205747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a81e0 con 0x5561064a2a30 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.663+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 72 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93875205747680] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.663+0000 7f564e542800 20 remove_watcher() i=5 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.663+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93875205751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064ad7a0 con 0x5561064a2a30 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.664+0000 7f5641a85640 1 -- 172.21.15.145:0/2619604768 <== osd.3 v2:172.21.15.145:6800/4228232102 73 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93875205751472] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5634057030 con 0x5561064a2a30 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.664+0000 7f564e542800 20 remove_watcher() i=6 2024-09-10T04:53:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.664+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93875205755168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5561064a90a0 con 0x7f563c03a070 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.665+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 <== osd.2 v2:172.21.15.145:6816/1789112018 30 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93875205755168] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564404e040 con 0x7f563c03a070 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.665+0000 7f564e542800 20 remove_watcher() i=7 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55610649d9f0 msgr2=0x55610649fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x55610649d9f0 0x55610649fde0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106499570 msgr2=0x55610649ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106499570 0x55610649ba30 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f563c03a070 msgr2=0x7f563c0318d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f563c03a070 0x7f563c0318d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561064a2a30 msgr2=0x5561064a4e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x5561064a2a30 0x5561064a4e80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f551403c730 msgr2=0x7f551403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f551403c730 0x7f551403ebf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5634045be0 tx=0x7f563406d040 comp rx=0 tx=0).stop 2024-09-10T04:53:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 msgr2=0x55610648e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564aa87640 1 -- 172.21.15.145:0/2619604768 reap_dead start 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f563c01c020 tx=0x7f563c005f20 comp rx=0 tx=0).stop 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 shutdown_connections 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/2619604768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556106486ca0 0x55610648e100 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 >> 172.21.15.145:0/2619604768 conn(0x5561064830a0 msgr2=0x5561064812b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 shutdown_connections 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/2619604768 wait complete. 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 msgr2=0x7f552403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 0x7f552403eba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55610645e150 tx=0x7f5634005ac0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 msgr2=0x55610647a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f563c017ce0 tx=0x7f563c019e20 comp rx=0 tx=0).stop 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 shutdown_connections 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f552403c6e0 0x7f552403eba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 --2- 172.21.15.145:0/3193720202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55610647a3a0 0x55610647a7c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 >> 172.21.15.145:0/3193720202 conn(0x55610646e750 msgr2=0x55610646eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 shutdown_connections 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.666+0000 7f564e542800 1 -- 172.21.15.145:0/3193720202 wait complete. 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556106464660 msgr2=0x556106466b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x556106464660 0x556106466b20 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106362fd0 msgr2=0x556106463870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x556106362fd0 0x556106463870 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556106469ef0 msgr2=0x55610646c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x556106469ef0 0x55610646c2e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f553003c730 msgr2=0x7f553003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f553003c730 0x7f553003ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5634057000 tx=0x7f5634052000 comp rx=0 tx=0).stop 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 msgr2=0x55610645c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 --2- 172.21.15.145:0/3413013227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561063614b0 0x55610645c220 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x556106455800 tx=0x7f563c000ed0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564aa87640 1 -- 172.21.15.145:0/3413013227 reap_dead start 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 shutdown_connections 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 >> 172.21.15.145:0/3413013227 conn(0x55610635d1c0 msgr2=0x556106455b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 shutdown_connections 2024-09-10T04:53:24.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-10T04:53:24.667+0000 7f564e542800 1 -- 172.21.15.145:0/3413013227 wait complete. 2024-09-10T04:53:24.679 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T04:53:24.688 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T04:53:24.689 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:53:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8ce27ab640 1 Processor -- start 2024-09-10T04:53:24.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8ce27ab640 1 -- start start 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8ce27ab640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cdc129d80 0x7f8cdc12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8ce27ab640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cdc06dc00 con 0x7f8cdc12a6a0 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8ce27ab640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f8cdc1299c0 con 0x7f8cdc129d80 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8cdbfff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cdc129d80 0x7f8cdc12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8cdb7fe640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8cdc12a6a0 0x7f8cdc110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46096/0 (socket says 172.21.15.98:46096) 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.785+0000 7f8cdb7fe640 1 -- 172.21.15.98:0/1890168764 learned_addr learned my addr 172.21.15.98:0/1890168764 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdbfff640 1 -- 172.21.15.98:0/1890168764 >> v1:172.21.15.98:6789/0 conn(0x7f8cdc12a6a0 legacy=0x7f8cdc110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdbfff640 1 -- 172.21.15.98:0/1890168764 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc114d20 con 0x7f8cdc129d80 2024-09-10T04:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdbfff640 1 --2- 172.21.15.98:0/1890168764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc12a160 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009720 tx=0x7f8ccc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f3d3c8c7dd276d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdaffd640 1 -- 172.21.15.98:0/1890168764 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc037070 con 0x7f8cdc129d80 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdaffd640 1 -- 172.21.15.98:0/1890168764 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc02ad90 con 0x7f8cdc129d80 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.786+0000 7f8cdaffd640 1 -- 172.21.15.98:0/1890168764 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc032590 con 0x7f8cdc129d80 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 -- 172.21.15.98:0/1890168764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 msgr2=0x7f8cdc12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/1890168764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc12a160 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009720 tx=0x7f8ccc02a110 comp rx=0 tx=0).stop 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 -- 172.21.15.98:0/1890168764 shutdown_connections 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/1890168764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc12a160 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 -- 172.21.15.98:0/1890168764 >> 172.21.15.98:0/1890168764 conn(0x7f8cdc070850 msgr2=0x7f8cdc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 -- 172.21.15.98:0/1890168764 shutdown_connections 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.787+0000 7f8ce27ab640 1 -- 172.21.15.98:0/1890168764 wait complete. 2024-09-10T04:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.788+0000 7f8ce27ab640 1 Processor -- start 2024-09-10T04:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.788+0000 7f8ce27ab640 1 -- start start 2024-09-10T04:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.788+0000 7f8ce27ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.788+0000 7f8ce27ab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc114940 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.788+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50832/0 (socket says 172.21.15.98:50832) 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cdbfff640 1 -- 172.21.15.98:0/744603916 learned_addr learned my addr 172.21.15.98:0/744603916 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cdbfff640 1 -- 172.21.15.98:0/744603916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc11c890 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cdbfff640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009840 tx=0x7f8ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc041020 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc03d550 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc037040 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc11dca0 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.789+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc11b5b0 con 0x7f8cdc129d80 2024-09-10T04:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.790+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8ccc044020 con 0x7f8cdc129d80 2024-09-10T04:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.790+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cdc1119e0 con 0x7f8cdc129d80 2024-09-10T04:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.790+0000 7f8cd8ff9640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 0x7f8cc8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.790+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f8ccc073480 con 0x7f8cdc129d80 2024-09-10T04:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.791+0000 7f8cdb7fe640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 0x7f8cc8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.791+0000 7f8cdb7fe640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 0x7f8cc8040350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007fd0 tx=0x7f8cd0007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:24.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.795+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8ccc04b030 con 0x7f8cdc129d80 2024-09-10T04:53:24.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.966+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cdc068da0 con 0x7f8cc803de90 2024-09-10T04:53:24.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.977+0000 7f8cd8ff9640 1 -- 172.21.15.98:0/744603916 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666095 (secure 0 0 0) 0x7f8cdc068da0 con 0x7f8cc803de90 2024-09-10T04:53:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:24.992 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 msgr2=0x7f8cc8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 0x7f8cc8040350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007fd0 tx=0x7f8cd0007aa0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 msgr2=0x7f8cdc11b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009840 tx=0x7f8ccc0046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 shutdown_connections 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cc803de90 0x7f8cc8040350 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 --2- 172.21.15.98:0/744603916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cdc129d80 0x7f8cdc11b070 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.981+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 >> 172.21.15.98:0/744603916 conn(0x7f8cdc070850 msgr2=0x7f8cdc126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:24.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.982+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 shutdown_connections 2024-09-10T04:53:24.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:24.982+0000 7f8ce27ab640 1 -- 172.21.15.98:0/744603916 wait complete. 2024-09-10T04:53:24.996 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-10T04:53:23.253371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003757"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.213647+0000","last_change":"2024-09-10T04:50:08.836558+0000","last_active":"2024-09-10T04:50:51.213647+0000","last_peered":"2024-09-10T04:50:51.213647+0000","last_clean":"2024-09-10T04:50:51.213647+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:50:51.213647+0000","last_undegraded":"2024-09-10T04:50:51.213647+0000","last_fullsized":"2024-09-10T04:50:51.213647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:07.611919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874886+0000","last_change":"2024-09-10T04:50:10.827523+0000","last_active":"2024-09-10T04:50:48.874886+0000","last_peered":"2024-09-10T04:50:48.874886+0000","last_clean":"2024-09-10T04:50:48.874886+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:50:48.874886+0000","last_undegraded":"2024-09-10T04:50:48.874886+0000","last_fullsized":"2024-09-10T04:50:48.874886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:56.905163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:13.223901+0000","last_change":"2024-09-10T04:50:08.848586+0000","last_active":"2024-09-10T04:52:13.223901+0000","last_peered":"2024-09-10T04:52:13.223901+0000","last_clean":"2024-09-10T04:52:13.223901+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:52:13.223901+0000","last_undegraded":"2024-09-10T04:52:13.223901+0000","last_fullsized":"2024-09-10T04:52:13.223901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671414+0000","last_change":"2024-09-10T04:50:10.819187+0000","last_active":"2024-09-10T04:53:17.671414+0000","last_peered":"2024-09-10T04:53:17.671414+0000","last_clean":"2024-09-10T04:53:17.671414+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:53:17.671414+0000","last_undegraded":"2024-09-10T04:53:17.671414+0000","last_fullsized":"2024-09-10T04:53:17.671414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:41.828061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881449+0000","last_change":"2024-09-10T04:50:08.839328+0000","last_active":"2024-09-10T04:50:48.881449+0000","last_peered":"2024-09-10T04:50:48.881449+0000","last_clean":"2024-09-10T04:50:48.881449+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:50:48.881449+0000","last_undegraded":"2024-09-10T04:50:48.881449+0000","last_fullsized":"2024-09-10T04:50:48.881449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:21.710828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732731+0000","last_change":"2024-09-10T04:50:48.879830+0000","last_active":"2024-09-10T04:51:33.732731+0000","last_peered":"2024-09-10T04:51:33.732731+0000","last_clean":"2024-09-10T04:51:33.732731+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:51:33.732731+0000","last_undegraded":"2024-09-10T04:51:33.732731+0000","last_fullsized":"2024-09-10T04:51:33.732731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:59.179205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871764+0000","last_change":"2024-09-10T04:50:08.841951+0000","last_active":"2024-09-10T04:50:48.871764+0000","last_peered":"2024-09-10T04:50:48.871764+0000","last_clean":"2024-09-10T04:50:48.871764+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:50:48.871764+0000","last_undegraded":"2024-09-10T04:50:48.871764+0000","last_fullsized":"2024-09-10T04:50:48.871764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:00.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.201672+0000","last_change":"2024-09-10T04:50:48.879883+0000","last_active":"2024-09-10T04:52:14.201672+0000","last_peered":"2024-09-10T04:52:14.201672+0000","last_clean":"2024-09-10T04:52:14.201672+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:52:14.201672+0000","last_undegraded":"2024-09-10T04:52:14.201672+0000","last_fullsized":"2024-09-10T04:52:14.201672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:08.771696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875513+0000","last_change":"2024-09-10T04:50:08.836256+0000","last_active":"2024-09-10T04:50:48.875513+0000","last_peered":"2024-09-10T04:50:48.875513+0000","last_clean":"2024-09-10T04:50:48.875513+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:50:48.875513+0000","last_undegraded":"2024-09-10T04:50:48.875513+0000","last_fullsized":"2024-09-10T04:50:48.875513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:21.447084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702019+0000","last_change":"2024-09-10T04:50:10.823009+0000","last_active":"2024-09-10T04:50:51.702019+0000","last_peered":"2024-09-10T04:50:51.702019+0000","last_clean":"2024-09-10T04:50:51.702019+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:50:51.702019+0000","last_undegraded":"2024-09-10T04:50:51.702019+0000","last_fullsized":"2024-09-10T04:50:51.702019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.897024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875751+0000","last_change":"2024-09-10T04:50:08.837428+0000","last_active":"2024-09-10T04:50:48.875751+0000","last_peered":"2024-09-10T04:50:48.875751+0000","last_clean":"2024-09-10T04:50:48.875751+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:50:48.875751+0000","last_undegraded":"2024-09-10T04:50:48.875751+0000","last_fullsized":"2024-09-10T04:50:48.875751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:13.131981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671731+0000","last_change":"2024-09-10T04:50:10.832647+0000","last_active":"2024-09-10T04:53:17.671731+0000","last_peered":"2024-09-10T04:53:17.671731+0000","last_clean":"2024-09-10T04:53:17.671731+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:53:17.671731+0000","last_undegraded":"2024-09-10T04:53:17.671731+0000","last_fullsized":"2024-09-10T04:53:17.671731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:30.079691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.878085+0000","last_change":"2024-09-10T04:50:08.834170+0000","last_active":"2024-09-10T04:53:17.878085+0000","last_peered":"2024-09-10T04:53:17.878085+0000","last_clean":"2024-09-10T04:53:17.878085+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:17.878085+0000","last_undegraded":"2024-09-10T04:53:17.878085+0000","last_fullsized":"2024-09-10T04:53:17.878085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:23.894994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732327+0000","last_change":"2024-09-10T04:50:10.825623+0000","last_active":"2024-09-10T04:51:33.732327+0000","last_peered":"2024-09-10T04:51:33.732327+0000","last_clean":"2024-09-10T04:51:33.732327+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:51:33.732327+0000","last_undegraded":"2024-09-10T04:51:33.732327+0000","last_fullsized":"2024-09-10T04:51:33.732327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.611215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.881294+0000","last_change":"2024-09-10T04:50:08.842334+0000","last_active":"2024-09-10T04:53:17.881294+0000","last_peered":"2024-09-10T04:53:17.881294+0000","last_clean":"2024-09-10T04:53:17.881294+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:17.881294+0000","last_undegraded":"2024-09-10T04:53:17.881294+0000","last_fullsized":"2024-09-10T04:53:17.881294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:03.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.022533+0000","last_change":"2024-09-10T04:50:10.831636+0000","last_active":"2024-09-10T04:53:18.022533+0000","last_peered":"2024-09-10T04:53:18.022533+0000","last_clean":"2024-09-10T04:53:18.022533+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:18.022533+0000","last_undegraded":"2024-09-10T04:53:18.022533+0000","last_fullsized":"2024-09-10T04:53:18.022533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:51.773869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949263+0000","last_change":"2024-09-10T04:50:10.827812+0000","last_active":"2024-09-10T04:53:17.949263+0000","last_peered":"2024-09-10T04:53:17.949263+0000","last_clean":"2024-09-10T04:53:17.949263+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:17.949263+0000","last_undegraded":"2024-09-10T04:53:17.949263+0000","last_fullsized":"2024-09-10T04:53:17.949263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.617778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879684+0000","last_change":"2024-09-10T04:50:08.849290+0000","last_active":"2024-09-10T04:50:48.879684+0000","last_peered":"2024-09-10T04:50:48.879684+0000","last_clean":"2024-09-10T04:50:48.879684+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:50:48.879684+0000","last_undegraded":"2024-09-10T04:50:48.879684+0000","last_fullsized":"2024-09-10T04:50:48.879684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:01.331992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.230916+0000","last_change":"2024-09-10T04:50:10.825696+0000","last_active":"2024-09-10T04:50:51.230916+0000","last_peered":"2024-09-10T04:50:51.230916+0000","last_clean":"2024-09-10T04:50:51.230916+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:50:51.230916+0000","last_undegraded":"2024-09-10T04:50:51.230916+0000","last_fullsized":"2024-09-10T04:50:51.230916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:21.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.249384+0000","last_change":"2024-09-10T04:50:08.855614+0000","last_active":"2024-09-10T04:52:17.249384+0000","last_peered":"2024-09-10T04:52:17.249384+0000","last_clean":"2024-09-10T04:52:17.249384+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:52:17.249384+0000","last_undegraded":"2024-09-10T04:52:17.249384+0000","last_fullsized":"2024-09-10T04:52:17.249384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:52.782524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.219735+0000","last_change":"2024-09-10T04:50:08.838188+0000","last_active":"2024-09-10T04:50:51.219735+0000","last_peered":"2024-09-10T04:50:51.219735+0000","last_clean":"2024-09-10T04:50:51.219735+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:50:51.219735+0000","last_undegraded":"2024-09-10T04:50:51.219735+0000","last_fullsized":"2024-09-10T04:50:51.219735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:02.357191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874666+0000","last_change":"2024-09-10T04:50:10.831149+0000","last_active":"2024-09-10T04:50:48.874666+0000","last_peered":"2024-09-10T04:50:48.874666+0000","last_clean":"2024-09-10T04:50:48.874666+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:50:48.874666+0000","last_undegraded":"2024-09-10T04:50:48.874666+0000","last_fullsized":"2024-09-10T04:50:48.874666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.512694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875939+0000","last_change":"2024-09-10T04:50:08.836996+0000","last_active":"2024-09-10T04:50:48.875939+0000","last_peered":"2024-09-10T04:50:48.875939+0000","last_clean":"2024-09-10T04:50:48.875939+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:50:48.875939+0000","last_undegraded":"2024-09-10T04:50:48.875939+0000","last_fullsized":"2024-09-10T04:50:48.875939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:37.196606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732464+0000","last_change":"2024-09-10T04:50:10.824023+0000","last_active":"2024-09-10T04:51:33.732464+0000","last_peered":"2024-09-10T04:51:33.732464+0000","last_clean":"2024-09-10T04:51:33.732464+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:51:33.732464+0000","last_undegraded":"2024-09-10T04:51:33.732464+0000","last_fullsized":"2024-09-10T04:51:33.732464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.559546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.545371+0000","last_change":"2024-09-10T04:50:08.846235+0000","last_active":"2024-09-10T04:53:17.545371+0000","last_peered":"2024-09-10T04:53:17.545371+0000","last_clean":"2024-09-10T04:53:17.545371+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:17.545371+0000","last_undegraded":"2024-09-10T04:53:17.545371+0000","last_fullsized":"2024-09-10T04:53:17.545371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:03.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954024+0000","last_change":"2024-09-10T04:50:10.831903+0000","last_active":"2024-09-10T04:53:17.954024+0000","last_peered":"2024-09-10T04:53:17.954024+0000","last_clean":"2024-09-10T04:53:17.954024+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:17.954024+0000","last_undegraded":"2024-09-10T04:53:17.954024+0000","last_fullsized":"2024-09-10T04:53:17.954024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:04.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879338+0000","last_change":"2024-09-10T04:50:08.838274+0000","last_active":"2024-09-10T04:50:48.879338+0000","last_peered":"2024-09-10T04:50:48.879338+0000","last_clean":"2024-09-10T04:50:48.879338+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:50:48.879338+0000","last_undegraded":"2024-09-10T04:50:48.879338+0000","last_fullsized":"2024-09-10T04:50:48.879338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:40.373059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.763257+0000","last_change":"2024-09-10T04:50:10.827657+0000","last_active":"2024-09-10T04:53:17.763257+0000","last_peered":"2024-09-10T04:53:17.763257+0000","last_clean":"2024-09-10T04:53:17.763257+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:17.763257+0000","last_undegraded":"2024-09-10T04:53:17.763257+0000","last_fullsized":"2024-09-10T04:53:17.763257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:10.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.722381+0000","last_change":"2024-09-10T04:50:08.845982+0000","last_active":"2024-09-10T04:51:33.722381+0000","last_peered":"2024-09-10T04:51:33.722381+0000","last_clean":"2024-09-10T04:51:33.722381+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:51:33.722381+0000","last_undegraded":"2024-09-10T04:51:33.722381+0000","last_fullsized":"2024-09-10T04:51:33.722381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:28.921046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.840707+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:52:15.840707+0000","last_peered":"2024-09-10T04:52:15.840707+0000","last_clean":"2024-09-10T04:52:15.840707+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:52:15.840707+0000","last_undegraded":"2024-09-10T04:52:15.840707+0000","last_fullsized":"2024-09-10T04:52:15.840707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228840+0000","last_change":"2024-09-10T04:50:10.818723+0000","last_active":"2024-09-10T04:52:38.228840+0000","last_peered":"2024-09-10T04:52:38.228840+0000","last_clean":"2024-09-10T04:52:38.228840+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:52:38.228840+0000","last_undegraded":"2024-09-10T04:52:38.228840+0000","last_fullsized":"2024-09-10T04:52:38.228840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:32.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.891329+0000","last_change":"2024-09-10T04:50:08.842024+0000","last_active":"2024-09-10T04:53:17.891329+0000","last_peered":"2024-09-10T04:53:17.891329+0000","last_clean":"2024-09-10T04:53:17.891329+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:17.891329+0000","last_undegraded":"2024-09-10T04:53:17.891329+0000","last_fullsized":"2024-09-10T04:53:17.891329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:36.641361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203915+0000","last_change":"2024-09-10T04:50:10.823064+0000","last_active":"2024-09-10T04:52:14.203915+0000","last_peered":"2024-09-10T04:52:14.203915+0000","last_clean":"2024-09-10T04:52:14.203915+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:52:14.203915+0000","last_undegraded":"2024-09-10T04:52:14.203915+0000","last_fullsized":"2024-09-10T04:52:14.203915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:26.449576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874566+0000","last_change":"2024-09-10T04:50:08.837572+0000","last_active":"2024-09-10T04:50:48.874566+0000","last_peered":"2024-09-10T04:50:48.874566+0000","last_clean":"2024-09-10T04:50:48.874566+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:50:48.874566+0000","last_undegraded":"2024-09-10T04:50:48.874566+0000","last_fullsized":"2024-09-10T04:50:48.874566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:06.915826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871643+0000","last_change":"2024-09-10T04:50:14.831883+0000","last_active":"2024-09-10T04:50:48.871643+0000","last_peered":"2024-09-10T04:50:48.871643+0000","last_clean":"2024-09-10T04:50:48.871643+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:50:48.871643+0000","last_undegraded":"2024-09-10T04:50:48.871643+0000","last_fullsized":"2024-09-10T04:50:48.871643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:08.755472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910428+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:17.910428+0000","last_peered":"2024-09-10T04:53:17.910428+0000","last_clean":"2024-09-10T04:53:17.910428+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:17.910428+0000","last_undegraded":"2024-09-10T04:53:17.910428+0000","last_fullsized":"2024-09-10T04:53:17.910428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898545+0000","last_change":"2024-09-10T04:50:10.825749+0000","last_active":"2024-09-10T04:53:17.898545+0000","last_peered":"2024-09-10T04:53:17.898545+0000","last_clean":"2024-09-10T04:53:17.898545+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:17.898545+0000","last_undegraded":"2024-09-10T04:53:17.898545+0000","last_fullsized":"2024-09-10T04:53:17.898545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:53.153695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874420+0000","last_change":"2024-09-10T04:50:08.828799+0000","last_active":"2024-09-10T04:50:48.874420+0000","last_peered":"2024-09-10T04:50:48.874420+0000","last_clean":"2024-09-10T04:50:48.874420+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:50:48.874420+0000","last_undegraded":"2024-09-10T04:50:48.874420+0000","last_fullsized":"2024-09-10T04:50:48.874420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:51.598705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.835230+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:52:15.835230+0000","last_peered":"2024-09-10T04:52:15.835230+0000","last_clean":"2024-09-10T04:52:15.835230+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:52:15.835230+0000","last_undegraded":"2024-09-10T04:52:15.835230+0000","last_fullsized":"2024-09-10T04:52:15.835230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.073926+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:18.073926+0000","last_peered":"2024-09-10T04:53:18.073926+0000","last_clean":"2024-09-10T04:53:18.073926+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:18.073926+0000","last_undegraded":"2024-09-10T04:53:18.073926+0000","last_fullsized":"2024-09-10T04:53:18.073926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974101+0000","last_change":"2024-09-10T04:50:48.878932+0000","last_active":"2024-09-10T04:53:17.974101+0000","last_peered":"2024-09-10T04:53:17.974101+0000","last_clean":"2024-09-10T04:53:17.974101+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:17.974101+0000","last_undegraded":"2024-09-10T04:53:17.974101+0000","last_fullsized":"2024-09-10T04:53:17.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.903742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877328+0000","last_change":"2024-09-10T04:50:08.829013+0000","last_active":"2024-09-10T04:50:48.877328+0000","last_peered":"2024-09-10T04:50:48.877328+0000","last_clean":"2024-09-10T04:50:48.877328+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:50:48.877328+0000","last_undegraded":"2024-09-10T04:50:48.877328+0000","last_fullsized":"2024-09-10T04:50:48.877328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:03.087024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874784+0000","last_change":"2024-09-10T04:50:12.833519+0000","last_active":"2024-09-10T04:50:48.874784+0000","last_peered":"2024-09-10T04:50:48.874784+0000","last_clean":"2024-09-10T04:50:48.874784+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:50:48.874784+0000","last_undegraded":"2024-09-10T04:50:48.874784+0000","last_fullsized":"2024-09-10T04:50:48.874784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:32.252245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.844592+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:52:15.844592+0000","last_peered":"2024-09-10T04:52:15.844592+0000","last_clean":"2024-09-10T04:52:15.844592+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:52:15.844592+0000","last_undegraded":"2024-09-10T04:52:15.844592+0000","last_fullsized":"2024-09-10T04:52:15.844592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.964883+0000","last_change":"2024-09-10T04:50:10.826557+0000","last_active":"2024-09-10T04:50:50.964883+0000","last_peered":"2024-09-10T04:50:50.964883+0000","last_clean":"2024-09-10T04:50:50.964883+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:50:50.964883+0000","last_undegraded":"2024-09-10T04:50:50.964883+0000","last_fullsized":"2024-09-10T04:50:50.964883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:09.614984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.202264+0000","last_change":"2024-09-10T04:50:08.828183+0000","last_active":"2024-09-10T04:52:17.202264+0000","last_peered":"2024-09-10T04:52:17.202264+0000","last_clean":"2024-09-10T04:52:17.202264+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:52:17.202264+0000","last_undegraded":"2024-09-10T04:52:17.202264+0000","last_fullsized":"2024-09-10T04:52:17.202264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:30.666210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"25'1","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937623+0000","last_change":"2024-09-10T04:50:48.899617+0000","last_active":"2024-09-10T04:52:16.937623+0000","last_peered":"2024-09-10T04:52:16.937623+0000","last_clean":"2024-09-10T04:52:16.937623+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:52:16.937623+0000","last_undegraded":"2024-09-10T04:52:16.937623+0000","last_fullsized":"2024-09-10T04:52:16.937623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:52:34.876228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.824610+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:52:15.824610+0000","last_peered":"2024-09-10T04:52:15.824610+0000","last_clean":"2024-09-10T04:52:15.824610+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:52:15.824610+0000","last_undegraded":"2024-09-10T04:52:15.824610+0000","last_fullsized":"2024-09-10T04:52:15.824610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.764151+0000","last_change":"2024-09-10T04:50:10.826946+0000","last_active":"2024-09-10T04:53:17.764151+0000","last_peered":"2024-09-10T04:53:17.764151+0000","last_clean":"2024-09-10T04:53:17.764151+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:17.764151+0000","last_undegraded":"2024-09-10T04:53:17.764151+0000","last_fullsized":"2024-09-10T04:53:17.764151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:18.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877389+0000","last_change":"2024-09-10T04:50:08.837630+0000","last_active":"2024-09-10T04:50:48.877389+0000","last_peered":"2024-09-10T04:50:48.877389+0000","last_clean":"2024-09-10T04:50:48.877389+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:50:48.877389+0000","last_undegraded":"2024-09-10T04:50:48.877389+0000","last_fullsized":"2024-09-10T04:50:48.877389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:31.546596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880639+0000","last_change":"2024-09-10T04:50:48.878506+0000","last_active":"2024-09-10T04:50:48.880639+0000","last_peered":"2024-09-10T04:50:48.880639+0000","last_clean":"2024-09-10T04:50:48.880639+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:50:48.880639+0000","last_undegraded":"2024-09-10T04:50:48.880639+0000","last_fullsized":"2024-09-10T04:50:48.880639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:02.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.846385+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:52:15.846385+0000","last_peered":"2024-09-10T04:52:15.846385+0000","last_clean":"2024-09-10T04:52:15.846385+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:52:15.846385+0000","last_undegraded":"2024-09-10T04:52:15.846385+0000","last_fullsized":"2024-09-10T04:52:15.846385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.083067+0000","last_change":"2024-09-10T04:50:16.854603+0000","last_active":"2024-09-10T04:53:18.083067+0000","last_peered":"2024-09-10T04:53:18.083067+0000","last_clean":"2024-09-10T04:53:18.083067+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:53:18.083067+0000","last_undegraded":"2024-09-10T04:53:18.083067+0000","last_fullsized":"2024-09-10T04:53:18.083067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:42.247342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671118+0000","last_change":"2024-09-10T04:50:10.835108+0000","last_active":"2024-09-10T04:53:17.671118+0000","last_peered":"2024-09-10T04:53:17.671118+0000","last_clean":"2024-09-10T04:53:17.671118+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:17.671118+0000","last_undegraded":"2024-09-10T04:53:17.671118+0000","last_fullsized":"2024-09-10T04:53:17.671118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:45.228769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.517912+0000","last_change":"2024-09-10T04:50:08.829010+0000","last_active":"2024-09-10T04:51:33.517912+0000","last_peered":"2024-09-10T04:51:33.517912+0000","last_clean":"2024-09-10T04:51:33.517912+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:51:33.517912+0000","last_undegraded":"2024-09-10T04:51:33.517912+0000","last_fullsized":"2024-09-10T04:51:33.517912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:13.348983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871409+0000","last_change":"2024-09-10T04:50:12.828963+0000","last_active":"2024-09-10T04:50:48.871409+0000","last_peered":"2024-09-10T04:50:48.871409+0000","last_clean":"2024-09-10T04:50:48.871409+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:50:48.871409+0000","last_undegraded":"2024-09-10T04:50:48.871409+0000","last_fullsized":"2024-09-10T04:50:48.871409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:51.183596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.848473+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:52:15.848473+0000","last_peered":"2024-09-10T04:52:15.848473+0000","last_clean":"2024-09-10T04:52:15.848473+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:52:15.848473+0000","last_undegraded":"2024-09-10T04:52:15.848473+0000","last_fullsized":"2024-09-10T04:52:15.848473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871299+0000","last_change":"2024-09-10T04:50:16.852342+0000","last_active":"2024-09-10T04:50:48.871299+0000","last_peered":"2024-09-10T04:50:48.871299+0000","last_clean":"2024-09-10T04:50:48.871299+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:50:48.871299+0000","last_undegraded":"2024-09-10T04:50:48.871299+0000","last_fullsized":"2024-09-10T04:50:48.871299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:43.920861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:28.226751+0000","last_change":"2024-09-10T04:50:10.822366+0000","last_active":"2024-09-10T04:52:28.226751+0000","last_peered":"2024-09-10T04:52:28.226751+0000","last_clean":"2024-09-10T04:52:28.226751+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:52:28.226751+0000","last_undegraded":"2024-09-10T04:52:28.226751+0000","last_fullsized":"2024-09-10T04:52:28.226751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:25.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.884332+0000","last_change":"2024-09-10T04:50:08.845577+0000","last_active":"2024-09-10T04:50:48.884332+0000","last_peered":"2024-09-10T04:50:48.884332+0000","last_clean":"2024-09-10T04:50:48.884332+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:50:48.884332+0000","last_undegraded":"2024-09-10T04:50:48.884332+0000","last_fullsized":"2024-09-10T04:50:48.884332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:01.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872733+0000","last_change":"2024-09-10T04:50:12.826302+0000","last_active":"2024-09-10T04:50:48.872733+0000","last_peered":"2024-09-10T04:50:48.872733+0000","last_clean":"2024-09-10T04:50:48.872733+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:50:48.872733+0000","last_undegraded":"2024-09-10T04:50:48.872733+0000","last_fullsized":"2024-09-10T04:50:48.872733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:05.064578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.828772+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:52:15.828772+0000","last_peered":"2024-09-10T04:52:15.828772+0000","last_clean":"2024-09-10T04:52:15.828772+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:52:15.828772+0000","last_undegraded":"2024-09-10T04:52:15.828772+0000","last_fullsized":"2024-09-10T04:52:15.828772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702241+0000","last_change":"2024-09-10T04:50:10.826967+0000","last_active":"2024-09-10T04:50:51.702241+0000","last_peered":"2024-09-10T04:50:51.702241+0000","last_clean":"2024-09-10T04:50:51.702241+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:50:51.702241+0000","last_undegraded":"2024-09-10T04:50:51.702241+0000","last_fullsized":"2024-09-10T04:50:51.702241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:18.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875461+0000","last_change":"2024-09-10T04:50:08.828776+0000","last_active":"2024-09-10T04:50:48.875461+0000","last_peered":"2024-09-10T04:50:48.875461+0000","last_clean":"2024-09-10T04:50:48.875461+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:50:48.875461+0000","last_undegraded":"2024-09-10T04:50:48.875461+0000","last_fullsized":"2024-09-10T04:50:48.875461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:19.564788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.928233+0000","last_change":"2024-09-10T04:50:12.834219+0000","last_active":"2024-09-10T04:52:16.928233+0000","last_peered":"2024-09-10T04:52:16.928233+0000","last_clean":"2024-09-10T04:52:16.928233+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:52:16.928233+0000","last_undegraded":"2024-09-10T04:52:16.928233+0000","last_fullsized":"2024-09-10T04:52:16.928233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:03.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227534+0000","last_change":"2024-09-10T04:50:14.837587+0000","last_active":"2024-09-10T04:52:33.227534+0000","last_peered":"2024-09-10T04:52:33.227534+0000","last_clean":"2024-09-10T04:52:33.227534+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:52:33.227534+0000","last_undegraded":"2024-09-10T04:52:33.227534+0000","last_fullsized":"2024-09-10T04:52:33.227534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:07.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.064451+0000","last_change":"2024-09-10T04:50:16.854229+0000","last_active":"2024-09-10T04:53:18.064451+0000","last_peered":"2024-09-10T04:53:18.064451+0000","last_clean":"2024-09-10T04:53:18.064451+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:53:18.064451+0000","last_undegraded":"2024-09-10T04:53:18.064451+0000","last_fullsized":"2024-09-10T04:53:18.064451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:18.182840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.021671+0000","last_change":"2024-09-10T04:50:10.826497+0000","last_active":"2024-09-10T04:53:18.021671+0000","last_peered":"2024-09-10T04:53:18.021671+0000","last_clean":"2024-09-10T04:53:18.021671+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:18.021671+0000","last_undegraded":"2024-09-10T04:53:18.021671+0000","last_fullsized":"2024-09-10T04:53:18.021671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:32.092320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878748+0000","last_change":"2024-09-10T04:50:08.843627+0000","last_active":"2024-09-10T04:50:48.878748+0000","last_peered":"2024-09-10T04:50:48.878748+0000","last_clean":"2024-09-10T04:50:48.878748+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:50:48.878748+0000","last_undegraded":"2024-09-10T04:50:48.878748+0000","last_fullsized":"2024-09-10T04:50:48.878748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.987359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937306+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:52:16.937306+0000","last_peered":"2024-09-10T04:52:16.937306+0000","last_clean":"2024-09-10T04:52:16.937306+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:52:16.937306+0000","last_undegraded":"2024-09-10T04:52:16.937306+0000","last_fullsized":"2024-09-10T04:52:16.937306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":511,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.026279+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:18.026279+0000","last_peered":"2024-09-10T04:53:18.026279+0000","last_clean":"2024-09-10T04:53:18.026279+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:18.026279+0000","last_undegraded":"2024-09-10T04:53:18.026279+0000","last_fullsized":"2024-09-10T04:53:18.026279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974264+0000","last_change":"2024-09-10T04:50:10.829724+0000","last_active":"2024-09-10T04:53:17.974264+0000","last_peered":"2024-09-10T04:53:17.974264+0000","last_clean":"2024-09-10T04:53:17.974264+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:17.974264+0000","last_undegraded":"2024-09-10T04:53:17.974264+0000","last_fullsized":"2024-09-10T04:53:17.974264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:38.586579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878679+0000","last_change":"2024-09-10T04:50:08.842002+0000","last_active":"2024-09-10T04:50:48.878679+0000","last_peered":"2024-09-10T04:50:48.878679+0000","last_clean":"2024-09-10T04:50:48.878679+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:50:48.878679+0000","last_undegraded":"2024-09-10T04:50:48.878679+0000","last_fullsized":"2024-09-10T04:50:48.878679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:41.938317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883061+0000","last_change":"2024-09-10T04:50:12.829555+0000","last_active":"2024-09-10T04:50:48.883061+0000","last_peered":"2024-09-10T04:50:48.883061+0000","last_clean":"2024-09-10T04:50:48.883061+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:50:48.883061+0000","last_undegraded":"2024-09-10T04:50:48.883061+0000","last_fullsized":"2024-09-10T04:50:48.883061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:09:48.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227887+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:52:33.227887+0000","last_peered":"2024-09-10T04:52:33.227887+0000","last_clean":"2024-09-10T04:52:33.227887+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:52:33.227887+0000","last_undegraded":"2024-09-10T04:52:33.227887+0000","last_fullsized":"2024-09-10T04:52:33.227887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974080+0000","last_change":"2024-09-10T04:50:10.832812+0000","last_active":"2024-09-10T04:53:17.974080+0000","last_peered":"2024-09-10T04:53:17.974080+0000","last_clean":"2024-09-10T04:53:17.974080+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:17.974080+0000","last_undegraded":"2024-09-10T04:53:17.974080+0000","last_fullsized":"2024-09-10T04:53:17.974080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:10.931903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874246+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:48.874246+0000","last_peered":"2024-09-10T04:50:48.874246+0000","last_clean":"2024-09-10T04:50:48.874246+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:48.874246+0000","last_undegraded":"2024-09-10T04:50:48.874246+0000","last_fullsized":"2024-09-10T04:50:48.874246+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875222+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:48.875222+0000","last_peered":"2024-09-10T04:50:48.875222+0000","last_clean":"2024-09-10T04:50:48.875222+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:48.875222+0000","last_undegraded":"2024-09-10T04:50:48.875222+0000","last_fullsized":"2024-09-10T04:50:48.875222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879878+0000","last_change":"2024-09-10T04:50:08.838594+0000","last_active":"2024-09-10T04:50:48.879878+0000","last_peered":"2024-09-10T04:50:48.879878+0000","last_clean":"2024-09-10T04:50:48.879878+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:50:48.879878+0000","last_undegraded":"2024-09-10T04:50:48.879878+0000","last_fullsized":"2024-09-10T04:50:48.879878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:13.728249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876718+0000","last_change":"2024-09-10T04:50:12.831368+0000","last_active":"2024-09-10T04:50:48.876718+0000","last_peered":"2024-09-10T04:50:48.876718+0000","last_clean":"2024-09-10T04:50:48.876718+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:50:48.876718+0000","last_undegraded":"2024-09-10T04:50:48.876718+0000","last_fullsized":"2024-09-10T04:50:48.876718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:47.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.298706+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:52:17.298706+0000","last_peered":"2024-09-10T04:52:17.298706+0000","last_clean":"2024-09-10T04:52:17.298706+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:52:17.298706+0000","last_undegraded":"2024-09-10T04:52:17.298706+0000","last_fullsized":"2024-09-10T04:52:17.298706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882688+0000","last_change":"2024-09-10T04:50:10.823205+0000","last_active":"2024-09-10T04:50:48.882688+0000","last_peered":"2024-09-10T04:50:48.882688+0000","last_clean":"2024-09-10T04:50:48.882688+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:50:48.882688+0000","last_undegraded":"2024-09-10T04:50:48.882688+0000","last_fullsized":"2024-09-10T04:50:48.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:34.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874960+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:48.874960+0000","last_peered":"2024-09-10T04:50:48.874960+0000","last_clean":"2024-09-10T04:50:48.874960+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:48.874960+0000","last_undegraded":"2024-09-10T04:50:48.874960+0000","last_fullsized":"2024-09-10T04:50:48.874960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.631341+0000","last_change":"2024-09-10T04:50:08.836446+0000","last_active":"2024-09-10T04:53:17.631341+0000","last_peered":"2024-09-10T04:53:17.631341+0000","last_clean":"2024-09-10T04:53:17.631341+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:17.631341+0000","last_undegraded":"2024-09-10T04:53:17.631341+0000","last_fullsized":"2024-09-10T04:53:17.631341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878323+0000","last_change":"2024-09-10T04:50:12.829152+0000","last_active":"2024-09-10T04:50:48.878323+0000","last_peered":"2024-09-10T04:50:48.878323+0000","last_clean":"2024-09-10T04:50:48.878323+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:50:48.878323+0000","last_undegraded":"2024-09-10T04:50:48.878323+0000","last_fullsized":"2024-09-10T04:50:48.878323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:57.426370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":489,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910575+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:17.910575+0000","last_peered":"2024-09-10T04:53:17.910575+0000","last_clean":"2024-09-10T04:53:17.910575+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:17.910575+0000","last_undegraded":"2024-09-10T04:53:17.910575+0000","last_fullsized":"2024-09-10T04:53:17.910575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974004+0000","last_change":"2024-09-10T04:50:10.829015+0000","last_active":"2024-09-10T04:53:17.974004+0000","last_peered":"2024-09-10T04:53:17.974004+0000","last_clean":"2024-09-10T04:53:17.974004+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:17.974004+0000","last_undegraded":"2024-09-10T04:53:17.974004+0000","last_fullsized":"2024-09-10T04:53:17.974004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:58.709020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870077+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:48.870077+0000","last_peered":"2024-09-10T04:50:48.870077+0000","last_clean":"2024-09-10T04:50:48.870077+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:48.870077+0000","last_undegraded":"2024-09-10T04:50:48.870077+0000","last_fullsized":"2024-09-10T04:50:48.870077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874373+0000","last_change":"2024-09-10T04:50:08.847331+0000","last_active":"2024-09-10T04:50:48.874373+0000","last_peered":"2024-09-10T04:50:48.874373+0000","last_clean":"2024-09-10T04:50:48.874373+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:50:48.874373+0000","last_undegraded":"2024-09-10T04:50:48.874373+0000","last_fullsized":"2024-09-10T04:50:48.874373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.881835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874638+0000","last_change":"2024-09-10T04:50:12.825223+0000","last_active":"2024-09-10T04:50:48.874638+0000","last_peered":"2024-09-10T04:50:48.874638+0000","last_clean":"2024-09-10T04:50:48.874638+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:50:48.874638+0000","last_undegraded":"2024-09-10T04:50:48.874638+0000","last_fullsized":"2024-09-10T04:50:48.874638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:17.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910723+0000","last_change":"2024-09-10T04:50:48.893450+0000","last_active":"2024-09-10T04:53:17.910723+0000","last_peered":"2024-09-10T04:53:17.910723+0000","last_clean":"2024-09-10T04:53:17.910723+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:53:17.910723+0000","last_undegraded":"2024-09-10T04:53:17.910723+0000","last_fullsized":"2024-09-10T04:53:17.910723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:31.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.770722+0000","last_change":"2024-09-10T04:50:10.836057+0000","last_active":"2024-09-10T04:53:17.770722+0000","last_peered":"2024-09-10T04:53:17.770722+0000","last_clean":"2024-09-10T04:53:17.770722+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:17.770722+0000","last_undegraded":"2024-09-10T04:53:17.770722+0000","last_fullsized":"2024-09-10T04:53:17.770722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:55.248455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875284+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:48.875284+0000","last_peered":"2024-09-10T04:50:48.875284+0000","last_clean":"2024-09-10T04:50:48.875284+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:48.875284+0000","last_undegraded":"2024-09-10T04:50:48.875284+0000","last_fullsized":"2024-09-10T04:50:48.875284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875446+0000","last_change":"2024-09-10T04:50:08.828278+0000","last_active":"2024-09-10T04:50:48.875446+0000","last_peered":"2024-09-10T04:50:48.875446+0000","last_clean":"2024-09-10T04:50:48.875446+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:50:48.875446+0000","last_undegraded":"2024-09-10T04:50:48.875446+0000","last_fullsized":"2024-09-10T04:50:48.875446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:04.354850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877039+0000","last_change":"2024-09-10T04:50:12.829769+0000","last_active":"2024-09-10T04:50:48.877039+0000","last_peered":"2024-09-10T04:50:48.877039+0000","last_clean":"2024-09-10T04:50:48.877039+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:50:48.877039+0000","last_undegraded":"2024-09-10T04:50:48.877039+0000","last_fullsized":"2024-09-10T04:50:48.877039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:09.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876234+0000","last_change":"2024-09-10T04:50:10.829364+0000","last_active":"2024-09-10T04:50:48.876234+0000","last_peered":"2024-09-10T04:50:48.876234+0000","last_clean":"2024-09-10T04:50:48.876234+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:50:48.876234+0000","last_undegraded":"2024-09-10T04:50:48.876234+0000","last_fullsized":"2024-09-10T04:50:48.876234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.090089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877512+0000","last_change":"2024-09-10T04:50:08.837043+0000","last_active":"2024-09-10T04:50:48.877512+0000","last_peered":"2024-09-10T04:50:48.877512+0000","last_clean":"2024-09-10T04:50:48.877512+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:50:48.877512+0000","last_undegraded":"2024-09-10T04:50:48.877512+0000","last_fullsized":"2024-09-10T04:50:48.877512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:17.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877579+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:48.877579+0000","last_peered":"2024-09-10T04:50:48.877579+0000","last_clean":"2024-09-10T04:50:48.877579+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:48.877579+0000","last_undegraded":"2024-09-10T04:50:48.877579+0000","last_fullsized":"2024-09-10T04:50:48.877579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224774+0000","last_change":"2024-09-10T04:50:12.830001+0000","last_active":"2024-09-10T04:52:18.224774+0000","last_peered":"2024-09-10T04:52:18.224774+0000","last_clean":"2024-09-10T04:52:18.224774+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:52:18.224774+0000","last_undegraded":"2024-09-10T04:52:18.224774+0000","last_fullsized":"2024-09-10T04:52:18.224774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:30.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224683+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:52:18.224683+0000","last_peered":"2024-09-10T04:52:18.224683+0000","last_clean":"2024-09-10T04:52:18.224683+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:52:18.224683+0000","last_undegraded":"2024-09-10T04:52:18.224683+0000","last_fullsized":"2024-09-10T04:52:18.224683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296859+0000","last_change":"2024-09-10T04:50:48.895495+0000","last_active":"2024-09-10T04:52:17.296859+0000","last_peered":"2024-09-10T04:52:17.296859+0000","last_clean":"2024-09-10T04:52:17.296859+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:52:17.296859+0000","last_undegraded":"2024-09-10T04:52:17.296859+0000","last_fullsized":"2024-09-10T04:52:17.296859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:15.353442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878026+0000","last_change":"2024-09-10T04:50:08.836453+0000","last_active":"2024-09-10T04:50:48.878026+0000","last_peered":"2024-09-10T04:50:48.878026+0000","last_clean":"2024-09-10T04:50:48.878026+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:50:48.878026+0000","last_undegraded":"2024-09-10T04:50:48.878026+0000","last_fullsized":"2024-09-10T04:50:48.878026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:00.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877301+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:48.877301+0000","last_peered":"2024-09-10T04:50:48.877301+0000","last_clean":"2024-09-10T04:50:48.877301+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:48.877301+0000","last_undegraded":"2024-09-10T04:50:48.877301+0000","last_fullsized":"2024-09-10T04:50:48.877301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910637+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:17.910637+0000","last_peered":"2024-09-10T04:53:17.910637+0000","last_clean":"2024-09-10T04:53:17.910637+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:17.910637+0000","last_undegraded":"2024-09-10T04:53:17.910637+0000","last_fullsized":"2024-09-10T04:53:17.910637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949075+0000","last_change":"2024-09-10T04:50:10.836157+0000","last_active":"2024-09-10T04:53:17.949075+0000","last_peered":"2024-09-10T04:53:17.949075+0000","last_clean":"2024-09-10T04:53:17.949075+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:17.949075+0000","last_undegraded":"2024-09-10T04:53:17.949075+0000","last_fullsized":"2024-09-10T04:53:17.949075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:51:54.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881873+0000","last_change":"2024-09-10T04:50:08.846597+0000","last_active":"2024-09-10T04:50:48.881873+0000","last_peered":"2024-09-10T04:50:48.881873+0000","last_clean":"2024-09-10T04:50:48.881873+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:50:48.881873+0000","last_undegraded":"2024-09-10T04:50:48.881873+0000","last_fullsized":"2024-09-10T04:50:48.881873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:30.509630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878039+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:48.878039+0000","last_peered":"2024-09-10T04:50:48.878039+0000","last_clean":"2024-09-10T04:50:48.878039+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:48.878039+0000","last_undegraded":"2024-09-10T04:50:48.878039+0000","last_fullsized":"2024-09-10T04:50:48.878039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875429+0000","last_change":"2024-09-10T04:50:12.828001+0000","last_active":"2024-09-10T04:50:48.875429+0000","last_peered":"2024-09-10T04:50:48.875429+0000","last_clean":"2024-09-10T04:50:48.875429+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:50:48.875429+0000","last_undegraded":"2024-09-10T04:50:48.875429+0000","last_fullsized":"2024-09-10T04:50:48.875429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:19.857340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.061187+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:18.061187+0000","last_peered":"2024-09-10T04:53:18.061187+0000","last_clean":"2024-09-10T04:53:18.061187+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:18.061187+0000","last_undegraded":"2024-09-10T04:53:18.061187+0000","last_fullsized":"2024-09-10T04:53:18.061187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296426+0000","last_change":"2024-09-10T04:50:10.825130+0000","last_active":"2024-09-10T04:52:17.296426+0000","last_peered":"2024-09-10T04:52:17.296426+0000","last_clean":"2024-09-10T04:52:17.296426+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:52:17.296426+0000","last_undegraded":"2024-09-10T04:52:17.296426+0000","last_fullsized":"2024-09-10T04:52:17.296426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:52.976061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.589847+0000","last_change":"2024-09-10T04:50:08.837605+0000","last_active":"2024-09-10T04:50:50.589847+0000","last_peered":"2024-09-10T04:50:50.589847+0000","last_clean":"2024-09-10T04:50:50.589847+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:50:50.589847+0000","last_undegraded":"2024-09-10T04:50:50.589847+0000","last_fullsized":"2024-09-10T04:50:50.589847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:53.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878172+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:48.878172+0000","last_peered":"2024-09-10T04:50:48.878172+0000","last_clean":"2024-09-10T04:50:48.878172+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:48.878172+0000","last_undegraded":"2024-09-10T04:50:48.878172+0000","last_fullsized":"2024-09-10T04:50:48.878172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881108+0000","last_change":"2024-09-10T04:50:12.833099+0000","last_active":"2024-09-10T04:50:48.881108+0000","last_peered":"2024-09-10T04:50:48.881108+0000","last_clean":"2024-09-10T04:50:48.881108+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:50:48.881108+0000","last_undegraded":"2024-09-10T04:50:48.881108+0000","last_fullsized":"2024-09-10T04:50:48.881108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:10.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.839664+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:52:15.839664+0000","last_peered":"2024-09-10T04:52:15.839664+0000","last_clean":"2024-09-10T04:52:15.839664+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:52:15.839664+0000","last_undegraded":"2024-09-10T04:52:15.839664+0000","last_fullsized":"2024-09-10T04:52:15.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.231272+0000","last_change":"2024-09-10T04:50:10.824890+0000","last_active":"2024-09-10T04:50:51.231272+0000","last_peered":"2024-09-10T04:50:51.231272+0000","last_clean":"2024-09-10T04:50:51.231272+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:50:51.231272+0000","last_undegraded":"2024-09-10T04:50:51.231272+0000","last_fullsized":"2024-09-10T04:50:51.231272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.915338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875830+0000","last_change":"2024-09-10T04:50:08.827991+0000","last_active":"2024-09-10T04:50:48.875830+0000","last_peered":"2024-09-10T04:50:48.875830+0000","last_clean":"2024-09-10T04:50:48.875830+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:50:48.875830+0000","last_undegraded":"2024-09-10T04:50:48.875830+0000","last_fullsized":"2024-09-10T04:50:48.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:27.065767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873861+0000","last_change":"2024-09-10T04:50:12.833107+0000","last_active":"2024-09-10T04:50:48.873861+0000","last_peered":"2024-09-10T04:50:48.873861+0000","last_clean":"2024-09-10T04:50:48.873861+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:50:48.873861+0000","last_undegraded":"2024-09-10T04:50:48.873861+0000","last_fullsized":"2024-09-10T04:50:48.873861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:21.150621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.845543+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:52:15.845543+0000","last_peered":"2024-09-10T04:52:15.845543+0000","last_clean":"2024-09-10T04:52:15.845543+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:52:15.845543+0000","last_undegraded":"2024-09-10T04:52:15.845543+0000","last_fullsized":"2024-09-10T04:52:15.845543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.701581+0000","last_change":"2024-09-10T04:50:10.829358+0000","last_active":"2024-09-10T04:50:51.701581+0000","last_peered":"2024-09-10T04:50:51.701581+0000","last_clean":"2024-09-10T04:50:51.701581+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:50:51.701581+0000","last_undegraded":"2024-09-10T04:50:51.701581+0000","last_fullsized":"2024-09-10T04:50:51.701581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871928+0000","last_change":"2024-09-10T04:50:08.844912+0000","last_active":"2024-09-10T04:50:48.871928+0000","last_peered":"2024-09-10T04:50:48.871928+0000","last_clean":"2024-09-10T04:50:48.871928+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:50:48.871928+0000","last_undegraded":"2024-09-10T04:50:48.871928+0000","last_fullsized":"2024-09-10T04:50:48.871928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:44.401270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872992+0000","last_change":"2024-09-10T04:50:16.850075+0000","last_active":"2024-09-10T04:50:48.872992+0000","last_peered":"2024-09-10T04:50:48.872992+0000","last_clean":"2024-09-10T04:50:48.872992+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:50:48.872992+0000","last_undegraded":"2024-09-10T04:50:48.872992+0000","last_fullsized":"2024-09-10T04:50:48.872992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:56:01.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.615428+0000","last_change":"2024-09-10T04:50:10.820033+0000","last_active":"2024-09-10T04:50:50.615428+0000","last_peered":"2024-09-10T04:50:50.615428+0000","last_clean":"2024-09-10T04:50:50.615428+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:50:50.615428+0000","last_undegraded":"2024-09-10T04:50:50.615428+0000","last_fullsized":"2024-09-10T04:50:50.615428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:57.856874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877343+0000","last_change":"2024-09-10T04:50:08.836435+0000","last_active":"2024-09-10T04:50:48.877343+0000","last_peered":"2024-09-10T04:50:48.877343+0000","last_clean":"2024-09-10T04:50:48.877343+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:50:48.877343+0000","last_undegraded":"2024-09-10T04:50:48.877343+0000","last_fullsized":"2024-09-10T04:50:48.877343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:00:09.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.369040+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:17.369040+0000","last_peered":"2024-09-10T04:53:17.369040+0000","last_clean":"2024-09-10T04:53:17.369040+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:17.369040+0000","last_undegraded":"2024-09-10T04:53:17.369040+0000","last_fullsized":"2024-09-10T04:53:17.369040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898536+0000","last_change":"2024-09-10T04:50:10.834917+0000","last_active":"2024-09-10T04:53:17.898536+0000","last_peered":"2024-09-10T04:53:17.898536+0000","last_clean":"2024-09-10T04:53:17.898536+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:17.898536+0000","last_undegraded":"2024-09-10T04:53:17.898536+0000","last_fullsized":"2024-09-10T04:53:17.898536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.969513+0000","last_change":"2024-09-10T04:50:08.848711+0000","last_active":"2024-09-10T04:53:17.969513+0000","last_peered":"2024-09-10T04:53:17.969513+0000","last_clean":"2024-09-10T04:53:17.969513+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:17.969513+0000","last_undegraded":"2024-09-10T04:53:17.969513+0000","last_fullsized":"2024-09-10T04:53:17.969513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:39.749808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.830813+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:52:15.830813+0000","last_peered":"2024-09-10T04:52:15.830813+0000","last_clean":"2024-09-10T04:52:15.830813+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:52:15.830813+0000","last_undegraded":"2024-09-10T04:52:15.830813+0000","last_fullsized":"2024-09-10T04:52:15.830813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878107+0000","last_change":"2024-09-10T04:50:10.826794+0000","last_active":"2024-09-10T04:50:48.878107+0000","last_peered":"2024-09-10T04:50:48.878107+0000","last_clean":"2024-09-10T04:50:48.878107+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:50:48.878107+0000","last_undegraded":"2024-09-10T04:50:48.878107+0000","last_fullsized":"2024-09-10T04:50:48.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:52.554993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.119492+0000","last_change":"2024-09-10T04:50:08.841684+0000","last_active":"2024-09-10T04:50:50.119492+0000","last_peered":"2024-09-10T04:50:50.119492+0000","last_clean":"2024-09-10T04:50:50.119492+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:50:50.119492+0000","last_undegraded":"2024-09-10T04:50:50.119492+0000","last_fullsized":"2024-09-10T04:50:50.119492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:23.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.851860+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:52:15.851860+0000","last_peered":"2024-09-10T04:52:15.851860+0000","last_clean":"2024-09-10T04:52:15.851860+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:52:15.851860+0000","last_undegraded":"2024-09-10T04:52:15.851860+0000","last_fullsized":"2024-09-10T04:52:15.851860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":69,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898584+0000","last_change":"2024-09-10T04:50:10.832030+0000","last_active":"2024-09-10T04:53:17.898584+0000","last_peered":"2024-09-10T04:53:17.898584+0000","last_clean":"2024-09-10T04:53:17.898584+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:17.898584+0000","last_undegraded":"2024-09-10T04:53:17.898584+0000","last_fullsized":"2024-09-10T04:53:17.898584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:06.264467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873902+0000","last_change":"2024-09-10T04:50:08.848820+0000","last_active":"2024-09-10T04:50:48.873902+0000","last_peered":"2024-09-10T04:50:48.873902+0000","last_clean":"2024-09-10T04:50:48.873902+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:50:48.873902+0000","last_undegraded":"2024-09-10T04:50:48.873902+0000","last_fullsized":"2024-09-10T04:50:48.873902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:38.304965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.831889+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:52:15.831889+0000","last_peered":"2024-09-10T04:52:15.831889+0000","last_clean":"2024-09-10T04:52:15.831889+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:52:15.831889+0000","last_undegraded":"2024-09-10T04:52:15.831889+0000","last_fullsized":"2024-09-10T04:52:15.831889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881759+0000","last_change":"2024-09-10T04:50:10.829229+0000","last_active":"2024-09-10T04:50:48.881759+0000","last_peered":"2024-09-10T04:50:48.881759+0000","last_clean":"2024-09-10T04:50:48.881759+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:50:48.881759+0000","last_undegraded":"2024-09-10T04:50:48.881759+0000","last_fullsized":"2024-09-10T04:50:48.881759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.888344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.135770+0000","last_change":"2024-09-10T04:50:08.829094+0000","last_active":"2024-09-10T04:52:17.135770+0000","last_peered":"2024-09-10T04:52:17.135770+0000","last_clean":"2024-09-10T04:52:17.135770+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:52:17.135770+0000","last_undegraded":"2024-09-10T04:52:17.135770+0000","last_fullsized":"2024-09-10T04:52:17.135770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:06.234076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.849560+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:52:15.849560+0000","last_peered":"2024-09-10T04:52:15.849560+0000","last_clean":"2024-09-10T04:52:15.849560+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:52:15.849560+0000","last_undegraded":"2024-09-10T04:52:15.849560+0000","last_fullsized":"2024-09-10T04:52:15.849560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980768+0000","last_change":"2024-09-10T04:50:10.833243+0000","last_active":"2024-09-10T04:53:17.980768+0000","last_peered":"2024-09-10T04:53:17.980768+0000","last_clean":"2024-09-10T04:53:17.980768+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:17.980768+0000","last_undegraded":"2024-09-10T04:53:17.980768+0000","last_fullsized":"2024-09-10T04:53:17.980768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:23.713893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883823+0000","last_change":"2024-09-10T04:50:08.845251+0000","last_active":"2024-09-10T04:50:48.883823+0000","last_peered":"2024-09-10T04:50:48.883823+0000","last_clean":"2024-09-10T04:50:48.883823+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:50:48.883823+0000","last_undegraded":"2024-09-10T04:50:48.883823+0000","last_fullsized":"2024-09-10T04:50:48.883823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:49.213273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910364+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:17.910364+0000","last_peered":"2024-09-10T04:53:17.910364+0000","last_clean":"2024-09-10T04:53:17.910364+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:17.910364+0000","last_undegraded":"2024-09-10T04:53:17.910364+0000","last_fullsized":"2024-09-10T04:53:17.910364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203867+0000","last_change":"2024-09-10T04:50:10.831574+0000","last_active":"2024-09-10T04:52:14.203867+0000","last_peered":"2024-09-10T04:52:14.203867+0000","last_clean":"2024-09-10T04:52:14.203867+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:52:14.203867+0000","last_undegraded":"2024-09-10T04:52:14.203867+0000","last_fullsized":"2024-09-10T04:52:14.203867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:00.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228408+0000","last_change":"2024-09-10T04:50:08.847637+0000","last_active":"2024-09-10T04:52:38.228408+0000","last_peered":"2024-09-10T04:52:38.228408+0000","last_clean":"2024-09-10T04:52:38.228408+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:52:38.228408+0000","last_undegraded":"2024-09-10T04:52:38.228408+0000","last_fullsized":"2024-09-10T04:52:38.228408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:06.730845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874087+0000","last_change":"2024-09-10T04:50:12.834537+0000","last_active":"2024-09-10T04:50:48.874087+0000","last_peered":"2024-09-10T04:50:48.874087+0000","last_clean":"2024-09-10T04:50:48.874087+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:50:48.874087+0000","last_undegraded":"2024-09-10T04:50:48.874087+0000","last_fullsized":"2024-09-10T04:50:48.874087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:56.571156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:43.229803+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:52:43.229803+0000","last_peered":"2024-09-10T04:52:43.229803+0000","last_clean":"2024-09-10T04:52:43.229803+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:52:43.229803+0000","last_undegraded":"2024-09-10T04:52:43.229803+0000","last_fullsized":"2024-09-10T04:52:43.229803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.673337+0000","last_change":"2024-09-10T04:50:10.827125+0000","last_active":"2024-09-10T04:53:17.673337+0000","last_peered":"2024-09-10T04:53:17.673337+0000","last_clean":"2024-09-10T04:53:17.673337+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:17.673337+0000","last_undegraded":"2024-09-10T04:53:17.673337+0000","last_fullsized":"2024-09-10T04:53:17.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:39.825343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876983+0000","last_change":"2024-09-10T04:50:08.838072+0000","last_active":"2024-09-10T04:50:48.876983+0000","last_peered":"2024-09-10T04:50:48.876983+0000","last_clean":"2024-09-10T04:50:48.876983+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:50:48.876983+0000","last_undegraded":"2024-09-10T04:50:48.876983+0000","last_fullsized":"2024-09-10T04:50:48.876983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:05.923861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.823561+0000","last_change":"2024-09-10T04:50:14.845070+0000","last_active":"2024-09-10T04:52:15.823561+0000","last_peered":"2024-09-10T04:52:15.823561+0000","last_clean":"2024-09-10T04:52:15.823561+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:52:15.823561+0000","last_undegraded":"2024-09-10T04:52:15.823561+0000","last_fullsized":"2024-09-10T04:52:15.823561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:53.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974120+0000","last_change":"2024-09-10T04:50:10.826976+0000","last_active":"2024-09-10T04:53:17.974120+0000","last_peered":"2024-09-10T04:53:17.974120+0000","last_clean":"2024-09-10T04:53:17.974120+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:53:17.974120+0000","last_undegraded":"2024-09-10T04:53:17.974120+0000","last_fullsized":"2024-09-10T04:53:17.974120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:07.818212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881536+0000","last_change":"2024-09-10T04:50:08.840484+0000","last_active":"2024-09-10T04:50:48.881536+0000","last_peered":"2024-09-10T04:50:48.881536+0000","last_clean":"2024-09-10T04:50:48.881536+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:50:48.881536+0000","last_undegraded":"2024-09-10T04:50:48.881536+0000","last_fullsized":"2024-09-10T04:50:48.881536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:38.776585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874056+0000","last_change":"2024-09-10T04:50:12.834557+0000","last_active":"2024-09-10T04:50:48.874056+0000","last_peered":"2024-09-10T04:50:48.874056+0000","last_clean":"2024-09-10T04:50:48.874056+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:50:48.874056+0000","last_undegraded":"2024-09-10T04:50:48.874056+0000","last_fullsized":"2024-09-10T04:50:48.874056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:02.966548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:48.230344+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:52:48.230344+0000","last_peered":"2024-09-10T04:52:48.230344+0000","last_clean":"2024-09-10T04:52:48.230344+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:52:48.230344+0000","last_undegraded":"2024-09-10T04:52:48.230344+0000","last_fullsized":"2024-09-10T04:52:48.230344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954522+0000","last_change":"2024-09-10T04:50:48.883931+0000","last_active":"2024-09-10T04:53:17.954522+0000","last_peered":"2024-09-10T04:53:17.954522+0000","last_clean":"2024-09-10T04:53:17.954522+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:17.954522+0000","last_undegraded":"2024-09-10T04:53:17.954522+0000","last_fullsized":"2024-09-10T04:53:17.954522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:24.168136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879567+0000","last_change":"2024-09-10T04:50:08.849572+0000","last_active":"2024-09-10T04:50:48.879567+0000","last_peered":"2024-09-10T04:50:48.879567+0000","last_clean":"2024-09-10T04:50:48.879567+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:50:48.879567+0000","last_undegraded":"2024-09-10T04:50:48.879567+0000","last_fullsized":"2024-09-10T04:50:48.879567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:35.230547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.535579+0000","last_change":"2024-09-10T04:50:48.897508+0000","last_active":"2024-09-10T04:52:14.535579+0000","last_peered":"2024-09-10T04:52:14.535579+0000","last_clean":"2024-09-10T04:52:14.535579+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:52:14.535579+0000","last_undegraded":"2024-09-10T04:52:14.535579+0000","last_fullsized":"2024-09-10T04:52:14.535579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:16.163407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.315908+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:17.315908+0000","last_peered":"2024-09-10T04:53:17.315908+0000","last_clean":"2024-09-10T04:53:17.315908+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:17.315908+0000","last_undegraded":"2024-09-10T04:53:17.315908+0000","last_fullsized":"2024-09-10T04:53:17.315908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296217+0000","last_change":"2024-09-10T04:50:10.831509+0000","last_active":"2024-09-10T04:52:17.296217+0000","last_peered":"2024-09-10T04:52:17.296217+0000","last_clean":"2024-09-10T04:52:17.296217+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:52:17.296217+0000","last_undegraded":"2024-09-10T04:52:17.296217+0000","last_fullsized":"2024-09-10T04:52:17.296217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:08.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871169+0000","last_change":"2024-09-10T04:50:08.856704+0000","last_active":"2024-09-10T04:50:48.871169+0000","last_peered":"2024-09-10T04:50:48.871169+0000","last_clean":"2024-09-10T04:50:48.871169+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:50:48.871169+0000","last_undegraded":"2024-09-10T04:50:48.871169+0000","last_fullsized":"2024-09-10T04:50:48.871169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:15.081087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.204249+0000","last_change":"2024-09-10T04:50:10.835492+0000","last_active":"2024-09-10T04:52:14.204249+0000","last_peered":"2024-09-10T04:52:14.204249+0000","last_clean":"2024-09-10T04:52:14.204249+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:52:14.204249+0000","last_undegraded":"2024-09-10T04:52:14.204249+0000","last_fullsized":"2024-09-10T04:52:14.204249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.215580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870244+0000","last_change":"2024-09-10T04:50:08.856062+0000","last_active":"2024-09-10T04:50:48.870244+0000","last_peered":"2024-09-10T04:50:48.870244+0000","last_clean":"2024-09-10T04:50:48.870244+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:50:48.870244+0000","last_undegraded":"2024-09-10T04:50:48.870244+0000","last_fullsized":"2024-09-10T04:50:48.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:44.016447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.527212+0000","last_change":"2024-09-10T04:50:10.827487+0000","last_active":"2024-09-10T04:51:33.527212+0000","last_peered":"2024-09-10T04:51:33.527212+0000","last_clean":"2024-09-10T04:51:33.527212+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:51:33.527212+0000","last_undegraded":"2024-09-10T04:51:33.527212+0000","last_fullsized":"2024-09-10T04:51:33.527212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:31.140771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.189762+0000","last_change":"2024-09-10T04:50:08.839647+0000","last_active":"2024-09-10T04:52:14.189762+0000","last_peered":"2024-09-10T04:52:14.189762+0000","last_clean":"2024-09-10T04:52:14.189762+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:52:14.189762+0000","last_undegraded":"2024-09-10T04:52:14.189762+0000","last_fullsized":"2024-09-10T04:52:14.189762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:50.972996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.297469+0000","last_change":"2024-09-10T04:50:10.836518+0000","last_active":"2024-09-10T04:52:17.297469+0000","last_peered":"2024-09-10T04:52:17.297469+0000","last_clean":"2024-09-10T04:52:17.297469+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:52:17.297469+0000","last_undegraded":"2024-09-10T04:52:17.297469+0000","last_fullsized":"2024-09-10T04:52:17.297469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:31.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.887688+0000","last_change":"2024-09-10T04:50:08.840487+0000","last_active":"2024-09-10T04:53:17.887688+0000","last_peered":"2024-09-10T04:53:17.887688+0000","last_clean":"2024-09-10T04:53:17.887688+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:17.887688+0000","last_undegraded":"2024-09-10T04:53:17.887688+0000","last_fullsized":"2024-09-10T04:53:17.887688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:15.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949045+0000","last_change":"2024-09-10T04:50:10.819238+0000","last_active":"2024-09-10T04:53:17.949045+0000","last_peered":"2024-09-10T04:53:17.949045+0000","last_clean":"2024-09-10T04:53:17.949045+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:53:17.949045+0000","last_undegraded":"2024-09-10T04:53:17.949045+0000","last_fullsized":"2024-09-10T04:53:17.949045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.471522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883009+0000","last_change":"2024-09-10T04:50:08.841048+0000","last_active":"2024-09-10T04:50:48.883009+0000","last_peered":"2024-09-10T04:50:48.883009+0000","last_clean":"2024-09-10T04:50:48.883009+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:50:48.883009+0000","last_undegraded":"2024-09-10T04:50:48.883009+0000","last_fullsized":"2024-09-10T04:50:48.883009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.225704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203735+0000","last_change":"2024-09-10T04:50:10.831470+0000","last_active":"2024-09-10T04:52:14.203735+0000","last_peered":"2024-09-10T04:52:14.203735+0000","last_clean":"2024-09-10T04:52:14.203735+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:52:14.203735+0000","last_undegraded":"2024-09-10T04:52:14.203735+0000","last_fullsized":"2024-09-10T04:52:14.203735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.221117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.884302+0000","last_change":"2024-09-10T04:50:08.846442+0000","last_active":"2024-09-10T04:53:17.884302+0000","last_peered":"2024-09-10T04:53:17.884302+0000","last_clean":"2024-09-10T04:53:17.884302+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:17.884302+0000","last_undegraded":"2024-09-10T04:53:17.884302+0000","last_fullsized":"2024-09-10T04:53:17.884302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:16.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946963+0000","last_change":"2024-09-10T04:50:10.827486+0000","last_active":"2024-09-10T04:53:17.946963+0000","last_peered":"2024-09-10T04:53:17.946963+0000","last_clean":"2024-09-10T04:53:17.946963+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:53:17.946963+0000","last_undegraded":"2024-09-10T04:53:17.946963+0000","last_fullsized":"2024-09-10T04:53:17.946963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:33.726146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224842+0000","last_change":"2024-09-10T04:50:08.844203+0000","last_active":"2024-09-10T04:52:18.224842+0000","last_peered":"2024-09-10T04:52:18.224842+0000","last_clean":"2024-09-10T04:52:18.224842+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:52:18.224842+0000","last_undegraded":"2024-09-10T04:52:18.224842+0000","last_fullsized":"2024-09-10T04:52:18.224842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:18.749197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974089+0000","last_change":"2024-09-10T04:50:10.827432+0000","last_active":"2024-09-10T04:53:17.974089+0000","last_peered":"2024-09-10T04:53:17.974089+0000","last_clean":"2024-09-10T04:53:17.974089+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:17.974089+0000","last_undegraded":"2024-09-10T04:53:17.974089+0000","last_fullsized":"2024-09-10T04:53:17.974089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.651962+0000","last_change":"2024-09-10T04:50:08.846314+0000","last_active":"2024-09-10T04:53:17.651962+0000","last_peered":"2024-09-10T04:53:17.651962+0000","last_clean":"2024-09-10T04:53:17.651962+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:17.651962+0000","last_undegraded":"2024-09-10T04:53:17.651962+0000","last_fullsized":"2024-09-10T04:53:17.651962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:46.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898539+0000","last_change":"2024-09-10T04:50:10.835695+0000","last_active":"2024-09-10T04:53:17.898539+0000","last_peered":"2024-09-10T04:53:17.898539+0000","last_clean":"2024-09-10T04:53:17.898539+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:17.898539+0000","last_undegraded":"2024-09-10T04:53:17.898539+0000","last_fullsized":"2024-09-10T04:53:17.898539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:38.631225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878570+0000","last_change":"2024-09-10T04:50:08.839014+0000","last_active":"2024-09-10T04:50:48.878570+0000","last_peered":"2024-09-10T04:50:48.878570+0000","last_clean":"2024-09-10T04:50:48.878570+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:50:48.878570+0000","last_undegraded":"2024-09-10T04:50:48.878570+0000","last_fullsized":"2024-09-10T04:50:48.878570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:44.696031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898521+0000","last_change":"2024-09-10T04:50:10.829938+0000","last_active":"2024-09-10T04:53:17.898521+0000","last_peered":"2024-09-10T04:53:17.898521+0000","last_clean":"2024-09-10T04:53:17.898521+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:53:17.898521+0000","last_undegraded":"2024-09-10T04:53:17.898521+0000","last_fullsized":"2024-09-10T04:53:17.898521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.656906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878982+0000","last_change":"2024-09-10T04:50:08.840107+0000","last_active":"2024-09-10T04:50:48.878982+0000","last_peered":"2024-09-10T04:50:48.878982+0000","last_clean":"2024-09-10T04:50:48.878982+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:50:48.878982+0000","last_undegraded":"2024-09-10T04:50:48.878982+0000","last_fullsized":"2024-09-10T04:50:48.878982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:13.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296935+0000","last_change":"2024-09-10T04:50:10.831991+0000","last_active":"2024-09-10T04:52:17.296935+0000","last_peered":"2024-09-10T04:52:17.296935+0000","last_clean":"2024-09-10T04:52:17.296935+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:52:17.296935+0000","last_undegraded":"2024-09-10T04:52:17.296935+0000","last_fullsized":"2024-09-10T04:52:17.296935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:15.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.226174+0000","last_change":"2024-09-10T04:50:08.837010+0000","last_active":"2024-09-10T04:52:23.226174+0000","last_peered":"2024-09-10T04:52:23.226174+0000","last_clean":"2024-09-10T04:52:23.226174+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:52:23.226174+0000","last_undegraded":"2024-09-10T04:52:23.226174+0000","last_fullsized":"2024-09-10T04:52:23.226174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.112191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.947710+0000","last_change":"2024-09-10T04:50:10.829211+0000","last_active":"2024-09-10T04:53:17.947710+0000","last_peered":"2024-09-10T04:53:17.947710+0000","last_clean":"2024-09-10T04:53:17.947710+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:17.947710+0000","last_undegraded":"2024-09-10T04:53:17.947710+0000","last_fullsized":"2024-09-10T04:53:17.947710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:38.433783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875118+0000","last_change":"2024-09-10T04:50:08.848180+0000","last_active":"2024-09-10T04:50:48.875118+0000","last_peered":"2024-09-10T04:50:48.875118+0000","last_clean":"2024-09-10T04:50:48.875118+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:50:48.875118+0000","last_undegraded":"2024-09-10T04:50:48.875118+0000","last_fullsized":"2024-09-10T04:50:48.875118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:10.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949266+0000","last_change":"2024-09-10T04:50:10.826724+0000","last_active":"2024-09-10T04:53:17.949266+0000","last_peered":"2024-09-10T04:53:17.949266+0000","last_clean":"2024-09-10T04:53:17.949266+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:17.949266+0000","last_undegraded":"2024-09-10T04:53:17.949266+0000","last_fullsized":"2024-09-10T04:53:17.949266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:23.940844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883171+0000","last_change":"2024-09-10T04:50:08.841143+0000","last_active":"2024-09-10T04:50:48.883171+0000","last_peered":"2024-09-10T04:50:48.883171+0000","last_clean":"2024-09-10T04:50:48.883171+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:50:48.883171+0000","last_undegraded":"2024-09-10T04:50:48.883171+0000","last_fullsized":"2024-09-10T04:50:48.883171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946926+0000","last_change":"2024-09-10T04:50:10.829656+0000","last_active":"2024-09-10T04:53:17.946926+0000","last_peered":"2024-09-10T04:53:17.946926+0000","last_clean":"2024-09-10T04:53:17.946926+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:17.946926+0000","last_undegraded":"2024-09-10T04:53:17.946926+0000","last_fullsized":"2024-09-10T04:53:17.946926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.419467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.117840+0000","last_change":"2024-09-10T04:50:08.841015+0000","last_active":"2024-09-10T04:50:50.117840+0000","last_peered":"2024-09-10T04:50:50.117840+0000","last_clean":"2024-09-10T04:50:50.117840+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:50:50.117840+0000","last_undegraded":"2024-09-10T04:50:50.117840+0000","last_fullsized":"2024-09-10T04:50:50.117840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:30.089256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.965106+0000","last_change":"2024-09-10T04:50:10.827238+0000","last_active":"2024-09-10T04:50:50.965106+0000","last_peered":"2024-09-10T04:50:50.965106+0000","last_clean":"2024-09-10T04:50:50.965106+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:50:50.965106+0000","last_undegraded":"2024-09-10T04:50:50.965106+0000","last_fullsized":"2024-09-10T04:50:50.965106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:11.286717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873207+0000","last_change":"2024-09-10T04:50:08.843693+0000","last_active":"2024-09-10T04:50:48.873207+0000","last_peered":"2024-09-10T04:50:48.873207+0000","last_clean":"2024-09-10T04:50:48.873207+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:50:48.873207+0000","last_undegraded":"2024-09-10T04:50:48.873207+0000","last_fullsized":"2024-09-10T04:50:48.873207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:17.375028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.905075+0000","last_change":"2024-09-10T04:50:10.827173+0000","last_active":"2024-09-10T04:53:17.905075+0000","last_peered":"2024-09-10T04:53:17.905075+0000","last_clean":"2024-09-10T04:53:17.905075+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:17.905075+0000","last_undegraded":"2024-09-10T04:53:17.905075+0000","last_fullsized":"2024-09-10T04:53:17.905075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:28.319087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882780+0000","last_change":"2024-09-10T04:50:08.841506+0000","last_active":"2024-09-10T04:50:48.882780+0000","last_peered":"2024-09-10T04:50:48.882780+0000","last_clean":"2024-09-10T04:50:48.882780+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:50:48.882780+0000","last_undegraded":"2024-09-10T04:50:48.882780+0000","last_fullsized":"2024-09-10T04:50:48.882780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:11.919356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874624+0000","last_change":"2024-09-10T04:50:08.828047+0000","last_active":"2024-09-10T04:50:48.874624+0000","last_peered":"2024-09-10T04:50:48.874624+0000","last_clean":"2024-09-10T04:50:48.874624+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:50:48.874624+0000","last_undegraded":"2024-09-10T04:50:48.874624+0000","last_fullsized":"2024-09-10T04:50:48.874624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:53.770216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974118+0000","last_change":"2024-09-10T04:50:10.831624+0000","last_active":"2024-09-10T04:53:17.974118+0000","last_peered":"2024-09-10T04:53:17.974118+0000","last_clean":"2024-09-10T04:53:17.974118+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:17.974118+0000","last_undegraded":"2024-09-10T04:53:17.974118+0000","last_fullsized":"2024-09-10T04:53:17.974118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:40.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.275559+0000","last_change":"2024-09-10T04:50:08.848380+0000","last_active":"2024-09-10T04:52:17.275559+0000","last_peered":"2024-09-10T04:52:17.275559+0000","last_clean":"2024-09-10T04:52:17.275559+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:52:17.275559+0000","last_undegraded":"2024-09-10T04:52:17.275559+0000","last_fullsized":"2024-09-10T04:52:17.275559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.809904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.904798+0000","last_change":"2024-09-10T04:50:10.833818+0000","last_active":"2024-09-10T04:53:17.904798+0000","last_peered":"2024-09-10T04:53:17.904798+0000","last_clean":"2024-09-10T04:53:17.904798+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:53:17.904798+0000","last_undegraded":"2024-09-10T04:53:17.904798+0000","last_fullsized":"2024-09-10T04:53:17.904798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:10.568818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1469,"ondisk_log_size":1469,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":9048064,"data_stored":8757315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44732,"kb_used_data":9388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327108,"statfs":{"total":96636764160,"available":96590958592,"internally_reserved":0,"allocated":9613312,"data_stored":9346366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673005,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":9662464,"data_stored":9349694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673005,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8759353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:53:25.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:53:25.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.170+0000 7fac54b10640 1 Processor -- start 2024-09-10T04:53:25.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.170+0000 7fac54b10640 1 -- start start 2024-09-10T04:53:25.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac54b10640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fac5012fc50 0x7fac501344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac54b10640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac50070f40 con 0x7fac5012f160 2024-09-10T04:53:25.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac54b10640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fac50070d70 con 0x7fac5012fc50 2024-09-10T04:53:25.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4dd9b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fac5012fc50 0x7fac501344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4e59c640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fac5012f160 0x7fac5012f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46112/0 (socket says 172.21.15.98:46112) 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4dd9b640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fac5012fc50 0x7fac501344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50842/0 (socket says 172.21.15.98:50842) 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4e59c640 1 -- 172.21.15.98:0/3298364868 learned_addr learned my addr 172.21.15.98:0/3298364868 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4dd9b640 1 -- 172.21.15.98:0/3298364868 >> v1:172.21.15.98:6789/0 conn(0x7fac5012f160 legacy=0x7fac5012f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4d59a640 1 -- 172.21.15.98:0/3298364868 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939650405 0 0) 0x7fac50070f40 con 0x7fac5012f160 2024-09-10T04:53:25.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.171+0000 7fac4dd9b640 1 -- 172.21.15.98:0/3298364868 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50072160 con 0x7fac5012fc50 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.172+0000 7fac4dd9b640 1 --2- 172.21.15.98:0/3298364868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012fc50 0x7fac501344e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fac44009720 tx=0x7fac4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a17b39aabc39ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.172+0000 7fac4d59a640 1 -- 172.21.15.98:0/3298364868 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44037070 con 0x7fac5012fc50 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.172+0000 7fac4d59a640 1 -- 172.21.15.98:0/3298364868 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4402ad90 con 0x7fac5012fc50 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.172+0000 7fac4d59a640 1 -- 172.21.15.98:0/3298364868 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44032590 con 0x7fac5012fc50 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 -- 172.21.15.98:0/3298364868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012fc50 msgr2=0x7fac501344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 --2- 172.21.15.98:0/3298364868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012fc50 0x7fac501344e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fac44009720 tx=0x7fac4402a110 comp rx=0 tx=0).stop 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 -- 172.21.15.98:0/3298364868 shutdown_connections 2024-09-10T04:53:25.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 --2- 172.21.15.98:0/3298364868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012fc50 0x7fac501344e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 -- 172.21.15.98:0/3298364868 >> 172.21.15.98:0/3298364868 conn(0x7fac500a0ae0 msgr2=0x7fac5006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:25.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 -- 172.21.15.98:0/3298364868 shutdown_connections 2024-09-10T04:53:25.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.173+0000 7fac54b10640 1 -- 172.21.15.98:0/3298364868 wait complete. 2024-09-10T04:53:25.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac54b10640 1 Processor -- start 2024-09-10T04:53:25.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac54b10640 1 -- start start 2024-09-10T04:53:25.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac54b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac54b10640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fac50134ba0 con 0x7fac5012f160 2024-09-10T04:53:25.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac4e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac4e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50852/0 (socket says 172.21.15.98:50852) 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.174+0000 7fac4e59c640 1 -- 172.21.15.98:0/1004675332 learned_addr learned my addr 172.21.15.98:0/1004675332 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac4e59c640 1 -- 172.21.15.98:0/1004675332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5011e890 con 0x7fac5012f160 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac4e59c640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c3d0 tx=0x7fac4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac400074d0 con 0x7fac5012f160 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac400047e0 con 0x7fac5012f160 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac40007670 con 0x7fac5012f160 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5011e160 con 0x7fac5012f160 2024-09-10T04:53:25.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.175+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5011c290 con 0x7fac5012f160 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.176+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac40011070 con 0x7fac5012f160 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.176+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5012f540 con 0x7fac5012f160 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.176+0000 7fac3effd640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 0x7fac30040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.176+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fac40052a80 con 0x7fac5012f160 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.176+0000 7fac4dd9b640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 0x7fac30040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.177+0000 7fac4dd9b640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 0x7fac30040300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac44034000 tx=0x7fac4402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.184+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fac40012dd0 con 0x7fac5012f160 2024-09-10T04:53:25.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.361+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac50068da0 con 0x7fac3003de40 2024-09-10T04:53:25.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.371+0000 7fac3effd640 1 -- 172.21.15.98:0/1004675332 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666095 (secure 0 0 0) 0x7fac50068da0 con 0x7fac3003de40 2024-09-10T04:53:25.405 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:25.409 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 msgr2=0x7fac30040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 0x7fac30040300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac44034000 tx=0x7fac4402e000 comp rx=0 tx=0).stop 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 msgr2=0x7fac5011bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c3d0 tx=0x7fac4000c890 comp rx=0 tx=0).stop 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 shutdown_connections 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fac3003de40 0x7fac30040300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 --2- 172.21.15.98:0/1004675332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac5012f160 0x7fac5011bd50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.377+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 >> 172.21.15.98:0/1004675332 conn(0x7fac500a0ae0 msgr2=0x7fac50130270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:25.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.378+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 shutdown_connections 2024-09-10T04:53:25.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.378+0000 7fac54b10640 1 -- 172.21.15.98:0/1004675332 wait complete. 2024-09-10T04:53:25.413 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-10T04:53:25.254307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004267"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.213647+0000","last_change":"2024-09-10T04:50:08.836558+0000","last_active":"2024-09-10T04:50:51.213647+0000","last_peered":"2024-09-10T04:50:51.213647+0000","last_clean":"2024-09-10T04:50:51.213647+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:50:51.213647+0000","last_undegraded":"2024-09-10T04:50:51.213647+0000","last_fullsized":"2024-09-10T04:50:51.213647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:07.611919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874886+0000","last_change":"2024-09-10T04:50:10.827523+0000","last_active":"2024-09-10T04:50:48.874886+0000","last_peered":"2024-09-10T04:50:48.874886+0000","last_clean":"2024-09-10T04:50:48.874886+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:50:48.874886+0000","last_undegraded":"2024-09-10T04:50:48.874886+0000","last_fullsized":"2024-09-10T04:50:48.874886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:56.905163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:13.223901+0000","last_change":"2024-09-10T04:50:08.848586+0000","last_active":"2024-09-10T04:52:13.223901+0000","last_peered":"2024-09-10T04:52:13.223901+0000","last_clean":"2024-09-10T04:52:13.223901+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:52:13.223901+0000","last_undegraded":"2024-09-10T04:52:13.223901+0000","last_fullsized":"2024-09-10T04:52:13.223901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671414+0000","last_change":"2024-09-10T04:50:10.819187+0000","last_active":"2024-09-10T04:53:17.671414+0000","last_peered":"2024-09-10T04:53:17.671414+0000","last_clean":"2024-09-10T04:53:17.671414+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:53:17.671414+0000","last_undegraded":"2024-09-10T04:53:17.671414+0000","last_fullsized":"2024-09-10T04:53:17.671414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:41.828061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881449+0000","last_change":"2024-09-10T04:50:08.839328+0000","last_active":"2024-09-10T04:50:48.881449+0000","last_peered":"2024-09-10T04:50:48.881449+0000","last_clean":"2024-09-10T04:50:48.881449+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:50:48.881449+0000","last_undegraded":"2024-09-10T04:50:48.881449+0000","last_fullsized":"2024-09-10T04:50:48.881449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:21.710828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732731+0000","last_change":"2024-09-10T04:50:48.879830+0000","last_active":"2024-09-10T04:51:33.732731+0000","last_peered":"2024-09-10T04:51:33.732731+0000","last_clean":"2024-09-10T04:51:33.732731+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:51:33.732731+0000","last_undegraded":"2024-09-10T04:51:33.732731+0000","last_fullsized":"2024-09-10T04:51:33.732731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:59.179205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871764+0000","last_change":"2024-09-10T04:50:08.841951+0000","last_active":"2024-09-10T04:50:48.871764+0000","last_peered":"2024-09-10T04:50:48.871764+0000","last_clean":"2024-09-10T04:50:48.871764+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:50:48.871764+0000","last_undegraded":"2024-09-10T04:50:48.871764+0000","last_fullsized":"2024-09-10T04:50:48.871764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:00.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.201672+0000","last_change":"2024-09-10T04:50:48.879883+0000","last_active":"2024-09-10T04:52:14.201672+0000","last_peered":"2024-09-10T04:52:14.201672+0000","last_clean":"2024-09-10T04:52:14.201672+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:52:14.201672+0000","last_undegraded":"2024-09-10T04:52:14.201672+0000","last_fullsized":"2024-09-10T04:52:14.201672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:08.771696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875513+0000","last_change":"2024-09-10T04:50:08.836256+0000","last_active":"2024-09-10T04:50:48.875513+0000","last_peered":"2024-09-10T04:50:48.875513+0000","last_clean":"2024-09-10T04:50:48.875513+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:50:48.875513+0000","last_undegraded":"2024-09-10T04:50:48.875513+0000","last_fullsized":"2024-09-10T04:50:48.875513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:21.447084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702019+0000","last_change":"2024-09-10T04:50:10.823009+0000","last_active":"2024-09-10T04:50:51.702019+0000","last_peered":"2024-09-10T04:50:51.702019+0000","last_clean":"2024-09-10T04:50:51.702019+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:50:51.702019+0000","last_undegraded":"2024-09-10T04:50:51.702019+0000","last_fullsized":"2024-09-10T04:50:51.702019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.897024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875751+0000","last_change":"2024-09-10T04:50:08.837428+0000","last_active":"2024-09-10T04:50:48.875751+0000","last_peered":"2024-09-10T04:50:48.875751+0000","last_clean":"2024-09-10T04:50:48.875751+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:50:48.875751+0000","last_undegraded":"2024-09-10T04:50:48.875751+0000","last_fullsized":"2024-09-10T04:50:48.875751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:13.131981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671731+0000","last_change":"2024-09-10T04:50:10.832647+0000","last_active":"2024-09-10T04:53:17.671731+0000","last_peered":"2024-09-10T04:53:17.671731+0000","last_clean":"2024-09-10T04:53:17.671731+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:53:17.671731+0000","last_undegraded":"2024-09-10T04:53:17.671731+0000","last_fullsized":"2024-09-10T04:53:17.671731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:30.079691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.878085+0000","last_change":"2024-09-10T04:50:08.834170+0000","last_active":"2024-09-10T04:53:17.878085+0000","last_peered":"2024-09-10T04:53:17.878085+0000","last_clean":"2024-09-10T04:53:17.878085+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:17.878085+0000","last_undegraded":"2024-09-10T04:53:17.878085+0000","last_fullsized":"2024-09-10T04:53:17.878085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:23.894994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732327+0000","last_change":"2024-09-10T04:50:10.825623+0000","last_active":"2024-09-10T04:51:33.732327+0000","last_peered":"2024-09-10T04:51:33.732327+0000","last_clean":"2024-09-10T04:51:33.732327+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:51:33.732327+0000","last_undegraded":"2024-09-10T04:51:33.732327+0000","last_fullsized":"2024-09-10T04:51:33.732327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.611215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.881294+0000","last_change":"2024-09-10T04:50:08.842334+0000","last_active":"2024-09-10T04:53:17.881294+0000","last_peered":"2024-09-10T04:53:17.881294+0000","last_clean":"2024-09-10T04:53:17.881294+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:17.881294+0000","last_undegraded":"2024-09-10T04:53:17.881294+0000","last_fullsized":"2024-09-10T04:53:17.881294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:03.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.022533+0000","last_change":"2024-09-10T04:50:10.831636+0000","last_active":"2024-09-10T04:53:18.022533+0000","last_peered":"2024-09-10T04:53:18.022533+0000","last_clean":"2024-09-10T04:53:18.022533+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:18.022533+0000","last_undegraded":"2024-09-10T04:53:18.022533+0000","last_fullsized":"2024-09-10T04:53:18.022533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:51.773869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949263+0000","last_change":"2024-09-10T04:50:10.827812+0000","last_active":"2024-09-10T04:53:17.949263+0000","last_peered":"2024-09-10T04:53:17.949263+0000","last_clean":"2024-09-10T04:53:17.949263+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:17.949263+0000","last_undegraded":"2024-09-10T04:53:17.949263+0000","last_fullsized":"2024-09-10T04:53:17.949263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.617778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879684+0000","last_change":"2024-09-10T04:50:08.849290+0000","last_active":"2024-09-10T04:50:48.879684+0000","last_peered":"2024-09-10T04:50:48.879684+0000","last_clean":"2024-09-10T04:50:48.879684+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:50:48.879684+0000","last_undegraded":"2024-09-10T04:50:48.879684+0000","last_fullsized":"2024-09-10T04:50:48.879684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:01.331992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.230916+0000","last_change":"2024-09-10T04:50:10.825696+0000","last_active":"2024-09-10T04:50:51.230916+0000","last_peered":"2024-09-10T04:50:51.230916+0000","last_clean":"2024-09-10T04:50:51.230916+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:50:51.230916+0000","last_undegraded":"2024-09-10T04:50:51.230916+0000","last_fullsized":"2024-09-10T04:50:51.230916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:21.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.249384+0000","last_change":"2024-09-10T04:50:08.855614+0000","last_active":"2024-09-10T04:52:17.249384+0000","last_peered":"2024-09-10T04:52:17.249384+0000","last_clean":"2024-09-10T04:52:17.249384+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:52:17.249384+0000","last_undegraded":"2024-09-10T04:52:17.249384+0000","last_fullsized":"2024-09-10T04:52:17.249384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:52.782524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.219735+0000","last_change":"2024-09-10T04:50:08.838188+0000","last_active":"2024-09-10T04:50:51.219735+0000","last_peered":"2024-09-10T04:50:51.219735+0000","last_clean":"2024-09-10T04:50:51.219735+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:50:51.219735+0000","last_undegraded":"2024-09-10T04:50:51.219735+0000","last_fullsized":"2024-09-10T04:50:51.219735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:02.357191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874666+0000","last_change":"2024-09-10T04:50:10.831149+0000","last_active":"2024-09-10T04:50:48.874666+0000","last_peered":"2024-09-10T04:50:48.874666+0000","last_clean":"2024-09-10T04:50:48.874666+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:50:48.874666+0000","last_undegraded":"2024-09-10T04:50:48.874666+0000","last_fullsized":"2024-09-10T04:50:48.874666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.512694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875939+0000","last_change":"2024-09-10T04:50:08.836996+0000","last_active":"2024-09-10T04:50:48.875939+0000","last_peered":"2024-09-10T04:50:48.875939+0000","last_clean":"2024-09-10T04:50:48.875939+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:50:48.875939+0000","last_undegraded":"2024-09-10T04:50:48.875939+0000","last_fullsized":"2024-09-10T04:50:48.875939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:37.196606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732464+0000","last_change":"2024-09-10T04:50:10.824023+0000","last_active":"2024-09-10T04:51:33.732464+0000","last_peered":"2024-09-10T04:51:33.732464+0000","last_clean":"2024-09-10T04:51:33.732464+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:51:33.732464+0000","last_undegraded":"2024-09-10T04:51:33.732464+0000","last_fullsized":"2024-09-10T04:51:33.732464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.559546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.545371+0000","last_change":"2024-09-10T04:50:08.846235+0000","last_active":"2024-09-10T04:53:17.545371+0000","last_peered":"2024-09-10T04:53:17.545371+0000","last_clean":"2024-09-10T04:53:17.545371+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:17.545371+0000","last_undegraded":"2024-09-10T04:53:17.545371+0000","last_fullsized":"2024-09-10T04:53:17.545371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:03.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954024+0000","last_change":"2024-09-10T04:50:10.831903+0000","last_active":"2024-09-10T04:53:17.954024+0000","last_peered":"2024-09-10T04:53:17.954024+0000","last_clean":"2024-09-10T04:53:17.954024+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:17.954024+0000","last_undegraded":"2024-09-10T04:53:17.954024+0000","last_fullsized":"2024-09-10T04:53:17.954024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:04.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879338+0000","last_change":"2024-09-10T04:50:08.838274+0000","last_active":"2024-09-10T04:50:48.879338+0000","last_peered":"2024-09-10T04:50:48.879338+0000","last_clean":"2024-09-10T04:50:48.879338+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:50:48.879338+0000","last_undegraded":"2024-09-10T04:50:48.879338+0000","last_fullsized":"2024-09-10T04:50:48.879338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:40.373059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.763257+0000","last_change":"2024-09-10T04:50:10.827657+0000","last_active":"2024-09-10T04:53:17.763257+0000","last_peered":"2024-09-10T04:53:17.763257+0000","last_clean":"2024-09-10T04:53:17.763257+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:17.763257+0000","last_undegraded":"2024-09-10T04:53:17.763257+0000","last_fullsized":"2024-09-10T04:53:17.763257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:10.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.722381+0000","last_change":"2024-09-10T04:50:08.845982+0000","last_active":"2024-09-10T04:51:33.722381+0000","last_peered":"2024-09-10T04:51:33.722381+0000","last_clean":"2024-09-10T04:51:33.722381+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:51:33.722381+0000","last_undegraded":"2024-09-10T04:51:33.722381+0000","last_fullsized":"2024-09-10T04:51:33.722381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:28.921046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.840707+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:52:15.840707+0000","last_peered":"2024-09-10T04:52:15.840707+0000","last_clean":"2024-09-10T04:52:15.840707+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:52:15.840707+0000","last_undegraded":"2024-09-10T04:52:15.840707+0000","last_fullsized":"2024-09-10T04:52:15.840707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228840+0000","last_change":"2024-09-10T04:50:10.818723+0000","last_active":"2024-09-10T04:52:38.228840+0000","last_peered":"2024-09-10T04:52:38.228840+0000","last_clean":"2024-09-10T04:52:38.228840+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:52:38.228840+0000","last_undegraded":"2024-09-10T04:52:38.228840+0000","last_fullsized":"2024-09-10T04:52:38.228840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:32.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.891329+0000","last_change":"2024-09-10T04:50:08.842024+0000","last_active":"2024-09-10T04:53:17.891329+0000","last_peered":"2024-09-10T04:53:17.891329+0000","last_clean":"2024-09-10T04:53:17.891329+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:17.891329+0000","last_undegraded":"2024-09-10T04:53:17.891329+0000","last_fullsized":"2024-09-10T04:53:17.891329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:36.641361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203915+0000","last_change":"2024-09-10T04:50:10.823064+0000","last_active":"2024-09-10T04:52:14.203915+0000","last_peered":"2024-09-10T04:52:14.203915+0000","last_clean":"2024-09-10T04:52:14.203915+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:52:14.203915+0000","last_undegraded":"2024-09-10T04:52:14.203915+0000","last_fullsized":"2024-09-10T04:52:14.203915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:26.449576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874566+0000","last_change":"2024-09-10T04:50:08.837572+0000","last_active":"2024-09-10T04:50:48.874566+0000","last_peered":"2024-09-10T04:50:48.874566+0000","last_clean":"2024-09-10T04:50:48.874566+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:50:48.874566+0000","last_undegraded":"2024-09-10T04:50:48.874566+0000","last_fullsized":"2024-09-10T04:50:48.874566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:06.915826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871643+0000","last_change":"2024-09-10T04:50:14.831883+0000","last_active":"2024-09-10T04:50:48.871643+0000","last_peered":"2024-09-10T04:50:48.871643+0000","last_clean":"2024-09-10T04:50:48.871643+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:50:48.871643+0000","last_undegraded":"2024-09-10T04:50:48.871643+0000","last_fullsized":"2024-09-10T04:50:48.871643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:08.755472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910428+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:17.910428+0000","last_peered":"2024-09-10T04:53:17.910428+0000","last_clean":"2024-09-10T04:53:17.910428+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:17.910428+0000","last_undegraded":"2024-09-10T04:53:17.910428+0000","last_fullsized":"2024-09-10T04:53:17.910428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898545+0000","last_change":"2024-09-10T04:50:10.825749+0000","last_active":"2024-09-10T04:53:17.898545+0000","last_peered":"2024-09-10T04:53:17.898545+0000","last_clean":"2024-09-10T04:53:17.898545+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:17.898545+0000","last_undegraded":"2024-09-10T04:53:17.898545+0000","last_fullsized":"2024-09-10T04:53:17.898545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:53.153695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874420+0000","last_change":"2024-09-10T04:50:08.828799+0000","last_active":"2024-09-10T04:50:48.874420+0000","last_peered":"2024-09-10T04:50:48.874420+0000","last_clean":"2024-09-10T04:50:48.874420+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:50:48.874420+0000","last_undegraded":"2024-09-10T04:50:48.874420+0000","last_fullsized":"2024-09-10T04:50:48.874420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:51.598705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.835230+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:52:15.835230+0000","last_peered":"2024-09-10T04:52:15.835230+0000","last_clean":"2024-09-10T04:52:15.835230+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:52:15.835230+0000","last_undegraded":"2024-09-10T04:52:15.835230+0000","last_fullsized":"2024-09-10T04:52:15.835230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.073926+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:18.073926+0000","last_peered":"2024-09-10T04:53:18.073926+0000","last_clean":"2024-09-10T04:53:18.073926+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:18.073926+0000","last_undegraded":"2024-09-10T04:53:18.073926+0000","last_fullsized":"2024-09-10T04:53:18.073926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974101+0000","last_change":"2024-09-10T04:50:48.878932+0000","last_active":"2024-09-10T04:53:17.974101+0000","last_peered":"2024-09-10T04:53:17.974101+0000","last_clean":"2024-09-10T04:53:17.974101+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:17.974101+0000","last_undegraded":"2024-09-10T04:53:17.974101+0000","last_fullsized":"2024-09-10T04:53:17.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.903742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877328+0000","last_change":"2024-09-10T04:50:08.829013+0000","last_active":"2024-09-10T04:50:48.877328+0000","last_peered":"2024-09-10T04:50:48.877328+0000","last_clean":"2024-09-10T04:50:48.877328+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:50:48.877328+0000","last_undegraded":"2024-09-10T04:50:48.877328+0000","last_fullsized":"2024-09-10T04:50:48.877328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:03.087024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874784+0000","last_change":"2024-09-10T04:50:12.833519+0000","last_active":"2024-09-10T04:50:48.874784+0000","last_peered":"2024-09-10T04:50:48.874784+0000","last_clean":"2024-09-10T04:50:48.874784+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:50:48.874784+0000","last_undegraded":"2024-09-10T04:50:48.874784+0000","last_fullsized":"2024-09-10T04:50:48.874784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:32.252245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.844592+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:52:15.844592+0000","last_peered":"2024-09-10T04:52:15.844592+0000","last_clean":"2024-09-10T04:52:15.844592+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:52:15.844592+0000","last_undegraded":"2024-09-10T04:52:15.844592+0000","last_fullsized":"2024-09-10T04:52:15.844592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.964883+0000","last_change":"2024-09-10T04:50:10.826557+0000","last_active":"2024-09-10T04:50:50.964883+0000","last_peered":"2024-09-10T04:50:50.964883+0000","last_clean":"2024-09-10T04:50:50.964883+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:50:50.964883+0000","last_undegraded":"2024-09-10T04:50:50.964883+0000","last_fullsized":"2024-09-10T04:50:50.964883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:09.614984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.202264+0000","last_change":"2024-09-10T04:50:08.828183+0000","last_active":"2024-09-10T04:52:17.202264+0000","last_peered":"2024-09-10T04:52:17.202264+0000","last_clean":"2024-09-10T04:52:17.202264+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:52:17.202264+0000","last_undegraded":"2024-09-10T04:52:17.202264+0000","last_fullsized":"2024-09-10T04:52:17.202264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:30.666210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"25'1","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937623+0000","last_change":"2024-09-10T04:50:48.899617+0000","last_active":"2024-09-10T04:52:16.937623+0000","last_peered":"2024-09-10T04:52:16.937623+0000","last_clean":"2024-09-10T04:52:16.937623+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:52:16.937623+0000","last_undegraded":"2024-09-10T04:52:16.937623+0000","last_fullsized":"2024-09-10T04:52:16.937623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:52:34.876228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.824610+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:52:15.824610+0000","last_peered":"2024-09-10T04:52:15.824610+0000","last_clean":"2024-09-10T04:52:15.824610+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:52:15.824610+0000","last_undegraded":"2024-09-10T04:52:15.824610+0000","last_fullsized":"2024-09-10T04:52:15.824610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.764151+0000","last_change":"2024-09-10T04:50:10.826946+0000","last_active":"2024-09-10T04:53:17.764151+0000","last_peered":"2024-09-10T04:53:17.764151+0000","last_clean":"2024-09-10T04:53:17.764151+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:17.764151+0000","last_undegraded":"2024-09-10T04:53:17.764151+0000","last_fullsized":"2024-09-10T04:53:17.764151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:18.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877389+0000","last_change":"2024-09-10T04:50:08.837630+0000","last_active":"2024-09-10T04:50:48.877389+0000","last_peered":"2024-09-10T04:50:48.877389+0000","last_clean":"2024-09-10T04:50:48.877389+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:50:48.877389+0000","last_undegraded":"2024-09-10T04:50:48.877389+0000","last_fullsized":"2024-09-10T04:50:48.877389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:31.546596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880639+0000","last_change":"2024-09-10T04:50:48.878506+0000","last_active":"2024-09-10T04:50:48.880639+0000","last_peered":"2024-09-10T04:50:48.880639+0000","last_clean":"2024-09-10T04:50:48.880639+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:50:48.880639+0000","last_undegraded":"2024-09-10T04:50:48.880639+0000","last_fullsized":"2024-09-10T04:50:48.880639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:02.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.846385+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:52:15.846385+0000","last_peered":"2024-09-10T04:52:15.846385+0000","last_clean":"2024-09-10T04:52:15.846385+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:52:15.846385+0000","last_undegraded":"2024-09-10T04:52:15.846385+0000","last_fullsized":"2024-09-10T04:52:15.846385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.083067+0000","last_change":"2024-09-10T04:50:16.854603+0000","last_active":"2024-09-10T04:53:18.083067+0000","last_peered":"2024-09-10T04:53:18.083067+0000","last_clean":"2024-09-10T04:53:18.083067+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:53:18.083067+0000","last_undegraded":"2024-09-10T04:53:18.083067+0000","last_fullsized":"2024-09-10T04:53:18.083067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:42.247342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671118+0000","last_change":"2024-09-10T04:50:10.835108+0000","last_active":"2024-09-10T04:53:17.671118+0000","last_peered":"2024-09-10T04:53:17.671118+0000","last_clean":"2024-09-10T04:53:17.671118+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:17.671118+0000","last_undegraded":"2024-09-10T04:53:17.671118+0000","last_fullsized":"2024-09-10T04:53:17.671118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:45.228769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.517912+0000","last_change":"2024-09-10T04:50:08.829010+0000","last_active":"2024-09-10T04:51:33.517912+0000","last_peered":"2024-09-10T04:51:33.517912+0000","last_clean":"2024-09-10T04:51:33.517912+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:51:33.517912+0000","last_undegraded":"2024-09-10T04:51:33.517912+0000","last_fullsized":"2024-09-10T04:51:33.517912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:13.348983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871409+0000","last_change":"2024-09-10T04:50:12.828963+0000","last_active":"2024-09-10T04:50:48.871409+0000","last_peered":"2024-09-10T04:50:48.871409+0000","last_clean":"2024-09-10T04:50:48.871409+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:50:48.871409+0000","last_undegraded":"2024-09-10T04:50:48.871409+0000","last_fullsized":"2024-09-10T04:50:48.871409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:51.183596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.848473+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:52:15.848473+0000","last_peered":"2024-09-10T04:52:15.848473+0000","last_clean":"2024-09-10T04:52:15.848473+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:52:15.848473+0000","last_undegraded":"2024-09-10T04:52:15.848473+0000","last_fullsized":"2024-09-10T04:52:15.848473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871299+0000","last_change":"2024-09-10T04:50:16.852342+0000","last_active":"2024-09-10T04:50:48.871299+0000","last_peered":"2024-09-10T04:50:48.871299+0000","last_clean":"2024-09-10T04:50:48.871299+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:50:48.871299+0000","last_undegraded":"2024-09-10T04:50:48.871299+0000","last_fullsized":"2024-09-10T04:50:48.871299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:43.920861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:28.226751+0000","last_change":"2024-09-10T04:50:10.822366+0000","last_active":"2024-09-10T04:52:28.226751+0000","last_peered":"2024-09-10T04:52:28.226751+0000","last_clean":"2024-09-10T04:52:28.226751+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:52:28.226751+0000","last_undegraded":"2024-09-10T04:52:28.226751+0000","last_fullsized":"2024-09-10T04:52:28.226751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:25.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.884332+0000","last_change":"2024-09-10T04:50:08.845577+0000","last_active":"2024-09-10T04:50:48.884332+0000","last_peered":"2024-09-10T04:50:48.884332+0000","last_clean":"2024-09-10T04:50:48.884332+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:50:48.884332+0000","last_undegraded":"2024-09-10T04:50:48.884332+0000","last_fullsized":"2024-09-10T04:50:48.884332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:01.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872733+0000","last_change":"2024-09-10T04:50:12.826302+0000","last_active":"2024-09-10T04:50:48.872733+0000","last_peered":"2024-09-10T04:50:48.872733+0000","last_clean":"2024-09-10T04:50:48.872733+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:50:48.872733+0000","last_undegraded":"2024-09-10T04:50:48.872733+0000","last_fullsized":"2024-09-10T04:50:48.872733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:05.064578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.828772+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:52:15.828772+0000","last_peered":"2024-09-10T04:52:15.828772+0000","last_clean":"2024-09-10T04:52:15.828772+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:52:15.828772+0000","last_undegraded":"2024-09-10T04:52:15.828772+0000","last_fullsized":"2024-09-10T04:52:15.828772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702241+0000","last_change":"2024-09-10T04:50:10.826967+0000","last_active":"2024-09-10T04:50:51.702241+0000","last_peered":"2024-09-10T04:50:51.702241+0000","last_clean":"2024-09-10T04:50:51.702241+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:50:51.702241+0000","last_undegraded":"2024-09-10T04:50:51.702241+0000","last_fullsized":"2024-09-10T04:50:51.702241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:18.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875461+0000","last_change":"2024-09-10T04:50:08.828776+0000","last_active":"2024-09-10T04:50:48.875461+0000","last_peered":"2024-09-10T04:50:48.875461+0000","last_clean":"2024-09-10T04:50:48.875461+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:50:48.875461+0000","last_undegraded":"2024-09-10T04:50:48.875461+0000","last_fullsized":"2024-09-10T04:50:48.875461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:19.564788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.928233+0000","last_change":"2024-09-10T04:50:12.834219+0000","last_active":"2024-09-10T04:52:16.928233+0000","last_peered":"2024-09-10T04:52:16.928233+0000","last_clean":"2024-09-10T04:52:16.928233+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:52:16.928233+0000","last_undegraded":"2024-09-10T04:52:16.928233+0000","last_fullsized":"2024-09-10T04:52:16.928233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:03.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227534+0000","last_change":"2024-09-10T04:50:14.837587+0000","last_active":"2024-09-10T04:52:33.227534+0000","last_peered":"2024-09-10T04:52:33.227534+0000","last_clean":"2024-09-10T04:52:33.227534+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:52:33.227534+0000","last_undegraded":"2024-09-10T04:52:33.227534+0000","last_fullsized":"2024-09-10T04:52:33.227534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:07.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.064451+0000","last_change":"2024-09-10T04:50:16.854229+0000","last_active":"2024-09-10T04:53:18.064451+0000","last_peered":"2024-09-10T04:53:18.064451+0000","last_clean":"2024-09-10T04:53:18.064451+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:53:18.064451+0000","last_undegraded":"2024-09-10T04:53:18.064451+0000","last_fullsized":"2024-09-10T04:53:18.064451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:18.182840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.021671+0000","last_change":"2024-09-10T04:50:10.826497+0000","last_active":"2024-09-10T04:53:18.021671+0000","last_peered":"2024-09-10T04:53:18.021671+0000","last_clean":"2024-09-10T04:53:18.021671+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:18.021671+0000","last_undegraded":"2024-09-10T04:53:18.021671+0000","last_fullsized":"2024-09-10T04:53:18.021671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:32.092320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878748+0000","last_change":"2024-09-10T04:50:08.843627+0000","last_active":"2024-09-10T04:50:48.878748+0000","last_peered":"2024-09-10T04:50:48.878748+0000","last_clean":"2024-09-10T04:50:48.878748+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:50:48.878748+0000","last_undegraded":"2024-09-10T04:50:48.878748+0000","last_fullsized":"2024-09-10T04:50:48.878748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.987359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937306+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:52:16.937306+0000","last_peered":"2024-09-10T04:52:16.937306+0000","last_clean":"2024-09-10T04:52:16.937306+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:52:16.937306+0000","last_undegraded":"2024-09-10T04:52:16.937306+0000","last_fullsized":"2024-09-10T04:52:16.937306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":511,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.026279+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:18.026279+0000","last_peered":"2024-09-10T04:53:18.026279+0000","last_clean":"2024-09-10T04:53:18.026279+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:18.026279+0000","last_undegraded":"2024-09-10T04:53:18.026279+0000","last_fullsized":"2024-09-10T04:53:18.026279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974264+0000","last_change":"2024-09-10T04:50:10.829724+0000","last_active":"2024-09-10T04:53:17.974264+0000","last_peered":"2024-09-10T04:53:17.974264+0000","last_clean":"2024-09-10T04:53:17.974264+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:17.974264+0000","last_undegraded":"2024-09-10T04:53:17.974264+0000","last_fullsized":"2024-09-10T04:53:17.974264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:38.586579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878679+0000","last_change":"2024-09-10T04:50:08.842002+0000","last_active":"2024-09-10T04:50:48.878679+0000","last_peered":"2024-09-10T04:50:48.878679+0000","last_clean":"2024-09-10T04:50:48.878679+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:50:48.878679+0000","last_undegraded":"2024-09-10T04:50:48.878679+0000","last_fullsized":"2024-09-10T04:50:48.878679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:41.938317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883061+0000","last_change":"2024-09-10T04:50:12.829555+0000","last_active":"2024-09-10T04:50:48.883061+0000","last_peered":"2024-09-10T04:50:48.883061+0000","last_clean":"2024-09-10T04:50:48.883061+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:50:48.883061+0000","last_undegraded":"2024-09-10T04:50:48.883061+0000","last_fullsized":"2024-09-10T04:50:48.883061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:09:48.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227887+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:52:33.227887+0000","last_peered":"2024-09-10T04:52:33.227887+0000","last_clean":"2024-09-10T04:52:33.227887+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:52:33.227887+0000","last_undegraded":"2024-09-10T04:52:33.227887+0000","last_fullsized":"2024-09-10T04:52:33.227887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974080+0000","last_change":"2024-09-10T04:50:10.832812+0000","last_active":"2024-09-10T04:53:17.974080+0000","last_peered":"2024-09-10T04:53:17.974080+0000","last_clean":"2024-09-10T04:53:17.974080+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:17.974080+0000","last_undegraded":"2024-09-10T04:53:17.974080+0000","last_fullsized":"2024-09-10T04:53:17.974080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:10.931903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874246+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:48.874246+0000","last_peered":"2024-09-10T04:50:48.874246+0000","last_clean":"2024-09-10T04:50:48.874246+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:48.874246+0000","last_undegraded":"2024-09-10T04:50:48.874246+0000","last_fullsized":"2024-09-10T04:50:48.874246+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875222+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:48.875222+0000","last_peered":"2024-09-10T04:50:48.875222+0000","last_clean":"2024-09-10T04:50:48.875222+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:48.875222+0000","last_undegraded":"2024-09-10T04:50:48.875222+0000","last_fullsized":"2024-09-10T04:50:48.875222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879878+0000","last_change":"2024-09-10T04:50:08.838594+0000","last_active":"2024-09-10T04:50:48.879878+0000","last_peered":"2024-09-10T04:50:48.879878+0000","last_clean":"2024-09-10T04:50:48.879878+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:50:48.879878+0000","last_undegraded":"2024-09-10T04:50:48.879878+0000","last_fullsized":"2024-09-10T04:50:48.879878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:13.728249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876718+0000","last_change":"2024-09-10T04:50:12.831368+0000","last_active":"2024-09-10T04:50:48.876718+0000","last_peered":"2024-09-10T04:50:48.876718+0000","last_clean":"2024-09-10T04:50:48.876718+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:50:48.876718+0000","last_undegraded":"2024-09-10T04:50:48.876718+0000","last_fullsized":"2024-09-10T04:50:48.876718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:47.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.298706+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:52:17.298706+0000","last_peered":"2024-09-10T04:52:17.298706+0000","last_clean":"2024-09-10T04:52:17.298706+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:52:17.298706+0000","last_undegraded":"2024-09-10T04:52:17.298706+0000","last_fullsized":"2024-09-10T04:52:17.298706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882688+0000","last_change":"2024-09-10T04:50:10.823205+0000","last_active":"2024-09-10T04:50:48.882688+0000","last_peered":"2024-09-10T04:50:48.882688+0000","last_clean":"2024-09-10T04:50:48.882688+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:50:48.882688+0000","last_undegraded":"2024-09-10T04:50:48.882688+0000","last_fullsized":"2024-09-10T04:50:48.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:34.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874960+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:48.874960+0000","last_peered":"2024-09-10T04:50:48.874960+0000","last_clean":"2024-09-10T04:50:48.874960+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:48.874960+0000","last_undegraded":"2024-09-10T04:50:48.874960+0000","last_fullsized":"2024-09-10T04:50:48.874960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.631341+0000","last_change":"2024-09-10T04:50:08.836446+0000","last_active":"2024-09-10T04:53:17.631341+0000","last_peered":"2024-09-10T04:53:17.631341+0000","last_clean":"2024-09-10T04:53:17.631341+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:17.631341+0000","last_undegraded":"2024-09-10T04:53:17.631341+0000","last_fullsized":"2024-09-10T04:53:17.631341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878323+0000","last_change":"2024-09-10T04:50:12.829152+0000","last_active":"2024-09-10T04:50:48.878323+0000","last_peered":"2024-09-10T04:50:48.878323+0000","last_clean":"2024-09-10T04:50:48.878323+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:50:48.878323+0000","last_undegraded":"2024-09-10T04:50:48.878323+0000","last_fullsized":"2024-09-10T04:50:48.878323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:57.426370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":489,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910575+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:17.910575+0000","last_peered":"2024-09-10T04:53:17.910575+0000","last_clean":"2024-09-10T04:53:17.910575+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:17.910575+0000","last_undegraded":"2024-09-10T04:53:17.910575+0000","last_fullsized":"2024-09-10T04:53:17.910575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974004+0000","last_change":"2024-09-10T04:50:10.829015+0000","last_active":"2024-09-10T04:53:17.974004+0000","last_peered":"2024-09-10T04:53:17.974004+0000","last_clean":"2024-09-10T04:53:17.974004+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:17.974004+0000","last_undegraded":"2024-09-10T04:53:17.974004+0000","last_fullsized":"2024-09-10T04:53:17.974004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:58.709020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870077+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:48.870077+0000","last_peered":"2024-09-10T04:50:48.870077+0000","last_clean":"2024-09-10T04:50:48.870077+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:48.870077+0000","last_undegraded":"2024-09-10T04:50:48.870077+0000","last_fullsized":"2024-09-10T04:50:48.870077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874373+0000","last_change":"2024-09-10T04:50:08.847331+0000","last_active":"2024-09-10T04:50:48.874373+0000","last_peered":"2024-09-10T04:50:48.874373+0000","last_clean":"2024-09-10T04:50:48.874373+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:50:48.874373+0000","last_undegraded":"2024-09-10T04:50:48.874373+0000","last_fullsized":"2024-09-10T04:50:48.874373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.881835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874638+0000","last_change":"2024-09-10T04:50:12.825223+0000","last_active":"2024-09-10T04:50:48.874638+0000","last_peered":"2024-09-10T04:50:48.874638+0000","last_clean":"2024-09-10T04:50:48.874638+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:50:48.874638+0000","last_undegraded":"2024-09-10T04:50:48.874638+0000","last_fullsized":"2024-09-10T04:50:48.874638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:17.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910723+0000","last_change":"2024-09-10T04:50:48.893450+0000","last_active":"2024-09-10T04:53:17.910723+0000","last_peered":"2024-09-10T04:53:17.910723+0000","last_clean":"2024-09-10T04:53:17.910723+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:53:17.910723+0000","last_undegraded":"2024-09-10T04:53:17.910723+0000","last_fullsized":"2024-09-10T04:53:17.910723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:31.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.770722+0000","last_change":"2024-09-10T04:50:10.836057+0000","last_active":"2024-09-10T04:53:17.770722+0000","last_peered":"2024-09-10T04:53:17.770722+0000","last_clean":"2024-09-10T04:53:17.770722+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:17.770722+0000","last_undegraded":"2024-09-10T04:53:17.770722+0000","last_fullsized":"2024-09-10T04:53:17.770722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:55.248455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875284+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:48.875284+0000","last_peered":"2024-09-10T04:50:48.875284+0000","last_clean":"2024-09-10T04:50:48.875284+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:48.875284+0000","last_undegraded":"2024-09-10T04:50:48.875284+0000","last_fullsized":"2024-09-10T04:50:48.875284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875446+0000","last_change":"2024-09-10T04:50:08.828278+0000","last_active":"2024-09-10T04:50:48.875446+0000","last_peered":"2024-09-10T04:50:48.875446+0000","last_clean":"2024-09-10T04:50:48.875446+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:50:48.875446+0000","last_undegraded":"2024-09-10T04:50:48.875446+0000","last_fullsized":"2024-09-10T04:50:48.875446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:04.354850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877039+0000","last_change":"2024-09-10T04:50:12.829769+0000","last_active":"2024-09-10T04:50:48.877039+0000","last_peered":"2024-09-10T04:50:48.877039+0000","last_clean":"2024-09-10T04:50:48.877039+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:50:48.877039+0000","last_undegraded":"2024-09-10T04:50:48.877039+0000","last_fullsized":"2024-09-10T04:50:48.877039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:09.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876234+0000","last_change":"2024-09-10T04:50:10.829364+0000","last_active":"2024-09-10T04:50:48.876234+0000","last_peered":"2024-09-10T04:50:48.876234+0000","last_clean":"2024-09-10T04:50:48.876234+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:50:48.876234+0000","last_undegraded":"2024-09-10T04:50:48.876234+0000","last_fullsized":"2024-09-10T04:50:48.876234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.090089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877512+0000","last_change":"2024-09-10T04:50:08.837043+0000","last_active":"2024-09-10T04:50:48.877512+0000","last_peered":"2024-09-10T04:50:48.877512+0000","last_clean":"2024-09-10T04:50:48.877512+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:50:48.877512+0000","last_undegraded":"2024-09-10T04:50:48.877512+0000","last_fullsized":"2024-09-10T04:50:48.877512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:17.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877579+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:48.877579+0000","last_peered":"2024-09-10T04:50:48.877579+0000","last_clean":"2024-09-10T04:50:48.877579+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:48.877579+0000","last_undegraded":"2024-09-10T04:50:48.877579+0000","last_fullsized":"2024-09-10T04:50:48.877579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224774+0000","last_change":"2024-09-10T04:50:12.830001+0000","last_active":"2024-09-10T04:52:18.224774+0000","last_peered":"2024-09-10T04:52:18.224774+0000","last_clean":"2024-09-10T04:52:18.224774+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:52:18.224774+0000","last_undegraded":"2024-09-10T04:52:18.224774+0000","last_fullsized":"2024-09-10T04:52:18.224774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:30.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224683+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:52:18.224683+0000","last_peered":"2024-09-10T04:52:18.224683+0000","last_clean":"2024-09-10T04:52:18.224683+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:52:18.224683+0000","last_undegraded":"2024-09-10T04:52:18.224683+0000","last_fullsized":"2024-09-10T04:52:18.224683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296859+0000","last_change":"2024-09-10T04:50:48.895495+0000","last_active":"2024-09-10T04:52:17.296859+0000","last_peered":"2024-09-10T04:52:17.296859+0000","last_clean":"2024-09-10T04:52:17.296859+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:52:17.296859+0000","last_undegraded":"2024-09-10T04:52:17.296859+0000","last_fullsized":"2024-09-10T04:52:17.296859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:15.353442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878026+0000","last_change":"2024-09-10T04:50:08.836453+0000","last_active":"2024-09-10T04:50:48.878026+0000","last_peered":"2024-09-10T04:50:48.878026+0000","last_clean":"2024-09-10T04:50:48.878026+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:50:48.878026+0000","last_undegraded":"2024-09-10T04:50:48.878026+0000","last_fullsized":"2024-09-10T04:50:48.878026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:00.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877301+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:48.877301+0000","last_peered":"2024-09-10T04:50:48.877301+0000","last_clean":"2024-09-10T04:50:48.877301+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:48.877301+0000","last_undegraded":"2024-09-10T04:50:48.877301+0000","last_fullsized":"2024-09-10T04:50:48.877301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910637+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:17.910637+0000","last_peered":"2024-09-10T04:53:17.910637+0000","last_clean":"2024-09-10T04:53:17.910637+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:17.910637+0000","last_undegraded":"2024-09-10T04:53:17.910637+0000","last_fullsized":"2024-09-10T04:53:17.910637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949075+0000","last_change":"2024-09-10T04:50:10.836157+0000","last_active":"2024-09-10T04:53:17.949075+0000","last_peered":"2024-09-10T04:53:17.949075+0000","last_clean":"2024-09-10T04:53:17.949075+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:17.949075+0000","last_undegraded":"2024-09-10T04:53:17.949075+0000","last_fullsized":"2024-09-10T04:53:17.949075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:51:54.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881873+0000","last_change":"2024-09-10T04:50:08.846597+0000","last_active":"2024-09-10T04:50:48.881873+0000","last_peered":"2024-09-10T04:50:48.881873+0000","last_clean":"2024-09-10T04:50:48.881873+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:50:48.881873+0000","last_undegraded":"2024-09-10T04:50:48.881873+0000","last_fullsized":"2024-09-10T04:50:48.881873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:30.509630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878039+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:48.878039+0000","last_peered":"2024-09-10T04:50:48.878039+0000","last_clean":"2024-09-10T04:50:48.878039+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:48.878039+0000","last_undegraded":"2024-09-10T04:50:48.878039+0000","last_fullsized":"2024-09-10T04:50:48.878039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875429+0000","last_change":"2024-09-10T04:50:12.828001+0000","last_active":"2024-09-10T04:50:48.875429+0000","last_peered":"2024-09-10T04:50:48.875429+0000","last_clean":"2024-09-10T04:50:48.875429+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:50:48.875429+0000","last_undegraded":"2024-09-10T04:50:48.875429+0000","last_fullsized":"2024-09-10T04:50:48.875429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:19.857340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.061187+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:18.061187+0000","last_peered":"2024-09-10T04:53:18.061187+0000","last_clean":"2024-09-10T04:53:18.061187+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:18.061187+0000","last_undegraded":"2024-09-10T04:53:18.061187+0000","last_fullsized":"2024-09-10T04:53:18.061187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296426+0000","last_change":"2024-09-10T04:50:10.825130+0000","last_active":"2024-09-10T04:52:17.296426+0000","last_peered":"2024-09-10T04:52:17.296426+0000","last_clean":"2024-09-10T04:52:17.296426+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:52:17.296426+0000","last_undegraded":"2024-09-10T04:52:17.296426+0000","last_fullsized":"2024-09-10T04:52:17.296426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:52.976061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.589847+0000","last_change":"2024-09-10T04:50:08.837605+0000","last_active":"2024-09-10T04:50:50.589847+0000","last_peered":"2024-09-10T04:50:50.589847+0000","last_clean":"2024-09-10T04:50:50.589847+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:50:50.589847+0000","last_undegraded":"2024-09-10T04:50:50.589847+0000","last_fullsized":"2024-09-10T04:50:50.589847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:53.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878172+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:48.878172+0000","last_peered":"2024-09-10T04:50:48.878172+0000","last_clean":"2024-09-10T04:50:48.878172+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:48.878172+0000","last_undegraded":"2024-09-10T04:50:48.878172+0000","last_fullsized":"2024-09-10T04:50:48.878172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881108+0000","last_change":"2024-09-10T04:50:12.833099+0000","last_active":"2024-09-10T04:50:48.881108+0000","last_peered":"2024-09-10T04:50:48.881108+0000","last_clean":"2024-09-10T04:50:48.881108+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:50:48.881108+0000","last_undegraded":"2024-09-10T04:50:48.881108+0000","last_fullsized":"2024-09-10T04:50:48.881108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:10.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.839664+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:52:15.839664+0000","last_peered":"2024-09-10T04:52:15.839664+0000","last_clean":"2024-09-10T04:52:15.839664+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:52:15.839664+0000","last_undegraded":"2024-09-10T04:52:15.839664+0000","last_fullsized":"2024-09-10T04:52:15.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.231272+0000","last_change":"2024-09-10T04:50:10.824890+0000","last_active":"2024-09-10T04:50:51.231272+0000","last_peered":"2024-09-10T04:50:51.231272+0000","last_clean":"2024-09-10T04:50:51.231272+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:50:51.231272+0000","last_undegraded":"2024-09-10T04:50:51.231272+0000","last_fullsized":"2024-09-10T04:50:51.231272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.915338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875830+0000","last_change":"2024-09-10T04:50:08.827991+0000","last_active":"2024-09-10T04:50:48.875830+0000","last_peered":"2024-09-10T04:50:48.875830+0000","last_clean":"2024-09-10T04:50:48.875830+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:50:48.875830+0000","last_undegraded":"2024-09-10T04:50:48.875830+0000","last_fullsized":"2024-09-10T04:50:48.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:27.065767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873861+0000","last_change":"2024-09-10T04:50:12.833107+0000","last_active":"2024-09-10T04:50:48.873861+0000","last_peered":"2024-09-10T04:50:48.873861+0000","last_clean":"2024-09-10T04:50:48.873861+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:50:48.873861+0000","last_undegraded":"2024-09-10T04:50:48.873861+0000","last_fullsized":"2024-09-10T04:50:48.873861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:21.150621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.845543+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:52:15.845543+0000","last_peered":"2024-09-10T04:52:15.845543+0000","last_clean":"2024-09-10T04:52:15.845543+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:52:15.845543+0000","last_undegraded":"2024-09-10T04:52:15.845543+0000","last_fullsized":"2024-09-10T04:52:15.845543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.701581+0000","last_change":"2024-09-10T04:50:10.829358+0000","last_active":"2024-09-10T04:50:51.701581+0000","last_peered":"2024-09-10T04:50:51.701581+0000","last_clean":"2024-09-10T04:50:51.701581+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:50:51.701581+0000","last_undegraded":"2024-09-10T04:50:51.701581+0000","last_fullsized":"2024-09-10T04:50:51.701581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871928+0000","last_change":"2024-09-10T04:50:08.844912+0000","last_active":"2024-09-10T04:50:48.871928+0000","last_peered":"2024-09-10T04:50:48.871928+0000","last_clean":"2024-09-10T04:50:48.871928+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:50:48.871928+0000","last_undegraded":"2024-09-10T04:50:48.871928+0000","last_fullsized":"2024-09-10T04:50:48.871928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:44.401270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872992+0000","last_change":"2024-09-10T04:50:16.850075+0000","last_active":"2024-09-10T04:50:48.872992+0000","last_peered":"2024-09-10T04:50:48.872992+0000","last_clean":"2024-09-10T04:50:48.872992+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:50:48.872992+0000","last_undegraded":"2024-09-10T04:50:48.872992+0000","last_fullsized":"2024-09-10T04:50:48.872992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:56:01.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.615428+0000","last_change":"2024-09-10T04:50:10.820033+0000","last_active":"2024-09-10T04:50:50.615428+0000","last_peered":"2024-09-10T04:50:50.615428+0000","last_clean":"2024-09-10T04:50:50.615428+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:50:50.615428+0000","last_undegraded":"2024-09-10T04:50:50.615428+0000","last_fullsized":"2024-09-10T04:50:50.615428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:57.856874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877343+0000","last_change":"2024-09-10T04:50:08.836435+0000","last_active":"2024-09-10T04:50:48.877343+0000","last_peered":"2024-09-10T04:50:48.877343+0000","last_clean":"2024-09-10T04:50:48.877343+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:50:48.877343+0000","last_undegraded":"2024-09-10T04:50:48.877343+0000","last_fullsized":"2024-09-10T04:50:48.877343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:00:09.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.369040+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:17.369040+0000","last_peered":"2024-09-10T04:53:17.369040+0000","last_clean":"2024-09-10T04:53:17.369040+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:17.369040+0000","last_undegraded":"2024-09-10T04:53:17.369040+0000","last_fullsized":"2024-09-10T04:53:17.369040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898536+0000","last_change":"2024-09-10T04:50:10.834917+0000","last_active":"2024-09-10T04:53:17.898536+0000","last_peered":"2024-09-10T04:53:17.898536+0000","last_clean":"2024-09-10T04:53:17.898536+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:17.898536+0000","last_undegraded":"2024-09-10T04:53:17.898536+0000","last_fullsized":"2024-09-10T04:53:17.898536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.969513+0000","last_change":"2024-09-10T04:50:08.848711+0000","last_active":"2024-09-10T04:53:17.969513+0000","last_peered":"2024-09-10T04:53:17.969513+0000","last_clean":"2024-09-10T04:53:17.969513+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:17.969513+0000","last_undegraded":"2024-09-10T04:53:17.969513+0000","last_fullsized":"2024-09-10T04:53:17.969513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:39.749808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.830813+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:52:15.830813+0000","last_peered":"2024-09-10T04:52:15.830813+0000","last_clean":"2024-09-10T04:52:15.830813+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:52:15.830813+0000","last_undegraded":"2024-09-10T04:52:15.830813+0000","last_fullsized":"2024-09-10T04:52:15.830813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878107+0000","last_change":"2024-09-10T04:50:10.826794+0000","last_active":"2024-09-10T04:50:48.878107+0000","last_peered":"2024-09-10T04:50:48.878107+0000","last_clean":"2024-09-10T04:50:48.878107+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:50:48.878107+0000","last_undegraded":"2024-09-10T04:50:48.878107+0000","last_fullsized":"2024-09-10T04:50:48.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:52.554993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.119492+0000","last_change":"2024-09-10T04:50:08.841684+0000","last_active":"2024-09-10T04:50:50.119492+0000","last_peered":"2024-09-10T04:50:50.119492+0000","last_clean":"2024-09-10T04:50:50.119492+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:50:50.119492+0000","last_undegraded":"2024-09-10T04:50:50.119492+0000","last_fullsized":"2024-09-10T04:50:50.119492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:23.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.851860+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:52:15.851860+0000","last_peered":"2024-09-10T04:52:15.851860+0000","last_clean":"2024-09-10T04:52:15.851860+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:52:15.851860+0000","last_undegraded":"2024-09-10T04:52:15.851860+0000","last_fullsized":"2024-09-10T04:52:15.851860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":69,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898584+0000","last_change":"2024-09-10T04:50:10.832030+0000","last_active":"2024-09-10T04:53:17.898584+0000","last_peered":"2024-09-10T04:53:17.898584+0000","last_clean":"2024-09-10T04:53:17.898584+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:17.898584+0000","last_undegraded":"2024-09-10T04:53:17.898584+0000","last_fullsized":"2024-09-10T04:53:17.898584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:06.264467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873902+0000","last_change":"2024-09-10T04:50:08.848820+0000","last_active":"2024-09-10T04:50:48.873902+0000","last_peered":"2024-09-10T04:50:48.873902+0000","last_clean":"2024-09-10T04:50:48.873902+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:50:48.873902+0000","last_undegraded":"2024-09-10T04:50:48.873902+0000","last_fullsized":"2024-09-10T04:50:48.873902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:38.304965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.831889+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:52:15.831889+0000","last_peered":"2024-09-10T04:52:15.831889+0000","last_clean":"2024-09-10T04:52:15.831889+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:52:15.831889+0000","last_undegraded":"2024-09-10T04:52:15.831889+0000","last_fullsized":"2024-09-10T04:52:15.831889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881759+0000","last_change":"2024-09-10T04:50:10.829229+0000","last_active":"2024-09-10T04:50:48.881759+0000","last_peered":"2024-09-10T04:50:48.881759+0000","last_clean":"2024-09-10T04:50:48.881759+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:50:48.881759+0000","last_undegraded":"2024-09-10T04:50:48.881759+0000","last_fullsized":"2024-09-10T04:50:48.881759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.888344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.135770+0000","last_change":"2024-09-10T04:50:08.829094+0000","last_active":"2024-09-10T04:52:17.135770+0000","last_peered":"2024-09-10T04:52:17.135770+0000","last_clean":"2024-09-10T04:52:17.135770+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:52:17.135770+0000","last_undegraded":"2024-09-10T04:52:17.135770+0000","last_fullsized":"2024-09-10T04:52:17.135770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:06.234076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.849560+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:52:15.849560+0000","last_peered":"2024-09-10T04:52:15.849560+0000","last_clean":"2024-09-10T04:52:15.849560+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:52:15.849560+0000","last_undegraded":"2024-09-10T04:52:15.849560+0000","last_fullsized":"2024-09-10T04:52:15.849560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980768+0000","last_change":"2024-09-10T04:50:10.833243+0000","last_active":"2024-09-10T04:53:17.980768+0000","last_peered":"2024-09-10T04:53:17.980768+0000","last_clean":"2024-09-10T04:53:17.980768+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:17.980768+0000","last_undegraded":"2024-09-10T04:53:17.980768+0000","last_fullsized":"2024-09-10T04:53:17.980768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:23.713893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883823+0000","last_change":"2024-09-10T04:50:08.845251+0000","last_active":"2024-09-10T04:50:48.883823+0000","last_peered":"2024-09-10T04:50:48.883823+0000","last_clean":"2024-09-10T04:50:48.883823+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:50:48.883823+0000","last_undegraded":"2024-09-10T04:50:48.883823+0000","last_fullsized":"2024-09-10T04:50:48.883823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:49.213273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910364+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:17.910364+0000","last_peered":"2024-09-10T04:53:17.910364+0000","last_clean":"2024-09-10T04:53:17.910364+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:17.910364+0000","last_undegraded":"2024-09-10T04:53:17.910364+0000","last_fullsized":"2024-09-10T04:53:17.910364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203867+0000","last_change":"2024-09-10T04:50:10.831574+0000","last_active":"2024-09-10T04:52:14.203867+0000","last_peered":"2024-09-10T04:52:14.203867+0000","last_clean":"2024-09-10T04:52:14.203867+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:52:14.203867+0000","last_undegraded":"2024-09-10T04:52:14.203867+0000","last_fullsized":"2024-09-10T04:52:14.203867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:00.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228408+0000","last_change":"2024-09-10T04:50:08.847637+0000","last_active":"2024-09-10T04:52:38.228408+0000","last_peered":"2024-09-10T04:52:38.228408+0000","last_clean":"2024-09-10T04:52:38.228408+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:52:38.228408+0000","last_undegraded":"2024-09-10T04:52:38.228408+0000","last_fullsized":"2024-09-10T04:52:38.228408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:06.730845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874087+0000","last_change":"2024-09-10T04:50:12.834537+0000","last_active":"2024-09-10T04:50:48.874087+0000","last_peered":"2024-09-10T04:50:48.874087+0000","last_clean":"2024-09-10T04:50:48.874087+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:50:48.874087+0000","last_undegraded":"2024-09-10T04:50:48.874087+0000","last_fullsized":"2024-09-10T04:50:48.874087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:56.571156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:43.229803+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:52:43.229803+0000","last_peered":"2024-09-10T04:52:43.229803+0000","last_clean":"2024-09-10T04:52:43.229803+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:52:43.229803+0000","last_undegraded":"2024-09-10T04:52:43.229803+0000","last_fullsized":"2024-09-10T04:52:43.229803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.673337+0000","last_change":"2024-09-10T04:50:10.827125+0000","last_active":"2024-09-10T04:53:17.673337+0000","last_peered":"2024-09-10T04:53:17.673337+0000","last_clean":"2024-09-10T04:53:17.673337+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:17.673337+0000","last_undegraded":"2024-09-10T04:53:17.673337+0000","last_fullsized":"2024-09-10T04:53:17.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:39.825343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876983+0000","last_change":"2024-09-10T04:50:08.838072+0000","last_active":"2024-09-10T04:50:48.876983+0000","last_peered":"2024-09-10T04:50:48.876983+0000","last_clean":"2024-09-10T04:50:48.876983+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:50:48.876983+0000","last_undegraded":"2024-09-10T04:50:48.876983+0000","last_fullsized":"2024-09-10T04:50:48.876983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:05.923861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.823561+0000","last_change":"2024-09-10T04:50:14.845070+0000","last_active":"2024-09-10T04:52:15.823561+0000","last_peered":"2024-09-10T04:52:15.823561+0000","last_clean":"2024-09-10T04:52:15.823561+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:52:15.823561+0000","last_undegraded":"2024-09-10T04:52:15.823561+0000","last_fullsized":"2024-09-10T04:52:15.823561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:53.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974120+0000","last_change":"2024-09-10T04:50:10.826976+0000","last_active":"2024-09-10T04:53:17.974120+0000","last_peered":"2024-09-10T04:53:17.974120+0000","last_clean":"2024-09-10T04:53:17.974120+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:53:17.974120+0000","last_undegraded":"2024-09-10T04:53:17.974120+0000","last_fullsized":"2024-09-10T04:53:17.974120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:07.818212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881536+0000","last_change":"2024-09-10T04:50:08.840484+0000","last_active":"2024-09-10T04:50:48.881536+0000","last_peered":"2024-09-10T04:50:48.881536+0000","last_clean":"2024-09-10T04:50:48.881536+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:50:48.881536+0000","last_undegraded":"2024-09-10T04:50:48.881536+0000","last_fullsized":"2024-09-10T04:50:48.881536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:38.776585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874056+0000","last_change":"2024-09-10T04:50:12.834557+0000","last_active":"2024-09-10T04:50:48.874056+0000","last_peered":"2024-09-10T04:50:48.874056+0000","last_clean":"2024-09-10T04:50:48.874056+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:50:48.874056+0000","last_undegraded":"2024-09-10T04:50:48.874056+0000","last_fullsized":"2024-09-10T04:50:48.874056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:02.966548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:48.230344+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:52:48.230344+0000","last_peered":"2024-09-10T04:52:48.230344+0000","last_clean":"2024-09-10T04:52:48.230344+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:52:48.230344+0000","last_undegraded":"2024-09-10T04:52:48.230344+0000","last_fullsized":"2024-09-10T04:52:48.230344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954522+0000","last_change":"2024-09-10T04:50:48.883931+0000","last_active":"2024-09-10T04:53:17.954522+0000","last_peered":"2024-09-10T04:53:17.954522+0000","last_clean":"2024-09-10T04:53:17.954522+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:17.954522+0000","last_undegraded":"2024-09-10T04:53:17.954522+0000","last_fullsized":"2024-09-10T04:53:17.954522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:24.168136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879567+0000","last_change":"2024-09-10T04:50:08.849572+0000","last_active":"2024-09-10T04:50:48.879567+0000","last_peered":"2024-09-10T04:50:48.879567+0000","last_clean":"2024-09-10T04:50:48.879567+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:50:48.879567+0000","last_undegraded":"2024-09-10T04:50:48.879567+0000","last_fullsized":"2024-09-10T04:50:48.879567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:35.230547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.535579+0000","last_change":"2024-09-10T04:50:48.897508+0000","last_active":"2024-09-10T04:52:14.535579+0000","last_peered":"2024-09-10T04:52:14.535579+0000","last_clean":"2024-09-10T04:52:14.535579+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:52:14.535579+0000","last_undegraded":"2024-09-10T04:52:14.535579+0000","last_fullsized":"2024-09-10T04:52:14.535579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:16.163407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.315908+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:17.315908+0000","last_peered":"2024-09-10T04:53:17.315908+0000","last_clean":"2024-09-10T04:53:17.315908+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:17.315908+0000","last_undegraded":"2024-09-10T04:53:17.315908+0000","last_fullsized":"2024-09-10T04:53:17.315908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296217+0000","last_change":"2024-09-10T04:50:10.831509+0000","last_active":"2024-09-10T04:52:17.296217+0000","last_peered":"2024-09-10T04:52:17.296217+0000","last_clean":"2024-09-10T04:52:17.296217+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:52:17.296217+0000","last_undegraded":"2024-09-10T04:52:17.296217+0000","last_fullsized":"2024-09-10T04:52:17.296217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:08.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871169+0000","last_change":"2024-09-10T04:50:08.856704+0000","last_active":"2024-09-10T04:50:48.871169+0000","last_peered":"2024-09-10T04:50:48.871169+0000","last_clean":"2024-09-10T04:50:48.871169+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:50:48.871169+0000","last_undegraded":"2024-09-10T04:50:48.871169+0000","last_fullsized":"2024-09-10T04:50:48.871169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:15.081087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.204249+0000","last_change":"2024-09-10T04:50:10.835492+0000","last_active":"2024-09-10T04:52:14.204249+0000","last_peered":"2024-09-10T04:52:14.204249+0000","last_clean":"2024-09-10T04:52:14.204249+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:52:14.204249+0000","last_undegraded":"2024-09-10T04:52:14.204249+0000","last_fullsized":"2024-09-10T04:52:14.204249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.215580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870244+0000","last_change":"2024-09-10T04:50:08.856062+0000","last_active":"2024-09-10T04:50:48.870244+0000","last_peered":"2024-09-10T04:50:48.870244+0000","last_clean":"2024-09-10T04:50:48.870244+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:50:48.870244+0000","last_undegraded":"2024-09-10T04:50:48.870244+0000","last_fullsized":"2024-09-10T04:50:48.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:44.016447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.527212+0000","last_change":"2024-09-10T04:50:10.827487+0000","last_active":"2024-09-10T04:51:33.527212+0000","last_peered":"2024-09-10T04:51:33.527212+0000","last_clean":"2024-09-10T04:51:33.527212+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:51:33.527212+0000","last_undegraded":"2024-09-10T04:51:33.527212+0000","last_fullsized":"2024-09-10T04:51:33.527212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:31.140771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.189762+0000","last_change":"2024-09-10T04:50:08.839647+0000","last_active":"2024-09-10T04:52:14.189762+0000","last_peered":"2024-09-10T04:52:14.189762+0000","last_clean":"2024-09-10T04:52:14.189762+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:52:14.189762+0000","last_undegraded":"2024-09-10T04:52:14.189762+0000","last_fullsized":"2024-09-10T04:52:14.189762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:50.972996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.297469+0000","last_change":"2024-09-10T04:50:10.836518+0000","last_active":"2024-09-10T04:52:17.297469+0000","last_peered":"2024-09-10T04:52:17.297469+0000","last_clean":"2024-09-10T04:52:17.297469+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:52:17.297469+0000","last_undegraded":"2024-09-10T04:52:17.297469+0000","last_fullsized":"2024-09-10T04:52:17.297469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:31.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.887688+0000","last_change":"2024-09-10T04:50:08.840487+0000","last_active":"2024-09-10T04:53:17.887688+0000","last_peered":"2024-09-10T04:53:17.887688+0000","last_clean":"2024-09-10T04:53:17.887688+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:17.887688+0000","last_undegraded":"2024-09-10T04:53:17.887688+0000","last_fullsized":"2024-09-10T04:53:17.887688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:15.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949045+0000","last_change":"2024-09-10T04:50:10.819238+0000","last_active":"2024-09-10T04:53:17.949045+0000","last_peered":"2024-09-10T04:53:17.949045+0000","last_clean":"2024-09-10T04:53:17.949045+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:53:17.949045+0000","last_undegraded":"2024-09-10T04:53:17.949045+0000","last_fullsized":"2024-09-10T04:53:17.949045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.471522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883009+0000","last_change":"2024-09-10T04:50:08.841048+0000","last_active":"2024-09-10T04:50:48.883009+0000","last_peered":"2024-09-10T04:50:48.883009+0000","last_clean":"2024-09-10T04:50:48.883009+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:50:48.883009+0000","last_undegraded":"2024-09-10T04:50:48.883009+0000","last_fullsized":"2024-09-10T04:50:48.883009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.225704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203735+0000","last_change":"2024-09-10T04:50:10.831470+0000","last_active":"2024-09-10T04:52:14.203735+0000","last_peered":"2024-09-10T04:52:14.203735+0000","last_clean":"2024-09-10T04:52:14.203735+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:52:14.203735+0000","last_undegraded":"2024-09-10T04:52:14.203735+0000","last_fullsized":"2024-09-10T04:52:14.203735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.221117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.884302+0000","last_change":"2024-09-10T04:50:08.846442+0000","last_active":"2024-09-10T04:53:17.884302+0000","last_peered":"2024-09-10T04:53:17.884302+0000","last_clean":"2024-09-10T04:53:17.884302+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:17.884302+0000","last_undegraded":"2024-09-10T04:53:17.884302+0000","last_fullsized":"2024-09-10T04:53:17.884302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:16.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946963+0000","last_change":"2024-09-10T04:50:10.827486+0000","last_active":"2024-09-10T04:53:17.946963+0000","last_peered":"2024-09-10T04:53:17.946963+0000","last_clean":"2024-09-10T04:53:17.946963+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:53:17.946963+0000","last_undegraded":"2024-09-10T04:53:17.946963+0000","last_fullsized":"2024-09-10T04:53:17.946963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:33.726146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224842+0000","last_change":"2024-09-10T04:50:08.844203+0000","last_active":"2024-09-10T04:52:18.224842+0000","last_peered":"2024-09-10T04:52:18.224842+0000","last_clean":"2024-09-10T04:52:18.224842+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:52:18.224842+0000","last_undegraded":"2024-09-10T04:52:18.224842+0000","last_fullsized":"2024-09-10T04:52:18.224842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:18.749197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974089+0000","last_change":"2024-09-10T04:50:10.827432+0000","last_active":"2024-09-10T04:53:17.974089+0000","last_peered":"2024-09-10T04:53:17.974089+0000","last_clean":"2024-09-10T04:53:17.974089+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:17.974089+0000","last_undegraded":"2024-09-10T04:53:17.974089+0000","last_fullsized":"2024-09-10T04:53:17.974089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.651962+0000","last_change":"2024-09-10T04:50:08.846314+0000","last_active":"2024-09-10T04:53:17.651962+0000","last_peered":"2024-09-10T04:53:17.651962+0000","last_clean":"2024-09-10T04:53:17.651962+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:17.651962+0000","last_undegraded":"2024-09-10T04:53:17.651962+0000","last_fullsized":"2024-09-10T04:53:17.651962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:46.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898539+0000","last_change":"2024-09-10T04:50:10.835695+0000","last_active":"2024-09-10T04:53:17.898539+0000","last_peered":"2024-09-10T04:53:17.898539+0000","last_clean":"2024-09-10T04:53:17.898539+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:17.898539+0000","last_undegraded":"2024-09-10T04:53:17.898539+0000","last_fullsized":"2024-09-10T04:53:17.898539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:38.631225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878570+0000","last_change":"2024-09-10T04:50:08.839014+0000","last_active":"2024-09-10T04:50:48.878570+0000","last_peered":"2024-09-10T04:50:48.878570+0000","last_clean":"2024-09-10T04:50:48.878570+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:50:48.878570+0000","last_undegraded":"2024-09-10T04:50:48.878570+0000","last_fullsized":"2024-09-10T04:50:48.878570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:44.696031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898521+0000","last_change":"2024-09-10T04:50:10.829938+0000","last_active":"2024-09-10T04:53:17.898521+0000","last_peered":"2024-09-10T04:53:17.898521+0000","last_clean":"2024-09-10T04:53:17.898521+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:53:17.898521+0000","last_undegraded":"2024-09-10T04:53:17.898521+0000","last_fullsized":"2024-09-10T04:53:17.898521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.656906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878982+0000","last_change":"2024-09-10T04:50:08.840107+0000","last_active":"2024-09-10T04:50:48.878982+0000","last_peered":"2024-09-10T04:50:48.878982+0000","last_clean":"2024-09-10T04:50:48.878982+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:50:48.878982+0000","last_undegraded":"2024-09-10T04:50:48.878982+0000","last_fullsized":"2024-09-10T04:50:48.878982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:13.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296935+0000","last_change":"2024-09-10T04:50:10.831991+0000","last_active":"2024-09-10T04:52:17.296935+0000","last_peered":"2024-09-10T04:52:17.296935+0000","last_clean":"2024-09-10T04:52:17.296935+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:52:17.296935+0000","last_undegraded":"2024-09-10T04:52:17.296935+0000","last_fullsized":"2024-09-10T04:52:17.296935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:15.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.226174+0000","last_change":"2024-09-10T04:50:08.837010+0000","last_active":"2024-09-10T04:52:23.226174+0000","last_peered":"2024-09-10T04:52:23.226174+0000","last_clean":"2024-09-10T04:52:23.226174+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:52:23.226174+0000","last_undegraded":"2024-09-10T04:52:23.226174+0000","last_fullsized":"2024-09-10T04:52:23.226174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.112191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.947710+0000","last_change":"2024-09-10T04:50:10.829211+0000","last_active":"2024-09-10T04:53:17.947710+0000","last_peered":"2024-09-10T04:53:17.947710+0000","last_clean":"2024-09-10T04:53:17.947710+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:17.947710+0000","last_undegraded":"2024-09-10T04:53:17.947710+0000","last_fullsized":"2024-09-10T04:53:17.947710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:38.433783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875118+0000","last_change":"2024-09-10T04:50:08.848180+0000","last_active":"2024-09-10T04:50:48.875118+0000","last_peered":"2024-09-10T04:50:48.875118+0000","last_clean":"2024-09-10T04:50:48.875118+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:50:48.875118+0000","last_undegraded":"2024-09-10T04:50:48.875118+0000","last_fullsized":"2024-09-10T04:50:48.875118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:10.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949266+0000","last_change":"2024-09-10T04:50:10.826724+0000","last_active":"2024-09-10T04:53:17.949266+0000","last_peered":"2024-09-10T04:53:17.949266+0000","last_clean":"2024-09-10T04:53:17.949266+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:17.949266+0000","last_undegraded":"2024-09-10T04:53:17.949266+0000","last_fullsized":"2024-09-10T04:53:17.949266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:23.940844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883171+0000","last_change":"2024-09-10T04:50:08.841143+0000","last_active":"2024-09-10T04:50:48.883171+0000","last_peered":"2024-09-10T04:50:48.883171+0000","last_clean":"2024-09-10T04:50:48.883171+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:50:48.883171+0000","last_undegraded":"2024-09-10T04:50:48.883171+0000","last_fullsized":"2024-09-10T04:50:48.883171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946926+0000","last_change":"2024-09-10T04:50:10.829656+0000","last_active":"2024-09-10T04:53:17.946926+0000","last_peered":"2024-09-10T04:53:17.946926+0000","last_clean":"2024-09-10T04:53:17.946926+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:17.946926+0000","last_undegraded":"2024-09-10T04:53:17.946926+0000","last_fullsized":"2024-09-10T04:53:17.946926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.419467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.117840+0000","last_change":"2024-09-10T04:50:08.841015+0000","last_active":"2024-09-10T04:50:50.117840+0000","last_peered":"2024-09-10T04:50:50.117840+0000","last_clean":"2024-09-10T04:50:50.117840+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:50:50.117840+0000","last_undegraded":"2024-09-10T04:50:50.117840+0000","last_fullsized":"2024-09-10T04:50:50.117840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:30.089256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.965106+0000","last_change":"2024-09-10T04:50:10.827238+0000","last_active":"2024-09-10T04:50:50.965106+0000","last_peered":"2024-09-10T04:50:50.965106+0000","last_clean":"2024-09-10T04:50:50.965106+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:50:50.965106+0000","last_undegraded":"2024-09-10T04:50:50.965106+0000","last_fullsized":"2024-09-10T04:50:50.965106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:11.286717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873207+0000","last_change":"2024-09-10T04:50:08.843693+0000","last_active":"2024-09-10T04:50:48.873207+0000","last_peered":"2024-09-10T04:50:48.873207+0000","last_clean":"2024-09-10T04:50:48.873207+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:50:48.873207+0000","last_undegraded":"2024-09-10T04:50:48.873207+0000","last_fullsized":"2024-09-10T04:50:48.873207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:17.375028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.905075+0000","last_change":"2024-09-10T04:50:10.827173+0000","last_active":"2024-09-10T04:53:17.905075+0000","last_peered":"2024-09-10T04:53:17.905075+0000","last_clean":"2024-09-10T04:53:17.905075+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:17.905075+0000","last_undegraded":"2024-09-10T04:53:17.905075+0000","last_fullsized":"2024-09-10T04:53:17.905075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:28.319087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882780+0000","last_change":"2024-09-10T04:50:08.841506+0000","last_active":"2024-09-10T04:50:48.882780+0000","last_peered":"2024-09-10T04:50:48.882780+0000","last_clean":"2024-09-10T04:50:48.882780+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:50:48.882780+0000","last_undegraded":"2024-09-10T04:50:48.882780+0000","last_fullsized":"2024-09-10T04:50:48.882780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:11.919356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874624+0000","last_change":"2024-09-10T04:50:08.828047+0000","last_active":"2024-09-10T04:50:48.874624+0000","last_peered":"2024-09-10T04:50:48.874624+0000","last_clean":"2024-09-10T04:50:48.874624+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:50:48.874624+0000","last_undegraded":"2024-09-10T04:50:48.874624+0000","last_fullsized":"2024-09-10T04:50:48.874624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:53.770216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974118+0000","last_change":"2024-09-10T04:50:10.831624+0000","last_active":"2024-09-10T04:53:17.974118+0000","last_peered":"2024-09-10T04:53:17.974118+0000","last_clean":"2024-09-10T04:53:17.974118+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:17.974118+0000","last_undegraded":"2024-09-10T04:53:17.974118+0000","last_fullsized":"2024-09-10T04:53:17.974118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:40.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.275559+0000","last_change":"2024-09-10T04:50:08.848380+0000","last_active":"2024-09-10T04:52:17.275559+0000","last_peered":"2024-09-10T04:52:17.275559+0000","last_clean":"2024-09-10T04:52:17.275559+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:52:17.275559+0000","last_undegraded":"2024-09-10T04:52:17.275559+0000","last_fullsized":"2024-09-10T04:52:17.275559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.809904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.904798+0000","last_change":"2024-09-10T04:50:10.833818+0000","last_active":"2024-09-10T04:53:17.904798+0000","last_peered":"2024-09-10T04:53:17.904798+0000","last_clean":"2024-09-10T04:53:17.904798+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:53:17.904798+0000","last_undegraded":"2024-09-10T04:53:17.904798+0000","last_fullsized":"2024-09-10T04:53:17.904798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:10.568818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1469,"ondisk_log_size":1469,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":9048064,"data_stored":8757315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44732,"kb_used_data":9388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327108,"statfs":{"total":96636764160,"available":96590958592,"internally_reserved":0,"allocated":9613312,"data_stored":9346366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673005,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":9662464,"data_stored":9349694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673005,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8759353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:53:25.422 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T04:53:25.422 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:53:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.529+0000 7f3f50f8a640 1 Processor -- start 2024-09-10T04:53:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.529+0000 7f3f50f8a640 1 -- start start 2024-09-10T04:53:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.529+0000 7f3f50f8a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f4c130270 0x7f3f4c132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.529+0000 7f3f50f8a640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c06dc00 con 0x7f3f4c129d80 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.529+0000 7f3f50f8a640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c1299c0 con 0x7f3f4c130270 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f43fff640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3f4c130270 0x7f3f4c132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f4a59c640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3f4c129d80 0x7f3f4c12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46118/0 (socket says 172.21.15.98:46118) 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f4a59c640 1 -- 172.21.15.98:0/2093401021 learned_addr learned my addr 172.21.15.98:0/2093401021 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f43fff640 1 -- 172.21.15.98:0/2093401021 >> v1:172.21.15.98:6789/0 conn(0x7f3f4c129d80 legacy=0x7f3f4c12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f43fff640 1 -- 172.21.15.98:0/2093401021 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c12a870 con 0x7f3f4c130270 2024-09-10T04:53:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f49d9b640 1 -- 172.21.15.98:0/2093401021 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432135159 0 0) 0x7f3f4c06dc00 con 0x7f3f4c129d80 2024-09-10T04:53:25.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.530+0000 7f3f43fff640 1 --2- 172.21.15.98:0/2093401021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c130270 0x7f3f4c132660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009720 tx=0x7f3f3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff0f9722b4e256d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f49d9b640 1 -- 172.21.15.98:0/2093401021 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f34037070 con 0x7f3f4c130270 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f49d9b640 1 -- 172.21.15.98:0/2093401021 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3402ad90 con 0x7f3f4c130270 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f49d9b640 1 -- 172.21.15.98:0/2093401021 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f34032590 con 0x7f3f4c130270 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 -- 172.21.15.98:0/2093401021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c130270 msgr2=0x7f3f4c132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/2093401021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c130270 0x7f3f4c132660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009720 tx=0x7f3f3402a110 comp rx=0 tx=0).stop 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 -- 172.21.15.98:0/2093401021 shutdown_connections 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/2093401021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c130270 0x7f3f4c132660 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 -- 172.21.15.98:0/2093401021 >> 172.21.15.98:0/2093401021 conn(0x7f3f4c070850 msgr2=0x7f3f4c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 -- 172.21.15.98:0/2093401021 shutdown_connections 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.531+0000 7f3f50f8a640 1 -- 172.21.15.98:0/2093401021 wait complete. 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.532+0000 7f3f50f8a640 1 Processor -- start 2024-09-10T04:53:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.532+0000 7f3f50f8a640 1 -- start start 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f50f8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f50f8a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c073a10 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50872/0 (socket says 172.21.15.98:50872) 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f4a59c640 1 -- 172.21.15.98:0/3054762401 learned_addr learned my addr 172.21.15.98:0/3054762401 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f4a59c640 1 -- 172.21.15.98:0/3054762401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c1c09c0 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f4a59c640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c3d0 tx=0x7f3f3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0074d0 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c0047e0 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1c0bf0 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c007670 con 0x7f3f4c129d80 2024-09-10T04:53:25.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.533+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1c10c0 con 0x7f3f4c129d80 2024-09-10T04:53:25.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.534+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f3c011070 con 0x7f3f4c129d80 2024-09-10T04:53:25.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.534+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c11a6b0 con 0x7f3f4c129d80 2024-09-10T04:53:25.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.534+0000 7f3f42ffd640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 0x7f3f2c040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.535+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f3f3c052950 con 0x7f3f4c129d80 2024-09-10T04:53:25.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.535+0000 7f3f43fff640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 0x7f3f2c040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.535+0000 7f3f43fff640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 0x7f3f2c040300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f3402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.539+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3f3c012dd0 con 0x7f3f4c129d80 2024-09-10T04:53:25.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.716+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f4c114640 con 0x7f3f2c03de40 2024-09-10T04:53:25.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.725+0000 7f3f42ffd640 1 -- 172.21.15.98:0/3054762401 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666095 (secure 0 0 0) 0x7f3f4c114640 con 0x7f3f2c03de40 2024-09-10T04:53:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:25.740 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 msgr2=0x7f3f2c040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 0x7f3f2c040300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f3402e000 comp rx=0 tx=0).stop 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 msgr2=0x7f3f4c1c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c3d0 tx=0x7f3f3c00c890 comp rx=0 tx=0).stop 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 shutdown_connections 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f3f2c03de40 0x7f3f2c040300 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 --2- 172.21.15.98:0/3054762401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f4c129d80 0x7f3f4c1c0480 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 >> 172.21.15.98:0/3054762401 conn(0x7f3f4c070850 msgr2=0x7f3f4c1282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:25.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 shutdown_connections 2024-09-10T04:53:25.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.730+0000 7f3f50f8a640 1 -- 172.21.15.98:0/3054762401 wait complete. 2024-09-10T04:53:25.744 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-10T04:53:25.254307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004267"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.213647+0000","last_change":"2024-09-10T04:50:08.836558+0000","last_active":"2024-09-10T04:50:51.213647+0000","last_peered":"2024-09-10T04:50:51.213647+0000","last_clean":"2024-09-10T04:50:51.213647+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:50:51.213647+0000","last_undegraded":"2024-09-10T04:50:51.213647+0000","last_fullsized":"2024-09-10T04:50:51.213647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:07.611919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874886+0000","last_change":"2024-09-10T04:50:10.827523+0000","last_active":"2024-09-10T04:50:48.874886+0000","last_peered":"2024-09-10T04:50:48.874886+0000","last_clean":"2024-09-10T04:50:48.874886+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:50:48.874886+0000","last_undegraded":"2024-09-10T04:50:48.874886+0000","last_fullsized":"2024-09-10T04:50:48.874886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:56.905163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:13.223901+0000","last_change":"2024-09-10T04:50:08.848586+0000","last_active":"2024-09-10T04:52:13.223901+0000","last_peered":"2024-09-10T04:52:13.223901+0000","last_clean":"2024-09-10T04:52:13.223901+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:52:13.223901+0000","last_undegraded":"2024-09-10T04:52:13.223901+0000","last_fullsized":"2024-09-10T04:52:13.223901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671414+0000","last_change":"2024-09-10T04:50:10.819187+0000","last_active":"2024-09-10T04:53:17.671414+0000","last_peered":"2024-09-10T04:53:17.671414+0000","last_clean":"2024-09-10T04:53:17.671414+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:53:17.671414+0000","last_undegraded":"2024-09-10T04:53:17.671414+0000","last_fullsized":"2024-09-10T04:53:17.671414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:41.828061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881449+0000","last_change":"2024-09-10T04:50:08.839328+0000","last_active":"2024-09-10T04:50:48.881449+0000","last_peered":"2024-09-10T04:50:48.881449+0000","last_clean":"2024-09-10T04:50:48.881449+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:50:48.881449+0000","last_undegraded":"2024-09-10T04:50:48.881449+0000","last_fullsized":"2024-09-10T04:50:48.881449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:21.710828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732731+0000","last_change":"2024-09-10T04:50:48.879830+0000","last_active":"2024-09-10T04:51:33.732731+0000","last_peered":"2024-09-10T04:51:33.732731+0000","last_clean":"2024-09-10T04:51:33.732731+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:51:33.732731+0000","last_undegraded":"2024-09-10T04:51:33.732731+0000","last_fullsized":"2024-09-10T04:51:33.732731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:59.179205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871764+0000","last_change":"2024-09-10T04:50:08.841951+0000","last_active":"2024-09-10T04:50:48.871764+0000","last_peered":"2024-09-10T04:50:48.871764+0000","last_clean":"2024-09-10T04:50:48.871764+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:50:48.871764+0000","last_undegraded":"2024-09-10T04:50:48.871764+0000","last_fullsized":"2024-09-10T04:50:48.871764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:00.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.201672+0000","last_change":"2024-09-10T04:50:48.879883+0000","last_active":"2024-09-10T04:52:14.201672+0000","last_peered":"2024-09-10T04:52:14.201672+0000","last_clean":"2024-09-10T04:52:14.201672+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:52:14.201672+0000","last_undegraded":"2024-09-10T04:52:14.201672+0000","last_fullsized":"2024-09-10T04:52:14.201672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:08.771696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875513+0000","last_change":"2024-09-10T04:50:08.836256+0000","last_active":"2024-09-10T04:50:48.875513+0000","last_peered":"2024-09-10T04:50:48.875513+0000","last_clean":"2024-09-10T04:50:48.875513+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:50:48.875513+0000","last_undegraded":"2024-09-10T04:50:48.875513+0000","last_fullsized":"2024-09-10T04:50:48.875513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:21.447084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702019+0000","last_change":"2024-09-10T04:50:10.823009+0000","last_active":"2024-09-10T04:50:51.702019+0000","last_peered":"2024-09-10T04:50:51.702019+0000","last_clean":"2024-09-10T04:50:51.702019+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:50:51.702019+0000","last_undegraded":"2024-09-10T04:50:51.702019+0000","last_fullsized":"2024-09-10T04:50:51.702019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.897024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875751+0000","last_change":"2024-09-10T04:50:08.837428+0000","last_active":"2024-09-10T04:50:48.875751+0000","last_peered":"2024-09-10T04:50:48.875751+0000","last_clean":"2024-09-10T04:50:48.875751+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:50:48.875751+0000","last_undegraded":"2024-09-10T04:50:48.875751+0000","last_fullsized":"2024-09-10T04:50:48.875751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:13.131981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671731+0000","last_change":"2024-09-10T04:50:10.832647+0000","last_active":"2024-09-10T04:53:17.671731+0000","last_peered":"2024-09-10T04:53:17.671731+0000","last_clean":"2024-09-10T04:53:17.671731+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:53:17.671731+0000","last_undegraded":"2024-09-10T04:53:17.671731+0000","last_fullsized":"2024-09-10T04:53:17.671731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:30.079691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.878085+0000","last_change":"2024-09-10T04:50:08.834170+0000","last_active":"2024-09-10T04:53:17.878085+0000","last_peered":"2024-09-10T04:53:17.878085+0000","last_clean":"2024-09-10T04:53:17.878085+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:17.878085+0000","last_undegraded":"2024-09-10T04:53:17.878085+0000","last_fullsized":"2024-09-10T04:53:17.878085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:23.894994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732327+0000","last_change":"2024-09-10T04:50:10.825623+0000","last_active":"2024-09-10T04:51:33.732327+0000","last_peered":"2024-09-10T04:51:33.732327+0000","last_clean":"2024-09-10T04:51:33.732327+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:51:33.732327+0000","last_undegraded":"2024-09-10T04:51:33.732327+0000","last_fullsized":"2024-09-10T04:51:33.732327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.611215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.881294+0000","last_change":"2024-09-10T04:50:08.842334+0000","last_active":"2024-09-10T04:53:17.881294+0000","last_peered":"2024-09-10T04:53:17.881294+0000","last_clean":"2024-09-10T04:53:17.881294+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:17.881294+0000","last_undegraded":"2024-09-10T04:53:17.881294+0000","last_fullsized":"2024-09-10T04:53:17.881294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:03.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.022533+0000","last_change":"2024-09-10T04:50:10.831636+0000","last_active":"2024-09-10T04:53:18.022533+0000","last_peered":"2024-09-10T04:53:18.022533+0000","last_clean":"2024-09-10T04:53:18.022533+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:18.022533+0000","last_undegraded":"2024-09-10T04:53:18.022533+0000","last_fullsized":"2024-09-10T04:53:18.022533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:51.773869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949263+0000","last_change":"2024-09-10T04:50:10.827812+0000","last_active":"2024-09-10T04:53:17.949263+0000","last_peered":"2024-09-10T04:53:17.949263+0000","last_clean":"2024-09-10T04:53:17.949263+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:17.949263+0000","last_undegraded":"2024-09-10T04:53:17.949263+0000","last_fullsized":"2024-09-10T04:53:17.949263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.617778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879684+0000","last_change":"2024-09-10T04:50:08.849290+0000","last_active":"2024-09-10T04:50:48.879684+0000","last_peered":"2024-09-10T04:50:48.879684+0000","last_clean":"2024-09-10T04:50:48.879684+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:50:48.879684+0000","last_undegraded":"2024-09-10T04:50:48.879684+0000","last_fullsized":"2024-09-10T04:50:48.879684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:01.331992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.230916+0000","last_change":"2024-09-10T04:50:10.825696+0000","last_active":"2024-09-10T04:50:51.230916+0000","last_peered":"2024-09-10T04:50:51.230916+0000","last_clean":"2024-09-10T04:50:51.230916+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:50:51.230916+0000","last_undegraded":"2024-09-10T04:50:51.230916+0000","last_fullsized":"2024-09-10T04:50:51.230916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:21.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.249384+0000","last_change":"2024-09-10T04:50:08.855614+0000","last_active":"2024-09-10T04:52:17.249384+0000","last_peered":"2024-09-10T04:52:17.249384+0000","last_clean":"2024-09-10T04:52:17.249384+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:52:17.249384+0000","last_undegraded":"2024-09-10T04:52:17.249384+0000","last_fullsized":"2024-09-10T04:52:17.249384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:52.782524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.219735+0000","last_change":"2024-09-10T04:50:08.838188+0000","last_active":"2024-09-10T04:50:51.219735+0000","last_peered":"2024-09-10T04:50:51.219735+0000","last_clean":"2024-09-10T04:50:51.219735+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:50:51.219735+0000","last_undegraded":"2024-09-10T04:50:51.219735+0000","last_fullsized":"2024-09-10T04:50:51.219735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:02.357191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874666+0000","last_change":"2024-09-10T04:50:10.831149+0000","last_active":"2024-09-10T04:50:48.874666+0000","last_peered":"2024-09-10T04:50:48.874666+0000","last_clean":"2024-09-10T04:50:48.874666+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:50:48.874666+0000","last_undegraded":"2024-09-10T04:50:48.874666+0000","last_fullsized":"2024-09-10T04:50:48.874666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.512694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875939+0000","last_change":"2024-09-10T04:50:08.836996+0000","last_active":"2024-09-10T04:50:48.875939+0000","last_peered":"2024-09-10T04:50:48.875939+0000","last_clean":"2024-09-10T04:50:48.875939+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:50:48.875939+0000","last_undegraded":"2024-09-10T04:50:48.875939+0000","last_fullsized":"2024-09-10T04:50:48.875939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:37.196606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732464+0000","last_change":"2024-09-10T04:50:10.824023+0000","last_active":"2024-09-10T04:51:33.732464+0000","last_peered":"2024-09-10T04:51:33.732464+0000","last_clean":"2024-09-10T04:51:33.732464+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:51:33.732464+0000","last_undegraded":"2024-09-10T04:51:33.732464+0000","last_fullsized":"2024-09-10T04:51:33.732464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.559546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.545371+0000","last_change":"2024-09-10T04:50:08.846235+0000","last_active":"2024-09-10T04:53:17.545371+0000","last_peered":"2024-09-10T04:53:17.545371+0000","last_clean":"2024-09-10T04:53:17.545371+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:17.545371+0000","last_undegraded":"2024-09-10T04:53:17.545371+0000","last_fullsized":"2024-09-10T04:53:17.545371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:03.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954024+0000","last_change":"2024-09-10T04:50:10.831903+0000","last_active":"2024-09-10T04:53:17.954024+0000","last_peered":"2024-09-10T04:53:17.954024+0000","last_clean":"2024-09-10T04:53:17.954024+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:17.954024+0000","last_undegraded":"2024-09-10T04:53:17.954024+0000","last_fullsized":"2024-09-10T04:53:17.954024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:04.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879338+0000","last_change":"2024-09-10T04:50:08.838274+0000","last_active":"2024-09-10T04:50:48.879338+0000","last_peered":"2024-09-10T04:50:48.879338+0000","last_clean":"2024-09-10T04:50:48.879338+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:50:48.879338+0000","last_undegraded":"2024-09-10T04:50:48.879338+0000","last_fullsized":"2024-09-10T04:50:48.879338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:40.373059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.763257+0000","last_change":"2024-09-10T04:50:10.827657+0000","last_active":"2024-09-10T04:53:17.763257+0000","last_peered":"2024-09-10T04:53:17.763257+0000","last_clean":"2024-09-10T04:53:17.763257+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:17.763257+0000","last_undegraded":"2024-09-10T04:53:17.763257+0000","last_fullsized":"2024-09-10T04:53:17.763257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:10.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.722381+0000","last_change":"2024-09-10T04:50:08.845982+0000","last_active":"2024-09-10T04:51:33.722381+0000","last_peered":"2024-09-10T04:51:33.722381+0000","last_clean":"2024-09-10T04:51:33.722381+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:51:33.722381+0000","last_undegraded":"2024-09-10T04:51:33.722381+0000","last_fullsized":"2024-09-10T04:51:33.722381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:28.921046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.840707+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:52:15.840707+0000","last_peered":"2024-09-10T04:52:15.840707+0000","last_clean":"2024-09-10T04:52:15.840707+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:52:15.840707+0000","last_undegraded":"2024-09-10T04:52:15.840707+0000","last_fullsized":"2024-09-10T04:52:15.840707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228840+0000","last_change":"2024-09-10T04:50:10.818723+0000","last_active":"2024-09-10T04:52:38.228840+0000","last_peered":"2024-09-10T04:52:38.228840+0000","last_clean":"2024-09-10T04:52:38.228840+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:52:38.228840+0000","last_undegraded":"2024-09-10T04:52:38.228840+0000","last_fullsized":"2024-09-10T04:52:38.228840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:32.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.891329+0000","last_change":"2024-09-10T04:50:08.842024+0000","last_active":"2024-09-10T04:53:17.891329+0000","last_peered":"2024-09-10T04:53:17.891329+0000","last_clean":"2024-09-10T04:53:17.891329+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:17.891329+0000","last_undegraded":"2024-09-10T04:53:17.891329+0000","last_fullsized":"2024-09-10T04:53:17.891329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:36.641361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203915+0000","last_change":"2024-09-10T04:50:10.823064+0000","last_active":"2024-09-10T04:52:14.203915+0000","last_peered":"2024-09-10T04:52:14.203915+0000","last_clean":"2024-09-10T04:52:14.203915+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:52:14.203915+0000","last_undegraded":"2024-09-10T04:52:14.203915+0000","last_fullsized":"2024-09-10T04:52:14.203915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:26.449576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874566+0000","last_change":"2024-09-10T04:50:08.837572+0000","last_active":"2024-09-10T04:50:48.874566+0000","last_peered":"2024-09-10T04:50:48.874566+0000","last_clean":"2024-09-10T04:50:48.874566+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:50:48.874566+0000","last_undegraded":"2024-09-10T04:50:48.874566+0000","last_fullsized":"2024-09-10T04:50:48.874566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:06.915826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871643+0000","last_change":"2024-09-10T04:50:14.831883+0000","last_active":"2024-09-10T04:50:48.871643+0000","last_peered":"2024-09-10T04:50:48.871643+0000","last_clean":"2024-09-10T04:50:48.871643+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:50:48.871643+0000","last_undegraded":"2024-09-10T04:50:48.871643+0000","last_fullsized":"2024-09-10T04:50:48.871643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:08.755472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910428+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:17.910428+0000","last_peered":"2024-09-10T04:53:17.910428+0000","last_clean":"2024-09-10T04:53:17.910428+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:17.910428+0000","last_undegraded":"2024-09-10T04:53:17.910428+0000","last_fullsized":"2024-09-10T04:53:17.910428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898545+0000","last_change":"2024-09-10T04:50:10.825749+0000","last_active":"2024-09-10T04:53:17.898545+0000","last_peered":"2024-09-10T04:53:17.898545+0000","last_clean":"2024-09-10T04:53:17.898545+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:17.898545+0000","last_undegraded":"2024-09-10T04:53:17.898545+0000","last_fullsized":"2024-09-10T04:53:17.898545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:53.153695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874420+0000","last_change":"2024-09-10T04:50:08.828799+0000","last_active":"2024-09-10T04:50:48.874420+0000","last_peered":"2024-09-10T04:50:48.874420+0000","last_clean":"2024-09-10T04:50:48.874420+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:50:48.874420+0000","last_undegraded":"2024-09-10T04:50:48.874420+0000","last_fullsized":"2024-09-10T04:50:48.874420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:51.598705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.835230+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:52:15.835230+0000","last_peered":"2024-09-10T04:52:15.835230+0000","last_clean":"2024-09-10T04:52:15.835230+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:52:15.835230+0000","last_undegraded":"2024-09-10T04:52:15.835230+0000","last_fullsized":"2024-09-10T04:52:15.835230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.073926+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:18.073926+0000","last_peered":"2024-09-10T04:53:18.073926+0000","last_clean":"2024-09-10T04:53:18.073926+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:18.073926+0000","last_undegraded":"2024-09-10T04:53:18.073926+0000","last_fullsized":"2024-09-10T04:53:18.073926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974101+0000","last_change":"2024-09-10T04:50:48.878932+0000","last_active":"2024-09-10T04:53:17.974101+0000","last_peered":"2024-09-10T04:53:17.974101+0000","last_clean":"2024-09-10T04:53:17.974101+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:17.974101+0000","last_undegraded":"2024-09-10T04:53:17.974101+0000","last_fullsized":"2024-09-10T04:53:17.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.903742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877328+0000","last_change":"2024-09-10T04:50:08.829013+0000","last_active":"2024-09-10T04:50:48.877328+0000","last_peered":"2024-09-10T04:50:48.877328+0000","last_clean":"2024-09-10T04:50:48.877328+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:50:48.877328+0000","last_undegraded":"2024-09-10T04:50:48.877328+0000","last_fullsized":"2024-09-10T04:50:48.877328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:03.087024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874784+0000","last_change":"2024-09-10T04:50:12.833519+0000","last_active":"2024-09-10T04:50:48.874784+0000","last_peered":"2024-09-10T04:50:48.874784+0000","last_clean":"2024-09-10T04:50:48.874784+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:50:48.874784+0000","last_undegraded":"2024-09-10T04:50:48.874784+0000","last_fullsized":"2024-09-10T04:50:48.874784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:32.252245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.844592+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:52:15.844592+0000","last_peered":"2024-09-10T04:52:15.844592+0000","last_clean":"2024-09-10T04:52:15.844592+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:52:15.844592+0000","last_undegraded":"2024-09-10T04:52:15.844592+0000","last_fullsized":"2024-09-10T04:52:15.844592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.964883+0000","last_change":"2024-09-10T04:50:10.826557+0000","last_active":"2024-09-10T04:50:50.964883+0000","last_peered":"2024-09-10T04:50:50.964883+0000","last_clean":"2024-09-10T04:50:50.964883+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:50:50.964883+0000","last_undegraded":"2024-09-10T04:50:50.964883+0000","last_fullsized":"2024-09-10T04:50:50.964883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:09.614984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.202264+0000","last_change":"2024-09-10T04:50:08.828183+0000","last_active":"2024-09-10T04:52:17.202264+0000","last_peered":"2024-09-10T04:52:17.202264+0000","last_clean":"2024-09-10T04:52:17.202264+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:52:17.202264+0000","last_undegraded":"2024-09-10T04:52:17.202264+0000","last_fullsized":"2024-09-10T04:52:17.202264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:30.666210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"25'1","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937623+0000","last_change":"2024-09-10T04:50:48.899617+0000","last_active":"2024-09-10T04:52:16.937623+0000","last_peered":"2024-09-10T04:52:16.937623+0000","last_clean":"2024-09-10T04:52:16.937623+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:52:16.937623+0000","last_undegraded":"2024-09-10T04:52:16.937623+0000","last_fullsized":"2024-09-10T04:52:16.937623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:52:34.876228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.824610+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:52:15.824610+0000","last_peered":"2024-09-10T04:52:15.824610+0000","last_clean":"2024-09-10T04:52:15.824610+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:52:15.824610+0000","last_undegraded":"2024-09-10T04:52:15.824610+0000","last_fullsized":"2024-09-10T04:52:15.824610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.764151+0000","last_change":"2024-09-10T04:50:10.826946+0000","last_active":"2024-09-10T04:53:17.764151+0000","last_peered":"2024-09-10T04:53:17.764151+0000","last_clean":"2024-09-10T04:53:17.764151+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:17.764151+0000","last_undegraded":"2024-09-10T04:53:17.764151+0000","last_fullsized":"2024-09-10T04:53:17.764151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:18.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877389+0000","last_change":"2024-09-10T04:50:08.837630+0000","last_active":"2024-09-10T04:50:48.877389+0000","last_peered":"2024-09-10T04:50:48.877389+0000","last_clean":"2024-09-10T04:50:48.877389+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:50:48.877389+0000","last_undegraded":"2024-09-10T04:50:48.877389+0000","last_fullsized":"2024-09-10T04:50:48.877389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:31.546596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880639+0000","last_change":"2024-09-10T04:50:48.878506+0000","last_active":"2024-09-10T04:50:48.880639+0000","last_peered":"2024-09-10T04:50:48.880639+0000","last_clean":"2024-09-10T04:50:48.880639+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:50:48.880639+0000","last_undegraded":"2024-09-10T04:50:48.880639+0000","last_fullsized":"2024-09-10T04:50:48.880639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:02.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.846385+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:52:15.846385+0000","last_peered":"2024-09-10T04:52:15.846385+0000","last_clean":"2024-09-10T04:52:15.846385+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:52:15.846385+0000","last_undegraded":"2024-09-10T04:52:15.846385+0000","last_fullsized":"2024-09-10T04:52:15.846385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.083067+0000","last_change":"2024-09-10T04:50:16.854603+0000","last_active":"2024-09-10T04:53:18.083067+0000","last_peered":"2024-09-10T04:53:18.083067+0000","last_clean":"2024-09-10T04:53:18.083067+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:53:18.083067+0000","last_undegraded":"2024-09-10T04:53:18.083067+0000","last_fullsized":"2024-09-10T04:53:18.083067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:42.247342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671118+0000","last_change":"2024-09-10T04:50:10.835108+0000","last_active":"2024-09-10T04:53:17.671118+0000","last_peered":"2024-09-10T04:53:17.671118+0000","last_clean":"2024-09-10T04:53:17.671118+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:17.671118+0000","last_undegraded":"2024-09-10T04:53:17.671118+0000","last_fullsized":"2024-09-10T04:53:17.671118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:45.228769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.517912+0000","last_change":"2024-09-10T04:50:08.829010+0000","last_active":"2024-09-10T04:51:33.517912+0000","last_peered":"2024-09-10T04:51:33.517912+0000","last_clean":"2024-09-10T04:51:33.517912+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:51:33.517912+0000","last_undegraded":"2024-09-10T04:51:33.517912+0000","last_fullsized":"2024-09-10T04:51:33.517912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:13.348983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871409+0000","last_change":"2024-09-10T04:50:12.828963+0000","last_active":"2024-09-10T04:50:48.871409+0000","last_peered":"2024-09-10T04:50:48.871409+0000","last_clean":"2024-09-10T04:50:48.871409+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:50:48.871409+0000","last_undegraded":"2024-09-10T04:50:48.871409+0000","last_fullsized":"2024-09-10T04:50:48.871409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:51.183596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.848473+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:52:15.848473+0000","last_peered":"2024-09-10T04:52:15.848473+0000","last_clean":"2024-09-10T04:52:15.848473+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:52:15.848473+0000","last_undegraded":"2024-09-10T04:52:15.848473+0000","last_fullsized":"2024-09-10T04:52:15.848473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871299+0000","last_change":"2024-09-10T04:50:16.852342+0000","last_active":"2024-09-10T04:50:48.871299+0000","last_peered":"2024-09-10T04:50:48.871299+0000","last_clean":"2024-09-10T04:50:48.871299+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:50:48.871299+0000","last_undegraded":"2024-09-10T04:50:48.871299+0000","last_fullsized":"2024-09-10T04:50:48.871299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:43.920861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:28.226751+0000","last_change":"2024-09-10T04:50:10.822366+0000","last_active":"2024-09-10T04:52:28.226751+0000","last_peered":"2024-09-10T04:52:28.226751+0000","last_clean":"2024-09-10T04:52:28.226751+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:52:28.226751+0000","last_undegraded":"2024-09-10T04:52:28.226751+0000","last_fullsized":"2024-09-10T04:52:28.226751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:25.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.884332+0000","last_change":"2024-09-10T04:50:08.845577+0000","last_active":"2024-09-10T04:50:48.884332+0000","last_peered":"2024-09-10T04:50:48.884332+0000","last_clean":"2024-09-10T04:50:48.884332+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:50:48.884332+0000","last_undegraded":"2024-09-10T04:50:48.884332+0000","last_fullsized":"2024-09-10T04:50:48.884332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:01.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872733+0000","last_change":"2024-09-10T04:50:12.826302+0000","last_active":"2024-09-10T04:50:48.872733+0000","last_peered":"2024-09-10T04:50:48.872733+0000","last_clean":"2024-09-10T04:50:48.872733+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:50:48.872733+0000","last_undegraded":"2024-09-10T04:50:48.872733+0000","last_fullsized":"2024-09-10T04:50:48.872733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:05.064578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.828772+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:52:15.828772+0000","last_peered":"2024-09-10T04:52:15.828772+0000","last_clean":"2024-09-10T04:52:15.828772+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:52:15.828772+0000","last_undegraded":"2024-09-10T04:52:15.828772+0000","last_fullsized":"2024-09-10T04:52:15.828772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702241+0000","last_change":"2024-09-10T04:50:10.826967+0000","last_active":"2024-09-10T04:50:51.702241+0000","last_peered":"2024-09-10T04:50:51.702241+0000","last_clean":"2024-09-10T04:50:51.702241+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:50:51.702241+0000","last_undegraded":"2024-09-10T04:50:51.702241+0000","last_fullsized":"2024-09-10T04:50:51.702241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:18.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875461+0000","last_change":"2024-09-10T04:50:08.828776+0000","last_active":"2024-09-10T04:50:48.875461+0000","last_peered":"2024-09-10T04:50:48.875461+0000","last_clean":"2024-09-10T04:50:48.875461+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:50:48.875461+0000","last_undegraded":"2024-09-10T04:50:48.875461+0000","last_fullsized":"2024-09-10T04:50:48.875461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:19.564788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.928233+0000","last_change":"2024-09-10T04:50:12.834219+0000","last_active":"2024-09-10T04:52:16.928233+0000","last_peered":"2024-09-10T04:52:16.928233+0000","last_clean":"2024-09-10T04:52:16.928233+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:52:16.928233+0000","last_undegraded":"2024-09-10T04:52:16.928233+0000","last_fullsized":"2024-09-10T04:52:16.928233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:03.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227534+0000","last_change":"2024-09-10T04:50:14.837587+0000","last_active":"2024-09-10T04:52:33.227534+0000","last_peered":"2024-09-10T04:52:33.227534+0000","last_clean":"2024-09-10T04:52:33.227534+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:52:33.227534+0000","last_undegraded":"2024-09-10T04:52:33.227534+0000","last_fullsized":"2024-09-10T04:52:33.227534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:07.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.064451+0000","last_change":"2024-09-10T04:50:16.854229+0000","last_active":"2024-09-10T04:53:18.064451+0000","last_peered":"2024-09-10T04:53:18.064451+0000","last_clean":"2024-09-10T04:53:18.064451+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:53:18.064451+0000","last_undegraded":"2024-09-10T04:53:18.064451+0000","last_fullsized":"2024-09-10T04:53:18.064451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:18.182840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.021671+0000","last_change":"2024-09-10T04:50:10.826497+0000","last_active":"2024-09-10T04:53:18.021671+0000","last_peered":"2024-09-10T04:53:18.021671+0000","last_clean":"2024-09-10T04:53:18.021671+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:18.021671+0000","last_undegraded":"2024-09-10T04:53:18.021671+0000","last_fullsized":"2024-09-10T04:53:18.021671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:32.092320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878748+0000","last_change":"2024-09-10T04:50:08.843627+0000","last_active":"2024-09-10T04:50:48.878748+0000","last_peered":"2024-09-10T04:50:48.878748+0000","last_clean":"2024-09-10T04:50:48.878748+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:50:48.878748+0000","last_undegraded":"2024-09-10T04:50:48.878748+0000","last_fullsized":"2024-09-10T04:50:48.878748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.987359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937306+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:52:16.937306+0000","last_peered":"2024-09-10T04:52:16.937306+0000","last_clean":"2024-09-10T04:52:16.937306+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:52:16.937306+0000","last_undegraded":"2024-09-10T04:52:16.937306+0000","last_fullsized":"2024-09-10T04:52:16.937306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":511,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.026279+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:18.026279+0000","last_peered":"2024-09-10T04:53:18.026279+0000","last_clean":"2024-09-10T04:53:18.026279+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:18.026279+0000","last_undegraded":"2024-09-10T04:53:18.026279+0000","last_fullsized":"2024-09-10T04:53:18.026279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974264+0000","last_change":"2024-09-10T04:50:10.829724+0000","last_active":"2024-09-10T04:53:17.974264+0000","last_peered":"2024-09-10T04:53:17.974264+0000","last_clean":"2024-09-10T04:53:17.974264+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:17.974264+0000","last_undegraded":"2024-09-10T04:53:17.974264+0000","last_fullsized":"2024-09-10T04:53:17.974264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:38.586579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878679+0000","last_change":"2024-09-10T04:50:08.842002+0000","last_active":"2024-09-10T04:50:48.878679+0000","last_peered":"2024-09-10T04:50:48.878679+0000","last_clean":"2024-09-10T04:50:48.878679+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:50:48.878679+0000","last_undegraded":"2024-09-10T04:50:48.878679+0000","last_fullsized":"2024-09-10T04:50:48.878679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:41.938317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883061+0000","last_change":"2024-09-10T04:50:12.829555+0000","last_active":"2024-09-10T04:50:48.883061+0000","last_peered":"2024-09-10T04:50:48.883061+0000","last_clean":"2024-09-10T04:50:48.883061+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:50:48.883061+0000","last_undegraded":"2024-09-10T04:50:48.883061+0000","last_fullsized":"2024-09-10T04:50:48.883061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:09:48.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227887+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:52:33.227887+0000","last_peered":"2024-09-10T04:52:33.227887+0000","last_clean":"2024-09-10T04:52:33.227887+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:52:33.227887+0000","last_undegraded":"2024-09-10T04:52:33.227887+0000","last_fullsized":"2024-09-10T04:52:33.227887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974080+0000","last_change":"2024-09-10T04:50:10.832812+0000","last_active":"2024-09-10T04:53:17.974080+0000","last_peered":"2024-09-10T04:53:17.974080+0000","last_clean":"2024-09-10T04:53:17.974080+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:17.974080+0000","last_undegraded":"2024-09-10T04:53:17.974080+0000","last_fullsized":"2024-09-10T04:53:17.974080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:10.931903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874246+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:48.874246+0000","last_peered":"2024-09-10T04:50:48.874246+0000","last_clean":"2024-09-10T04:50:48.874246+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:48.874246+0000","last_undegraded":"2024-09-10T04:50:48.874246+0000","last_fullsized":"2024-09-10T04:50:48.874246+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875222+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:48.875222+0000","last_peered":"2024-09-10T04:50:48.875222+0000","last_clean":"2024-09-10T04:50:48.875222+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:48.875222+0000","last_undegraded":"2024-09-10T04:50:48.875222+0000","last_fullsized":"2024-09-10T04:50:48.875222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879878+0000","last_change":"2024-09-10T04:50:08.838594+0000","last_active":"2024-09-10T04:50:48.879878+0000","last_peered":"2024-09-10T04:50:48.879878+0000","last_clean":"2024-09-10T04:50:48.879878+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:50:48.879878+0000","last_undegraded":"2024-09-10T04:50:48.879878+0000","last_fullsized":"2024-09-10T04:50:48.879878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:13.728249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876718+0000","last_change":"2024-09-10T04:50:12.831368+0000","last_active":"2024-09-10T04:50:48.876718+0000","last_peered":"2024-09-10T04:50:48.876718+0000","last_clean":"2024-09-10T04:50:48.876718+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:50:48.876718+0000","last_undegraded":"2024-09-10T04:50:48.876718+0000","last_fullsized":"2024-09-10T04:50:48.876718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:47.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.298706+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:52:17.298706+0000","last_peered":"2024-09-10T04:52:17.298706+0000","last_clean":"2024-09-10T04:52:17.298706+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:52:17.298706+0000","last_undegraded":"2024-09-10T04:52:17.298706+0000","last_fullsized":"2024-09-10T04:52:17.298706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882688+0000","last_change":"2024-09-10T04:50:10.823205+0000","last_active":"2024-09-10T04:50:48.882688+0000","last_peered":"2024-09-10T04:50:48.882688+0000","last_clean":"2024-09-10T04:50:48.882688+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:50:48.882688+0000","last_undegraded":"2024-09-10T04:50:48.882688+0000","last_fullsized":"2024-09-10T04:50:48.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:34.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874960+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:48.874960+0000","last_peered":"2024-09-10T04:50:48.874960+0000","last_clean":"2024-09-10T04:50:48.874960+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:48.874960+0000","last_undegraded":"2024-09-10T04:50:48.874960+0000","last_fullsized":"2024-09-10T04:50:48.874960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.631341+0000","last_change":"2024-09-10T04:50:08.836446+0000","last_active":"2024-09-10T04:53:17.631341+0000","last_peered":"2024-09-10T04:53:17.631341+0000","last_clean":"2024-09-10T04:53:17.631341+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:17.631341+0000","last_undegraded":"2024-09-10T04:53:17.631341+0000","last_fullsized":"2024-09-10T04:53:17.631341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878323+0000","last_change":"2024-09-10T04:50:12.829152+0000","last_active":"2024-09-10T04:50:48.878323+0000","last_peered":"2024-09-10T04:50:48.878323+0000","last_clean":"2024-09-10T04:50:48.878323+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:50:48.878323+0000","last_undegraded":"2024-09-10T04:50:48.878323+0000","last_fullsized":"2024-09-10T04:50:48.878323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:57.426370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":489,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910575+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:17.910575+0000","last_peered":"2024-09-10T04:53:17.910575+0000","last_clean":"2024-09-10T04:53:17.910575+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:17.910575+0000","last_undegraded":"2024-09-10T04:53:17.910575+0000","last_fullsized":"2024-09-10T04:53:17.910575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974004+0000","last_change":"2024-09-10T04:50:10.829015+0000","last_active":"2024-09-10T04:53:17.974004+0000","last_peered":"2024-09-10T04:53:17.974004+0000","last_clean":"2024-09-10T04:53:17.974004+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:17.974004+0000","last_undegraded":"2024-09-10T04:53:17.974004+0000","last_fullsized":"2024-09-10T04:53:17.974004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:58.709020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870077+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:48.870077+0000","last_peered":"2024-09-10T04:50:48.870077+0000","last_clean":"2024-09-10T04:50:48.870077+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:48.870077+0000","last_undegraded":"2024-09-10T04:50:48.870077+0000","last_fullsized":"2024-09-10T04:50:48.870077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874373+0000","last_change":"2024-09-10T04:50:08.847331+0000","last_active":"2024-09-10T04:50:48.874373+0000","last_peered":"2024-09-10T04:50:48.874373+0000","last_clean":"2024-09-10T04:50:48.874373+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:50:48.874373+0000","last_undegraded":"2024-09-10T04:50:48.874373+0000","last_fullsized":"2024-09-10T04:50:48.874373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.881835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874638+0000","last_change":"2024-09-10T04:50:12.825223+0000","last_active":"2024-09-10T04:50:48.874638+0000","last_peered":"2024-09-10T04:50:48.874638+0000","last_clean":"2024-09-10T04:50:48.874638+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:50:48.874638+0000","last_undegraded":"2024-09-10T04:50:48.874638+0000","last_fullsized":"2024-09-10T04:50:48.874638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:17.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910723+0000","last_change":"2024-09-10T04:50:48.893450+0000","last_active":"2024-09-10T04:53:17.910723+0000","last_peered":"2024-09-10T04:53:17.910723+0000","last_clean":"2024-09-10T04:53:17.910723+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:53:17.910723+0000","last_undegraded":"2024-09-10T04:53:17.910723+0000","last_fullsized":"2024-09-10T04:53:17.910723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:31.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.770722+0000","last_change":"2024-09-10T04:50:10.836057+0000","last_active":"2024-09-10T04:53:17.770722+0000","last_peered":"2024-09-10T04:53:17.770722+0000","last_clean":"2024-09-10T04:53:17.770722+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:17.770722+0000","last_undegraded":"2024-09-10T04:53:17.770722+0000","last_fullsized":"2024-09-10T04:53:17.770722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:55.248455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875284+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:48.875284+0000","last_peered":"2024-09-10T04:50:48.875284+0000","last_clean":"2024-09-10T04:50:48.875284+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:48.875284+0000","last_undegraded":"2024-09-10T04:50:48.875284+0000","last_fullsized":"2024-09-10T04:50:48.875284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875446+0000","last_change":"2024-09-10T04:50:08.828278+0000","last_active":"2024-09-10T04:50:48.875446+0000","last_peered":"2024-09-10T04:50:48.875446+0000","last_clean":"2024-09-10T04:50:48.875446+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:50:48.875446+0000","last_undegraded":"2024-09-10T04:50:48.875446+0000","last_fullsized":"2024-09-10T04:50:48.875446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:04.354850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877039+0000","last_change":"2024-09-10T04:50:12.829769+0000","last_active":"2024-09-10T04:50:48.877039+0000","last_peered":"2024-09-10T04:50:48.877039+0000","last_clean":"2024-09-10T04:50:48.877039+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:50:48.877039+0000","last_undegraded":"2024-09-10T04:50:48.877039+0000","last_fullsized":"2024-09-10T04:50:48.877039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:09.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876234+0000","last_change":"2024-09-10T04:50:10.829364+0000","last_active":"2024-09-10T04:50:48.876234+0000","last_peered":"2024-09-10T04:50:48.876234+0000","last_clean":"2024-09-10T04:50:48.876234+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:50:48.876234+0000","last_undegraded":"2024-09-10T04:50:48.876234+0000","last_fullsized":"2024-09-10T04:50:48.876234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.090089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877512+0000","last_change":"2024-09-10T04:50:08.837043+0000","last_active":"2024-09-10T04:50:48.877512+0000","last_peered":"2024-09-10T04:50:48.877512+0000","last_clean":"2024-09-10T04:50:48.877512+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:50:48.877512+0000","last_undegraded":"2024-09-10T04:50:48.877512+0000","last_fullsized":"2024-09-10T04:50:48.877512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:17.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877579+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:48.877579+0000","last_peered":"2024-09-10T04:50:48.877579+0000","last_clean":"2024-09-10T04:50:48.877579+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:48.877579+0000","last_undegraded":"2024-09-10T04:50:48.877579+0000","last_fullsized":"2024-09-10T04:50:48.877579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224774+0000","last_change":"2024-09-10T04:50:12.830001+0000","last_active":"2024-09-10T04:52:18.224774+0000","last_peered":"2024-09-10T04:52:18.224774+0000","last_clean":"2024-09-10T04:52:18.224774+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:52:18.224774+0000","last_undegraded":"2024-09-10T04:52:18.224774+0000","last_fullsized":"2024-09-10T04:52:18.224774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:30.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224683+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:52:18.224683+0000","last_peered":"2024-09-10T04:52:18.224683+0000","last_clean":"2024-09-10T04:52:18.224683+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:52:18.224683+0000","last_undegraded":"2024-09-10T04:52:18.224683+0000","last_fullsized":"2024-09-10T04:52:18.224683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296859+0000","last_change":"2024-09-10T04:50:48.895495+0000","last_active":"2024-09-10T04:52:17.296859+0000","last_peered":"2024-09-10T04:52:17.296859+0000","last_clean":"2024-09-10T04:52:17.296859+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:52:17.296859+0000","last_undegraded":"2024-09-10T04:52:17.296859+0000","last_fullsized":"2024-09-10T04:52:17.296859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:15.353442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878026+0000","last_change":"2024-09-10T04:50:08.836453+0000","last_active":"2024-09-10T04:50:48.878026+0000","last_peered":"2024-09-10T04:50:48.878026+0000","last_clean":"2024-09-10T04:50:48.878026+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:50:48.878026+0000","last_undegraded":"2024-09-10T04:50:48.878026+0000","last_fullsized":"2024-09-10T04:50:48.878026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:00.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877301+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:48.877301+0000","last_peered":"2024-09-10T04:50:48.877301+0000","last_clean":"2024-09-10T04:50:48.877301+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:48.877301+0000","last_undegraded":"2024-09-10T04:50:48.877301+0000","last_fullsized":"2024-09-10T04:50:48.877301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910637+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:17.910637+0000","last_peered":"2024-09-10T04:53:17.910637+0000","last_clean":"2024-09-10T04:53:17.910637+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:17.910637+0000","last_undegraded":"2024-09-10T04:53:17.910637+0000","last_fullsized":"2024-09-10T04:53:17.910637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949075+0000","last_change":"2024-09-10T04:50:10.836157+0000","last_active":"2024-09-10T04:53:17.949075+0000","last_peered":"2024-09-10T04:53:17.949075+0000","last_clean":"2024-09-10T04:53:17.949075+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:17.949075+0000","last_undegraded":"2024-09-10T04:53:17.949075+0000","last_fullsized":"2024-09-10T04:53:17.949075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:51:54.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881873+0000","last_change":"2024-09-10T04:50:08.846597+0000","last_active":"2024-09-10T04:50:48.881873+0000","last_peered":"2024-09-10T04:50:48.881873+0000","last_clean":"2024-09-10T04:50:48.881873+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:50:48.881873+0000","last_undegraded":"2024-09-10T04:50:48.881873+0000","last_fullsized":"2024-09-10T04:50:48.881873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:30.509630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878039+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:48.878039+0000","last_peered":"2024-09-10T04:50:48.878039+0000","last_clean":"2024-09-10T04:50:48.878039+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:48.878039+0000","last_undegraded":"2024-09-10T04:50:48.878039+0000","last_fullsized":"2024-09-10T04:50:48.878039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875429+0000","last_change":"2024-09-10T04:50:12.828001+0000","last_active":"2024-09-10T04:50:48.875429+0000","last_peered":"2024-09-10T04:50:48.875429+0000","last_clean":"2024-09-10T04:50:48.875429+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:50:48.875429+0000","last_undegraded":"2024-09-10T04:50:48.875429+0000","last_fullsized":"2024-09-10T04:50:48.875429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:19.857340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.061187+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:18.061187+0000","last_peered":"2024-09-10T04:53:18.061187+0000","last_clean":"2024-09-10T04:53:18.061187+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:18.061187+0000","last_undegraded":"2024-09-10T04:53:18.061187+0000","last_fullsized":"2024-09-10T04:53:18.061187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296426+0000","last_change":"2024-09-10T04:50:10.825130+0000","last_active":"2024-09-10T04:52:17.296426+0000","last_peered":"2024-09-10T04:52:17.296426+0000","last_clean":"2024-09-10T04:52:17.296426+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:52:17.296426+0000","last_undegraded":"2024-09-10T04:52:17.296426+0000","last_fullsized":"2024-09-10T04:52:17.296426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:52.976061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.589847+0000","last_change":"2024-09-10T04:50:08.837605+0000","last_active":"2024-09-10T04:50:50.589847+0000","last_peered":"2024-09-10T04:50:50.589847+0000","last_clean":"2024-09-10T04:50:50.589847+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:50:50.589847+0000","last_undegraded":"2024-09-10T04:50:50.589847+0000","last_fullsized":"2024-09-10T04:50:50.589847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:53.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878172+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:48.878172+0000","last_peered":"2024-09-10T04:50:48.878172+0000","last_clean":"2024-09-10T04:50:48.878172+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:48.878172+0000","last_undegraded":"2024-09-10T04:50:48.878172+0000","last_fullsized":"2024-09-10T04:50:48.878172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881108+0000","last_change":"2024-09-10T04:50:12.833099+0000","last_active":"2024-09-10T04:50:48.881108+0000","last_peered":"2024-09-10T04:50:48.881108+0000","last_clean":"2024-09-10T04:50:48.881108+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:50:48.881108+0000","last_undegraded":"2024-09-10T04:50:48.881108+0000","last_fullsized":"2024-09-10T04:50:48.881108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:10.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.839664+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:52:15.839664+0000","last_peered":"2024-09-10T04:52:15.839664+0000","last_clean":"2024-09-10T04:52:15.839664+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:52:15.839664+0000","last_undegraded":"2024-09-10T04:52:15.839664+0000","last_fullsized":"2024-09-10T04:52:15.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.231272+0000","last_change":"2024-09-10T04:50:10.824890+0000","last_active":"2024-09-10T04:50:51.231272+0000","last_peered":"2024-09-10T04:50:51.231272+0000","last_clean":"2024-09-10T04:50:51.231272+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:50:51.231272+0000","last_undegraded":"2024-09-10T04:50:51.231272+0000","last_fullsized":"2024-09-10T04:50:51.231272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.915338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875830+0000","last_change":"2024-09-10T04:50:08.827991+0000","last_active":"2024-09-10T04:50:48.875830+0000","last_peered":"2024-09-10T04:50:48.875830+0000","last_clean":"2024-09-10T04:50:48.875830+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:50:48.875830+0000","last_undegraded":"2024-09-10T04:50:48.875830+0000","last_fullsized":"2024-09-10T04:50:48.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:27.065767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873861+0000","last_change":"2024-09-10T04:50:12.833107+0000","last_active":"2024-09-10T04:50:48.873861+0000","last_peered":"2024-09-10T04:50:48.873861+0000","last_clean":"2024-09-10T04:50:48.873861+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:50:48.873861+0000","last_undegraded":"2024-09-10T04:50:48.873861+0000","last_fullsized":"2024-09-10T04:50:48.873861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:21.150621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.845543+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:52:15.845543+0000","last_peered":"2024-09-10T04:52:15.845543+0000","last_clean":"2024-09-10T04:52:15.845543+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:52:15.845543+0000","last_undegraded":"2024-09-10T04:52:15.845543+0000","last_fullsized":"2024-09-10T04:52:15.845543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.701581+0000","last_change":"2024-09-10T04:50:10.829358+0000","last_active":"2024-09-10T04:50:51.701581+0000","last_peered":"2024-09-10T04:50:51.701581+0000","last_clean":"2024-09-10T04:50:51.701581+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:50:51.701581+0000","last_undegraded":"2024-09-10T04:50:51.701581+0000","last_fullsized":"2024-09-10T04:50:51.701581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871928+0000","last_change":"2024-09-10T04:50:08.844912+0000","last_active":"2024-09-10T04:50:48.871928+0000","last_peered":"2024-09-10T04:50:48.871928+0000","last_clean":"2024-09-10T04:50:48.871928+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:50:48.871928+0000","last_undegraded":"2024-09-10T04:50:48.871928+0000","last_fullsized":"2024-09-10T04:50:48.871928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:44.401270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872992+0000","last_change":"2024-09-10T04:50:16.850075+0000","last_active":"2024-09-10T04:50:48.872992+0000","last_peered":"2024-09-10T04:50:48.872992+0000","last_clean":"2024-09-10T04:50:48.872992+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:50:48.872992+0000","last_undegraded":"2024-09-10T04:50:48.872992+0000","last_fullsized":"2024-09-10T04:50:48.872992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:56:01.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.615428+0000","last_change":"2024-09-10T04:50:10.820033+0000","last_active":"2024-09-10T04:50:50.615428+0000","last_peered":"2024-09-10T04:50:50.615428+0000","last_clean":"2024-09-10T04:50:50.615428+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:50:50.615428+0000","last_undegraded":"2024-09-10T04:50:50.615428+0000","last_fullsized":"2024-09-10T04:50:50.615428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:57.856874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877343+0000","last_change":"2024-09-10T04:50:08.836435+0000","last_active":"2024-09-10T04:50:48.877343+0000","last_peered":"2024-09-10T04:50:48.877343+0000","last_clean":"2024-09-10T04:50:48.877343+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:50:48.877343+0000","last_undegraded":"2024-09-10T04:50:48.877343+0000","last_fullsized":"2024-09-10T04:50:48.877343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:00:09.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.369040+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:17.369040+0000","last_peered":"2024-09-10T04:53:17.369040+0000","last_clean":"2024-09-10T04:53:17.369040+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:17.369040+0000","last_undegraded":"2024-09-10T04:53:17.369040+0000","last_fullsized":"2024-09-10T04:53:17.369040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898536+0000","last_change":"2024-09-10T04:50:10.834917+0000","last_active":"2024-09-10T04:53:17.898536+0000","last_peered":"2024-09-10T04:53:17.898536+0000","last_clean":"2024-09-10T04:53:17.898536+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:17.898536+0000","last_undegraded":"2024-09-10T04:53:17.898536+0000","last_fullsized":"2024-09-10T04:53:17.898536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.969513+0000","last_change":"2024-09-10T04:50:08.848711+0000","last_active":"2024-09-10T04:53:17.969513+0000","last_peered":"2024-09-10T04:53:17.969513+0000","last_clean":"2024-09-10T04:53:17.969513+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:17.969513+0000","last_undegraded":"2024-09-10T04:53:17.969513+0000","last_fullsized":"2024-09-10T04:53:17.969513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:39.749808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.830813+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:52:15.830813+0000","last_peered":"2024-09-10T04:52:15.830813+0000","last_clean":"2024-09-10T04:52:15.830813+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:52:15.830813+0000","last_undegraded":"2024-09-10T04:52:15.830813+0000","last_fullsized":"2024-09-10T04:52:15.830813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878107+0000","last_change":"2024-09-10T04:50:10.826794+0000","last_active":"2024-09-10T04:50:48.878107+0000","last_peered":"2024-09-10T04:50:48.878107+0000","last_clean":"2024-09-10T04:50:48.878107+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:50:48.878107+0000","last_undegraded":"2024-09-10T04:50:48.878107+0000","last_fullsized":"2024-09-10T04:50:48.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:52.554993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.119492+0000","last_change":"2024-09-10T04:50:08.841684+0000","last_active":"2024-09-10T04:50:50.119492+0000","last_peered":"2024-09-10T04:50:50.119492+0000","last_clean":"2024-09-10T04:50:50.119492+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:50:50.119492+0000","last_undegraded":"2024-09-10T04:50:50.119492+0000","last_fullsized":"2024-09-10T04:50:50.119492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:23.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.851860+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:52:15.851860+0000","last_peered":"2024-09-10T04:52:15.851860+0000","last_clean":"2024-09-10T04:52:15.851860+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:52:15.851860+0000","last_undegraded":"2024-09-10T04:52:15.851860+0000","last_fullsized":"2024-09-10T04:52:15.851860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":69,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898584+0000","last_change":"2024-09-10T04:50:10.832030+0000","last_active":"2024-09-10T04:53:17.898584+0000","last_peered":"2024-09-10T04:53:17.898584+0000","last_clean":"2024-09-10T04:53:17.898584+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:17.898584+0000","last_undegraded":"2024-09-10T04:53:17.898584+0000","last_fullsized":"2024-09-10T04:53:17.898584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:06.264467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873902+0000","last_change":"2024-09-10T04:50:08.848820+0000","last_active":"2024-09-10T04:50:48.873902+0000","last_peered":"2024-09-10T04:50:48.873902+0000","last_clean":"2024-09-10T04:50:48.873902+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:50:48.873902+0000","last_undegraded":"2024-09-10T04:50:48.873902+0000","last_fullsized":"2024-09-10T04:50:48.873902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:38.304965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.831889+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:52:15.831889+0000","last_peered":"2024-09-10T04:52:15.831889+0000","last_clean":"2024-09-10T04:52:15.831889+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:52:15.831889+0000","last_undegraded":"2024-09-10T04:52:15.831889+0000","last_fullsized":"2024-09-10T04:52:15.831889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881759+0000","last_change":"2024-09-10T04:50:10.829229+0000","last_active":"2024-09-10T04:50:48.881759+0000","last_peered":"2024-09-10T04:50:48.881759+0000","last_clean":"2024-09-10T04:50:48.881759+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:50:48.881759+0000","last_undegraded":"2024-09-10T04:50:48.881759+0000","last_fullsized":"2024-09-10T04:50:48.881759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.888344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.135770+0000","last_change":"2024-09-10T04:50:08.829094+0000","last_active":"2024-09-10T04:52:17.135770+0000","last_peered":"2024-09-10T04:52:17.135770+0000","last_clean":"2024-09-10T04:52:17.135770+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:52:17.135770+0000","last_undegraded":"2024-09-10T04:52:17.135770+0000","last_fullsized":"2024-09-10T04:52:17.135770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:06.234076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.849560+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:52:15.849560+0000","last_peered":"2024-09-10T04:52:15.849560+0000","last_clean":"2024-09-10T04:52:15.849560+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:52:15.849560+0000","last_undegraded":"2024-09-10T04:52:15.849560+0000","last_fullsized":"2024-09-10T04:52:15.849560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980768+0000","last_change":"2024-09-10T04:50:10.833243+0000","last_active":"2024-09-10T04:53:17.980768+0000","last_peered":"2024-09-10T04:53:17.980768+0000","last_clean":"2024-09-10T04:53:17.980768+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:17.980768+0000","last_undegraded":"2024-09-10T04:53:17.980768+0000","last_fullsized":"2024-09-10T04:53:17.980768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:23.713893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883823+0000","last_change":"2024-09-10T04:50:08.845251+0000","last_active":"2024-09-10T04:50:48.883823+0000","last_peered":"2024-09-10T04:50:48.883823+0000","last_clean":"2024-09-10T04:50:48.883823+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:50:48.883823+0000","last_undegraded":"2024-09-10T04:50:48.883823+0000","last_fullsized":"2024-09-10T04:50:48.883823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:49.213273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910364+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:17.910364+0000","last_peered":"2024-09-10T04:53:17.910364+0000","last_clean":"2024-09-10T04:53:17.910364+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:17.910364+0000","last_undegraded":"2024-09-10T04:53:17.910364+0000","last_fullsized":"2024-09-10T04:53:17.910364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203867+0000","last_change":"2024-09-10T04:50:10.831574+0000","last_active":"2024-09-10T04:52:14.203867+0000","last_peered":"2024-09-10T04:52:14.203867+0000","last_clean":"2024-09-10T04:52:14.203867+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:52:14.203867+0000","last_undegraded":"2024-09-10T04:52:14.203867+0000","last_fullsized":"2024-09-10T04:52:14.203867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:00.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228408+0000","last_change":"2024-09-10T04:50:08.847637+0000","last_active":"2024-09-10T04:52:38.228408+0000","last_peered":"2024-09-10T04:52:38.228408+0000","last_clean":"2024-09-10T04:52:38.228408+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:52:38.228408+0000","last_undegraded":"2024-09-10T04:52:38.228408+0000","last_fullsized":"2024-09-10T04:52:38.228408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:06.730845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874087+0000","last_change":"2024-09-10T04:50:12.834537+0000","last_active":"2024-09-10T04:50:48.874087+0000","last_peered":"2024-09-10T04:50:48.874087+0000","last_clean":"2024-09-10T04:50:48.874087+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:50:48.874087+0000","last_undegraded":"2024-09-10T04:50:48.874087+0000","last_fullsized":"2024-09-10T04:50:48.874087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:56.571156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:43.229803+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:52:43.229803+0000","last_peered":"2024-09-10T04:52:43.229803+0000","last_clean":"2024-09-10T04:52:43.229803+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:52:43.229803+0000","last_undegraded":"2024-09-10T04:52:43.229803+0000","last_fullsized":"2024-09-10T04:52:43.229803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.673337+0000","last_change":"2024-09-10T04:50:10.827125+0000","last_active":"2024-09-10T04:53:17.673337+0000","last_peered":"2024-09-10T04:53:17.673337+0000","last_clean":"2024-09-10T04:53:17.673337+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:17.673337+0000","last_undegraded":"2024-09-10T04:53:17.673337+0000","last_fullsized":"2024-09-10T04:53:17.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:39.825343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876983+0000","last_change":"2024-09-10T04:50:08.838072+0000","last_active":"2024-09-10T04:50:48.876983+0000","last_peered":"2024-09-10T04:50:48.876983+0000","last_clean":"2024-09-10T04:50:48.876983+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:50:48.876983+0000","last_undegraded":"2024-09-10T04:50:48.876983+0000","last_fullsized":"2024-09-10T04:50:48.876983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:05.923861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.823561+0000","last_change":"2024-09-10T04:50:14.845070+0000","last_active":"2024-09-10T04:52:15.823561+0000","last_peered":"2024-09-10T04:52:15.823561+0000","last_clean":"2024-09-10T04:52:15.823561+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:52:15.823561+0000","last_undegraded":"2024-09-10T04:52:15.823561+0000","last_fullsized":"2024-09-10T04:52:15.823561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:53.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974120+0000","last_change":"2024-09-10T04:50:10.826976+0000","last_active":"2024-09-10T04:53:17.974120+0000","last_peered":"2024-09-10T04:53:17.974120+0000","last_clean":"2024-09-10T04:53:17.974120+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:53:17.974120+0000","last_undegraded":"2024-09-10T04:53:17.974120+0000","last_fullsized":"2024-09-10T04:53:17.974120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:07.818212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881536+0000","last_change":"2024-09-10T04:50:08.840484+0000","last_active":"2024-09-10T04:50:48.881536+0000","last_peered":"2024-09-10T04:50:48.881536+0000","last_clean":"2024-09-10T04:50:48.881536+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:50:48.881536+0000","last_undegraded":"2024-09-10T04:50:48.881536+0000","last_fullsized":"2024-09-10T04:50:48.881536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:38.776585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874056+0000","last_change":"2024-09-10T04:50:12.834557+0000","last_active":"2024-09-10T04:50:48.874056+0000","last_peered":"2024-09-10T04:50:48.874056+0000","last_clean":"2024-09-10T04:50:48.874056+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:50:48.874056+0000","last_undegraded":"2024-09-10T04:50:48.874056+0000","last_fullsized":"2024-09-10T04:50:48.874056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:02.966548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:48.230344+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:52:48.230344+0000","last_peered":"2024-09-10T04:52:48.230344+0000","last_clean":"2024-09-10T04:52:48.230344+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:52:48.230344+0000","last_undegraded":"2024-09-10T04:52:48.230344+0000","last_fullsized":"2024-09-10T04:52:48.230344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954522+0000","last_change":"2024-09-10T04:50:48.883931+0000","last_active":"2024-09-10T04:53:17.954522+0000","last_peered":"2024-09-10T04:53:17.954522+0000","last_clean":"2024-09-10T04:53:17.954522+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:17.954522+0000","last_undegraded":"2024-09-10T04:53:17.954522+0000","last_fullsized":"2024-09-10T04:53:17.954522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:24.168136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879567+0000","last_change":"2024-09-10T04:50:08.849572+0000","last_active":"2024-09-10T04:50:48.879567+0000","last_peered":"2024-09-10T04:50:48.879567+0000","last_clean":"2024-09-10T04:50:48.879567+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:50:48.879567+0000","last_undegraded":"2024-09-10T04:50:48.879567+0000","last_fullsized":"2024-09-10T04:50:48.879567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:35.230547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.535579+0000","last_change":"2024-09-10T04:50:48.897508+0000","last_active":"2024-09-10T04:52:14.535579+0000","last_peered":"2024-09-10T04:52:14.535579+0000","last_clean":"2024-09-10T04:52:14.535579+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:52:14.535579+0000","last_undegraded":"2024-09-10T04:52:14.535579+0000","last_fullsized":"2024-09-10T04:52:14.535579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:16.163407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.315908+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:17.315908+0000","last_peered":"2024-09-10T04:53:17.315908+0000","last_clean":"2024-09-10T04:53:17.315908+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:17.315908+0000","last_undegraded":"2024-09-10T04:53:17.315908+0000","last_fullsized":"2024-09-10T04:53:17.315908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296217+0000","last_change":"2024-09-10T04:50:10.831509+0000","last_active":"2024-09-10T04:52:17.296217+0000","last_peered":"2024-09-10T04:52:17.296217+0000","last_clean":"2024-09-10T04:52:17.296217+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:52:17.296217+0000","last_undegraded":"2024-09-10T04:52:17.296217+0000","last_fullsized":"2024-09-10T04:52:17.296217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:08.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871169+0000","last_change":"2024-09-10T04:50:08.856704+0000","last_active":"2024-09-10T04:50:48.871169+0000","last_peered":"2024-09-10T04:50:48.871169+0000","last_clean":"2024-09-10T04:50:48.871169+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:50:48.871169+0000","last_undegraded":"2024-09-10T04:50:48.871169+0000","last_fullsized":"2024-09-10T04:50:48.871169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:15.081087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.204249+0000","last_change":"2024-09-10T04:50:10.835492+0000","last_active":"2024-09-10T04:52:14.204249+0000","last_peered":"2024-09-10T04:52:14.204249+0000","last_clean":"2024-09-10T04:52:14.204249+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:52:14.204249+0000","last_undegraded":"2024-09-10T04:52:14.204249+0000","last_fullsized":"2024-09-10T04:52:14.204249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.215580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870244+0000","last_change":"2024-09-10T04:50:08.856062+0000","last_active":"2024-09-10T04:50:48.870244+0000","last_peered":"2024-09-10T04:50:48.870244+0000","last_clean":"2024-09-10T04:50:48.870244+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:50:48.870244+0000","last_undegraded":"2024-09-10T04:50:48.870244+0000","last_fullsized":"2024-09-10T04:50:48.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:44.016447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.527212+0000","last_change":"2024-09-10T04:50:10.827487+0000","last_active":"2024-09-10T04:51:33.527212+0000","last_peered":"2024-09-10T04:51:33.527212+0000","last_clean":"2024-09-10T04:51:33.527212+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:51:33.527212+0000","last_undegraded":"2024-09-10T04:51:33.527212+0000","last_fullsized":"2024-09-10T04:51:33.527212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:31.140771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.189762+0000","last_change":"2024-09-10T04:50:08.839647+0000","last_active":"2024-09-10T04:52:14.189762+0000","last_peered":"2024-09-10T04:52:14.189762+0000","last_clean":"2024-09-10T04:52:14.189762+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:52:14.189762+0000","last_undegraded":"2024-09-10T04:52:14.189762+0000","last_fullsized":"2024-09-10T04:52:14.189762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:50.972996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.297469+0000","last_change":"2024-09-10T04:50:10.836518+0000","last_active":"2024-09-10T04:52:17.297469+0000","last_peered":"2024-09-10T04:52:17.297469+0000","last_clean":"2024-09-10T04:52:17.297469+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:52:17.297469+0000","last_undegraded":"2024-09-10T04:52:17.297469+0000","last_fullsized":"2024-09-10T04:52:17.297469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:31.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.887688+0000","last_change":"2024-09-10T04:50:08.840487+0000","last_active":"2024-09-10T04:53:17.887688+0000","last_peered":"2024-09-10T04:53:17.887688+0000","last_clean":"2024-09-10T04:53:17.887688+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:17.887688+0000","last_undegraded":"2024-09-10T04:53:17.887688+0000","last_fullsized":"2024-09-10T04:53:17.887688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:15.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949045+0000","last_change":"2024-09-10T04:50:10.819238+0000","last_active":"2024-09-10T04:53:17.949045+0000","last_peered":"2024-09-10T04:53:17.949045+0000","last_clean":"2024-09-10T04:53:17.949045+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:53:17.949045+0000","last_undegraded":"2024-09-10T04:53:17.949045+0000","last_fullsized":"2024-09-10T04:53:17.949045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.471522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883009+0000","last_change":"2024-09-10T04:50:08.841048+0000","last_active":"2024-09-10T04:50:48.883009+0000","last_peered":"2024-09-10T04:50:48.883009+0000","last_clean":"2024-09-10T04:50:48.883009+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:50:48.883009+0000","last_undegraded":"2024-09-10T04:50:48.883009+0000","last_fullsized":"2024-09-10T04:50:48.883009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.225704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203735+0000","last_change":"2024-09-10T04:50:10.831470+0000","last_active":"2024-09-10T04:52:14.203735+0000","last_peered":"2024-09-10T04:52:14.203735+0000","last_clean":"2024-09-10T04:52:14.203735+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:52:14.203735+0000","last_undegraded":"2024-09-10T04:52:14.203735+0000","last_fullsized":"2024-09-10T04:52:14.203735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.221117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.884302+0000","last_change":"2024-09-10T04:50:08.846442+0000","last_active":"2024-09-10T04:53:17.884302+0000","last_peered":"2024-09-10T04:53:17.884302+0000","last_clean":"2024-09-10T04:53:17.884302+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:17.884302+0000","last_undegraded":"2024-09-10T04:53:17.884302+0000","last_fullsized":"2024-09-10T04:53:17.884302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:16.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946963+0000","last_change":"2024-09-10T04:50:10.827486+0000","last_active":"2024-09-10T04:53:17.946963+0000","last_peered":"2024-09-10T04:53:17.946963+0000","last_clean":"2024-09-10T04:53:17.946963+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:53:17.946963+0000","last_undegraded":"2024-09-10T04:53:17.946963+0000","last_fullsized":"2024-09-10T04:53:17.946963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:33.726146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224842+0000","last_change":"2024-09-10T04:50:08.844203+0000","last_active":"2024-09-10T04:52:18.224842+0000","last_peered":"2024-09-10T04:52:18.224842+0000","last_clean":"2024-09-10T04:52:18.224842+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:52:18.224842+0000","last_undegraded":"2024-09-10T04:52:18.224842+0000","last_fullsized":"2024-09-10T04:52:18.224842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:18.749197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974089+0000","last_change":"2024-09-10T04:50:10.827432+0000","last_active":"2024-09-10T04:53:17.974089+0000","last_peered":"2024-09-10T04:53:17.974089+0000","last_clean":"2024-09-10T04:53:17.974089+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:17.974089+0000","last_undegraded":"2024-09-10T04:53:17.974089+0000","last_fullsized":"2024-09-10T04:53:17.974089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.651962+0000","last_change":"2024-09-10T04:50:08.846314+0000","last_active":"2024-09-10T04:53:17.651962+0000","last_peered":"2024-09-10T04:53:17.651962+0000","last_clean":"2024-09-10T04:53:17.651962+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:17.651962+0000","last_undegraded":"2024-09-10T04:53:17.651962+0000","last_fullsized":"2024-09-10T04:53:17.651962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:46.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898539+0000","last_change":"2024-09-10T04:50:10.835695+0000","last_active":"2024-09-10T04:53:17.898539+0000","last_peered":"2024-09-10T04:53:17.898539+0000","last_clean":"2024-09-10T04:53:17.898539+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:17.898539+0000","last_undegraded":"2024-09-10T04:53:17.898539+0000","last_fullsized":"2024-09-10T04:53:17.898539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:38.631225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878570+0000","last_change":"2024-09-10T04:50:08.839014+0000","last_active":"2024-09-10T04:50:48.878570+0000","last_peered":"2024-09-10T04:50:48.878570+0000","last_clean":"2024-09-10T04:50:48.878570+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:50:48.878570+0000","last_undegraded":"2024-09-10T04:50:48.878570+0000","last_fullsized":"2024-09-10T04:50:48.878570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:44.696031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898521+0000","last_change":"2024-09-10T04:50:10.829938+0000","last_active":"2024-09-10T04:53:17.898521+0000","last_peered":"2024-09-10T04:53:17.898521+0000","last_clean":"2024-09-10T04:53:17.898521+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:53:17.898521+0000","last_undegraded":"2024-09-10T04:53:17.898521+0000","last_fullsized":"2024-09-10T04:53:17.898521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.656906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878982+0000","last_change":"2024-09-10T04:50:08.840107+0000","last_active":"2024-09-10T04:50:48.878982+0000","last_peered":"2024-09-10T04:50:48.878982+0000","last_clean":"2024-09-10T04:50:48.878982+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:50:48.878982+0000","last_undegraded":"2024-09-10T04:50:48.878982+0000","last_fullsized":"2024-09-10T04:50:48.878982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:13.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296935+0000","last_change":"2024-09-10T04:50:10.831991+0000","last_active":"2024-09-10T04:52:17.296935+0000","last_peered":"2024-09-10T04:52:17.296935+0000","last_clean":"2024-09-10T04:52:17.296935+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:52:17.296935+0000","last_undegraded":"2024-09-10T04:52:17.296935+0000","last_fullsized":"2024-09-10T04:52:17.296935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:15.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.226174+0000","last_change":"2024-09-10T04:50:08.837010+0000","last_active":"2024-09-10T04:52:23.226174+0000","last_peered":"2024-09-10T04:52:23.226174+0000","last_clean":"2024-09-10T04:52:23.226174+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:52:23.226174+0000","last_undegraded":"2024-09-10T04:52:23.226174+0000","last_fullsized":"2024-09-10T04:52:23.226174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.112191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.947710+0000","last_change":"2024-09-10T04:50:10.829211+0000","last_active":"2024-09-10T04:53:17.947710+0000","last_peered":"2024-09-10T04:53:17.947710+0000","last_clean":"2024-09-10T04:53:17.947710+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:17.947710+0000","last_undegraded":"2024-09-10T04:53:17.947710+0000","last_fullsized":"2024-09-10T04:53:17.947710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:38.433783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875118+0000","last_change":"2024-09-10T04:50:08.848180+0000","last_active":"2024-09-10T04:50:48.875118+0000","last_peered":"2024-09-10T04:50:48.875118+0000","last_clean":"2024-09-10T04:50:48.875118+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:50:48.875118+0000","last_undegraded":"2024-09-10T04:50:48.875118+0000","last_fullsized":"2024-09-10T04:50:48.875118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:10.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949266+0000","last_change":"2024-09-10T04:50:10.826724+0000","last_active":"2024-09-10T04:53:17.949266+0000","last_peered":"2024-09-10T04:53:17.949266+0000","last_clean":"2024-09-10T04:53:17.949266+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:17.949266+0000","last_undegraded":"2024-09-10T04:53:17.949266+0000","last_fullsized":"2024-09-10T04:53:17.949266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:23.940844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883171+0000","last_change":"2024-09-10T04:50:08.841143+0000","last_active":"2024-09-10T04:50:48.883171+0000","last_peered":"2024-09-10T04:50:48.883171+0000","last_clean":"2024-09-10T04:50:48.883171+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:50:48.883171+0000","last_undegraded":"2024-09-10T04:50:48.883171+0000","last_fullsized":"2024-09-10T04:50:48.883171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946926+0000","last_change":"2024-09-10T04:50:10.829656+0000","last_active":"2024-09-10T04:53:17.946926+0000","last_peered":"2024-09-10T04:53:17.946926+0000","last_clean":"2024-09-10T04:53:17.946926+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:17.946926+0000","last_undegraded":"2024-09-10T04:53:17.946926+0000","last_fullsized":"2024-09-10T04:53:17.946926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.419467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.117840+0000","last_change":"2024-09-10T04:50:08.841015+0000","last_active":"2024-09-10T04:50:50.117840+0000","last_peered":"2024-09-10T04:50:50.117840+0000","last_clean":"2024-09-10T04:50:50.117840+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:50:50.117840+0000","last_undegraded":"2024-09-10T04:50:50.117840+0000","last_fullsized":"2024-09-10T04:50:50.117840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:30.089256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.965106+0000","last_change":"2024-09-10T04:50:10.827238+0000","last_active":"2024-09-10T04:50:50.965106+0000","last_peered":"2024-09-10T04:50:50.965106+0000","last_clean":"2024-09-10T04:50:50.965106+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:50:50.965106+0000","last_undegraded":"2024-09-10T04:50:50.965106+0000","last_fullsized":"2024-09-10T04:50:50.965106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:11.286717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873207+0000","last_change":"2024-09-10T04:50:08.843693+0000","last_active":"2024-09-10T04:50:48.873207+0000","last_peered":"2024-09-10T04:50:48.873207+0000","last_clean":"2024-09-10T04:50:48.873207+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:50:48.873207+0000","last_undegraded":"2024-09-10T04:50:48.873207+0000","last_fullsized":"2024-09-10T04:50:48.873207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:17.375028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.905075+0000","last_change":"2024-09-10T04:50:10.827173+0000","last_active":"2024-09-10T04:53:17.905075+0000","last_peered":"2024-09-10T04:53:17.905075+0000","last_clean":"2024-09-10T04:53:17.905075+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:17.905075+0000","last_undegraded":"2024-09-10T04:53:17.905075+0000","last_fullsized":"2024-09-10T04:53:17.905075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:28.319087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882780+0000","last_change":"2024-09-10T04:50:08.841506+0000","last_active":"2024-09-10T04:50:48.882780+0000","last_peered":"2024-09-10T04:50:48.882780+0000","last_clean":"2024-09-10T04:50:48.882780+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:50:48.882780+0000","last_undegraded":"2024-09-10T04:50:48.882780+0000","last_fullsized":"2024-09-10T04:50:48.882780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:11.919356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874624+0000","last_change":"2024-09-10T04:50:08.828047+0000","last_active":"2024-09-10T04:50:48.874624+0000","last_peered":"2024-09-10T04:50:48.874624+0000","last_clean":"2024-09-10T04:50:48.874624+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:50:48.874624+0000","last_undegraded":"2024-09-10T04:50:48.874624+0000","last_fullsized":"2024-09-10T04:50:48.874624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:53.770216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974118+0000","last_change":"2024-09-10T04:50:10.831624+0000","last_active":"2024-09-10T04:53:17.974118+0000","last_peered":"2024-09-10T04:53:17.974118+0000","last_clean":"2024-09-10T04:53:17.974118+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:17.974118+0000","last_undegraded":"2024-09-10T04:53:17.974118+0000","last_fullsized":"2024-09-10T04:53:17.974118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:40.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.275559+0000","last_change":"2024-09-10T04:50:08.848380+0000","last_active":"2024-09-10T04:52:17.275559+0000","last_peered":"2024-09-10T04:52:17.275559+0000","last_clean":"2024-09-10T04:52:17.275559+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:52:17.275559+0000","last_undegraded":"2024-09-10T04:52:17.275559+0000","last_fullsized":"2024-09-10T04:52:17.275559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.809904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.904798+0000","last_change":"2024-09-10T04:50:10.833818+0000","last_active":"2024-09-10T04:53:17.904798+0000","last_peered":"2024-09-10T04:53:17.904798+0000","last_clean":"2024-09-10T04:53:17.904798+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:53:17.904798+0000","last_undegraded":"2024-09-10T04:53:17.904798+0000","last_fullsized":"2024-09-10T04:53:17.904798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:10.568818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1469,"ondisk_log_size":1469,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":9048064,"data_stored":8757315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44732,"kb_used_data":9388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327108,"statfs":{"total":96636764160,"available":96590958592,"internally_reserved":0,"allocated":9613312,"data_stored":9346366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673005,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":9662464,"data_stored":9349694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673005,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8759353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:53:25.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T04:53:25.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.879+0000 7f43ebd56640 1 Processor -- start 2024-09-10T04:53:25.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.879+0000 7f43ebd56640 1 -- start start 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.879+0000 7f43ebd56640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f43e412f160 0x7f43e412f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43ebd56640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e4070f40 con 0x7f43e412fa80 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43ebd56640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f43e4070d70 con 0x7f43e412f160 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e9af2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f43e412f160 0x7f43e412f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e92f1640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f43e412fa80 0x7f43e412bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:46122/0 (socket says 172.21.15.98:46122) 2024-09-10T04:53:25.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e92f1640 1 -- 172.21.15.98:0/1107565782 learned_addr learned my addr 172.21.15.98:0/1107565782 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:25.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e9af2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f43e412f160 0x7f43e412f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50884/0 (socket says 172.21.15.98:50884) 2024-09-10T04:53:25.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e9af2640 1 -- 172.21.15.98:0/1107565782 >> v1:172.21.15.98:6789/0 conn(0x7f43e412fa80 legacy=0x7f43e412bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e9af2640 1 -- 172.21.15.98:0/1107565782 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e4072160 con 0x7f43e412f160 2024-09-10T04:53:25.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.880+0000 7f43e8af0640 1 -- 172.21.15.98:0/1107565782 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656156268 0 0) 0x7f43e4070f40 con 0x7f43e412fa80 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.881+0000 7f43e9af2640 1 --2- 172.21.15.98:0/1107565782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e412f540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009720 tx=0x7f43d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ded92f7d8e31cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.881+0000 7f43e8af0640 1 -- 172.21.15.98:0/1107565782 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d4037070 con 0x7f43e412f160 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.881+0000 7f43e8af0640 1 -- 172.21.15.98:0/1107565782 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d402ad90 con 0x7f43e412f160 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.881+0000 7f43e8af0640 1 -- 172.21.15.98:0/1107565782 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d4032590 con 0x7f43e412f160 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 -- 172.21.15.98:0/1107565782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 msgr2=0x7f43e412f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1107565782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e412f540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009720 tx=0x7f43d402a110 comp rx=0 tx=0).stop 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 -- 172.21.15.98:0/1107565782 shutdown_connections 2024-09-10T04:53:25.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1107565782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e412f540 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:25.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 -- 172.21.15.98:0/1107565782 >> 172.21.15.98:0/1107565782 conn(0x7f43e40a0ae0 msgr2=0x7f43e406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:25.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 -- 172.21.15.98:0/1107565782 shutdown_connections 2024-09-10T04:53:25.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 -- 172.21.15.98:0/1107565782 wait complete. 2024-09-10T04:53:25.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.882+0000 7f43ebd56640 1 Processor -- start 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43ebd56640 1 -- start start 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43ebd56640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43ebd56640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43e412c310 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43e9af2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43e9af2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50900/0 (socket says 172.21.15.98:50900) 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43e9af2640 1 -- 172.21.15.98:0/1571497261 learned_addr learned my addr 172.21.15.98:0/1571497261 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43e9af2640 1 -- 172.21.15.98:0/1571497261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e4121720 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.883+0000 7f43e9af2640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009720 tx=0x7f43d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.884+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d4041070 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.884+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d403c460 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.884+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e4122170 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.884+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d4037040 con 0x7f43e412f160 2024-09-10T04:53:25.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.884+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e41c4a00 con 0x7f43e412f160 2024-09-10T04:53:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.885+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e4121040 con 0x7f43e412f160 2024-09-10T04:53:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.885+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f43d4044070 con 0x7f43e412f160 2024-09-10T04:53:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.885+0000 7f43da7fc640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 0x7f43c8040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.885+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f43d40735f0 con 0x7f43e412f160 2024-09-10T04:53:25.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.885+0000 7f43e92f1640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 0x7f43c8040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:25.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.886+0000 7f43e92f1640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 0x7f43c8040380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43e0000c00 tx=0x7f43e00078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:25.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:25.889+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f43d403cc60 con 0x7f43e412f160 2024-09-10T04:53:26.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.072+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43e412c860 con 0x7f43e412f160 2024-09-10T04:53:26.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.073+0000 7f43da7fc640 1 -- 172.21.15.98:0/1571497261 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21339 (secure 0 0 0) 0x7f43d403c740 con 0x7f43e412f160 2024-09-10T04:53:26.076 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:26.076 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":34,"fsid":"06b8cc4b-d741-4e82-9b7a-3e23bf79f786","created":"2024-09-10T04:49:42.811530+0000","modified":"2024-09-10T04:50:48.866925+0000","last_up_change":"2024-09-10T04:49:52.498880+0000","last_in_change":"2024-09-10T04:49:43.858937+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T04:49:53.208406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T04:49:58.335613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T04:50:07.547006+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T04:50:09.130844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T04:50:11.102761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T04:50:12.896494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T04:50:14.843307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T04:50:16.927733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46e6df2a-9d9f-4a74-8518-8066cd04e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6801","nonce":733739603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6803","nonce":733739603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6807","nonce":733739603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":733739603},{"type":"v1","addr":"172.21.15.98:6805","nonce":733739603}]},"public_addr":"172.21.15.98:6801/733739603","cluster_addr":"172.21.15.98:6803/733739603","heartbeat_back_addr":"172.21.15.98:6807/733739603","heartbeat_front_addr":"172.21.15.98:6805/733739603","state":["exists","up"]},{"osd":1,"uuid":"ca64f75e-6b8c-4a37-a3b0-f31bdfd55a10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6809","nonce":819540050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6811","nonce":819540050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6815","nonce":819540050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":819540050},{"type":"v1","addr":"172.21.15.145:6813","nonce":819540050}]},"public_addr":"172.21.15.145:6809/819540050","cluster_addr":"172.21.15.145:6811/819540050","heartbeat_back_addr":"172.21.15.145:6815/819540050","heartbeat_front_addr":"172.21.15.145:6813/819540050","state":["exists","up"]},{"osd":2,"uuid":"b65706a9-7494-42d7-870b-17a5d98aa4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6817","nonce":1789112018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6819","nonce":1789112018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6823","nonce":1789112018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1789112018},{"type":"v1","addr":"172.21.15.145:6821","nonce":1789112018}]},"public_addr":"172.21.15.145:6817/1789112018","cluster_addr":"172.21.15.145:6819/1789112018","heartbeat_back_addr":"172.21.15.145:6823/1789112018","heartbeat_front_addr":"172.21.15.145:6821/1789112018","state":["exists","up"]},{"osd":3,"uuid":"ecc01501-9f53-4007-a5eb-8c6275af1106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6801","nonce":4228232102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6803","nonce":4228232102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6807","nonce":4228232102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4228232102},{"type":"v1","addr":"172.21.15.145:6805","nonce":4228232102}]},"public_addr":"172.21.15.145:6801/4228232102","cluster_addr":"172.21.15.145:6803/4228232102","heartbeat_back_addr":"172.21.15.145:6807/4228232102","heartbeat_front_addr":"172.21.15.145:6805/4228232102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.283734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.670591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:50.114321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T04:49:49.936242+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.18","mappings":[{"from":0,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.8","mappings":[{"from":1,"to":3}]},{"pgid":"5.b","mappings":[{"from":1,"to":3}]},{"pgid":"5.19","mappings":[{"from":1,"to":2}]},{"pgid":"6.5","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 msgr2=0x7f43c8040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 0x7f43c8040380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43e0000c00 tx=0x7f43e00078d0 comp rx=0 tx=0).stop 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 msgr2=0x7f43e41c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009720 tx=0x7f43d40046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 shutdown_connections 2024-09-10T04:53:26.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f43c803dec0 0x7f43c8040380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:26.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 --2- 172.21.15.98:0/1571497261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e412f160 0x7f43e41c42e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:26.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 >> 172.21.15.98:0/1571497261 conn(0x7f43e40a0ae0 msgr2=0x7f43e406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:26.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 shutdown_connections 2024-09-10T04:53:26.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:26.076+0000 7f43ebd56640 1 -- 172.21.15.98:0/1571497261 wait complete. 2024-09-10T04:53:27.089 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T04:53:27.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T04:53:27.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.198+0000 7fcfbda3c640 1 Processor -- start 2024-09-10T04:53:27.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.198+0000 7fcfbda3c640 1 -- start start 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfbda3c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcfb812bed0 0x7fcfb812c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfbda3c640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb8116d50 con 0x7fcfb812c7f0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfbda3c640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb81170f0 con 0x7fcfb812bed0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb67fc640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcfb812c7f0 0x7fcfb812f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42286/0 (socket says 172.21.15.98:42286) 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb6ffd640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcfb812bed0 0x7fcfb812c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb67fc640 1 -- 172.21.15.98:0/922262735 learned_addr learned my addr 172.21.15.98:0/922262735 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb5ffb640 1 -- 172.21.15.98:0/922262735 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565711720 0 0) 0x7fcfb8116d50 con 0x7fcfb812c7f0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb5ffb640 1 -- 172.21.15.98:0/922262735 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa0003520 con 0x7fcfb812c7f0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb6ffd640 1 -- 172.21.15.98:0/922262735 >> v1:172.21.15.98:6789/0 conn(0x7fcfb812c7f0 legacy=0x7fcfb812f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.199+0000 7fcfb6ffd640 1 -- 172.21.15.98:0/922262735 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb8115df0 con 0x7fcfb812bed0 2024-09-10T04:53:27.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfb6ffd640 1 --2- 172.21.15.98:0/922262735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb812c2b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009720 tx=0x7fcfa802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42203ae29b743766 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfb5ffb640 1 -- 172.21.15.98:0/922262735 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8037070 con 0x7fcfb812bed0 2024-09-10T04:53:27.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfb5ffb640 1 -- 172.21.15.98:0/922262735 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa802ad90 con 0x7fcfb812bed0 2024-09-10T04:53:27.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfb5ffb640 1 -- 172.21.15.98:0/922262735 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8032590 con 0x7fcfb812bed0 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfbda3c640 1 -- 172.21.15.98:0/922262735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 msgr2=0x7fcfb812c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/922262735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb812c2b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009720 tx=0x7fcfa802a110 comp rx=0 tx=0).stop 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfbda3c640 1 -- 172.21.15.98:0/922262735 shutdown_connections 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/922262735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb812c2b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.200+0000 7fcfbda3c640 1 -- 172.21.15.98:0/922262735 >> 172.21.15.98:0/922262735 conn(0x7fcfb806fb60 msgr2=0x7fcfb8071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.201+0000 7fcfbda3c640 1 -- 172.21.15.98:0/922262735 shutdown_connections 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.201+0000 7fcfbda3c640 1 -- 172.21.15.98:0/922262735 wait complete. 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.201+0000 7fcfbda3c640 1 Processor -- start 2024-09-10T04:53:27.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfbda3c640 1 -- start start 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfbda3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfbda3c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb812f980 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfb6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfb6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42736/0 (socket says 172.21.15.98:42736) 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfb6ffd640 1 -- 172.21.15.98:0/2732763634 learned_addr learned my addr 172.21.15.98:0/2732763634 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfb6ffd640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb811ccf0 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcfb6ffd640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c00 tx=0x7fcfa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.202+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8041070 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.203+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa803c460 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.203+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa8037040 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.203+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb811daa0 con 0x7fcfb812bed0 2024-09-10T04:53:27.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.203+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb811ddd0 con 0x7fcfb812bed0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.203+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfb806d430 con 0x7fcfb812bed0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcfa8044070 con 0x7fcfb812bed0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 0x7fcfa4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fcfa8073470 con 0x7fcfb812bed0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 0x7fcfa404c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfa802ad90 con 0x7fcfa404a460 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcfa807a050 con 0x7fcfb812bed0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcfb77fe640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 0x7fcfa404c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcfb67fc640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 0x7fcfa4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.204+0000 7fcfb77fe640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 0x7fcfa404c900 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.205+0000 7fcfb67fc640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 0x7fcfa4040350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcfac001610 tx=0x7fcfac0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.205+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== osd.0 v2:172.21.15.98:6800/733739603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfa802ad90 con 0x7fcfa404a460 2024-09-10T04:53:27.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.217+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 --> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcfb8073480 con 0x7fcfa404a460 2024-09-10T04:53:27.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcf9ffff640 1 -- 172.21.15.98:0/2732763634 <== osd.0 v2:172.21.15.98:6800/733739603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcfb8073480 con 0x7fcfa404a460 2024-09-10T04:53:27.220 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T04:53:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T04:53:27.220 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 msgr2=0x7fcfa404c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 0x7fcfa404c900 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 msgr2=0x7fcfa4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 0x7fcfa4040350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcfac001610 tx=0x7fcfac0078f0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 msgr2=0x7fcfb81c0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c00 tx=0x7fcfa80046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 shutdown_connections 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:6800/733739603,v1:172.21.15.98:6801/733739603] conn(0x7fcfa404a460 0x7fcfa404c900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fcfa403de90 0x7fcfa4040350 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 --2- 172.21.15.98:0/2732763634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfb812bed0 0x7fcfb81c0f40 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 >> 172.21.15.98:0/2732763634 conn(0x7fcfb806fb60 msgr2=0x7fcfb81288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 shutdown_connections 2024-09-10T04:53:27.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.218+0000 7fcfbda3c640 1 -- 172.21.15.98:0/2732763634 wait complete. 2024-09-10T04:53:27.230 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.328+0000 7f8d78fec640 1 Processor -- start 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.328+0000 7f8d78fec640 1 -- start start 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.328+0000 7f8d78fec640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8d74070370 0x7f8d74070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d78fec640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d74071de0 con 0x7f8d7409ec40 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d78fec640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7406dc30 con 0x7f8d74070370 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d7259c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8d74070370 0x7f8d74070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d69d9b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8d7409ec40 0x7f8d74126960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42290/0 (socket says 172.21.15.98:42290) 2024-09-10T04:53:27.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d69d9b640 1 -- 172.21.15.98:0/1260444362 learned_addr learned my addr 172.21.15.98:0/1260444362 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:27.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d7259c640 1 -- 172.21.15.98:0/1260444362 >> v1:172.21.15.98:6789/0 conn(0x7f8d7409ec40 legacy=0x7f8d74126960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.329+0000 7f8d7259c640 1 -- 172.21.15.98:0/1260444362 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d740721e0 con 0x7f8d74070370 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d7259c640 1 --2- 172.21.15.98:0/1260444362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74070750 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009720 tx=0x7f8d6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a2b69c827d98e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d71d9b640 1 -- 172.21.15.98:0/1260444362 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64037070 con 0x7f8d74070370 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d71d9b640 1 -- 172.21.15.98:0/1260444362 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6402ae20 con 0x7f8d74070370 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d71d9b640 1 -- 172.21.15.98:0/1260444362 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64032590 con 0x7f8d74070370 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 -- 172.21.15.98:0/1260444362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 msgr2=0x7f8d74070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 --2- 172.21.15.98:0/1260444362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74070750 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009720 tx=0x7f8d6402a1a0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 -- 172.21.15.98:0/1260444362 shutdown_connections 2024-09-10T04:53:27.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 --2- 172.21.15.98:0/1260444362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74070750 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 -- 172.21.15.98:0/1260444362 >> 172.21.15.98:0/1260444362 conn(0x7f8d7409c640 msgr2=0x7f8d7406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 -- 172.21.15.98:0/1260444362 shutdown_connections 2024-09-10T04:53:27.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.330+0000 7f8d78fec640 1 -- 172.21.15.98:0/1260444362 wait complete. 2024-09-10T04:53:27.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.331+0000 7f8d78fec640 1 Processor -- start 2024-09-10T04:53:27.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.331+0000 7f8d78fec640 1 -- start start 2024-09-10T04:53:27.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d78fec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d78fec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8d74071020 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d7259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d7259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42758/0 (socket says 172.21.15.98:42758) 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d7259c640 1 -- 172.21.15.98:0/4275870010 learned_addr learned my addr 172.21.15.98:0/4275870010 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d7259c640 1 -- 172.21.15.98:0/4275870010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d74127970 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d7259c640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64042070 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.332+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6403e590 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.333+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64037040 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.333+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7411b870 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.333+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7411d110 con 0x7f8d74070370 2024-09-10T04:53:27.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.333+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8d64045070 con 0x7f8d74070370 2024-09-10T04:53:27.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.333+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d74070750 con 0x7f8d74070370 2024-09-10T04:53:27.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.334+0000 7f8d6b7fe640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 0x7f8d54040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.334+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f8d64073870 con 0x7f8d74070370 2024-09-10T04:53:27.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.334+0000 7f8d69d9b640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 0x7f8d54040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.334+0000 7f8d69d9b640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 0x7f8d54040330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c007fd0 tx=0x7f8d5c007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.338+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8d6404f350 con 0x7f8d74070370 2024-09-10T04:53:27.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.514+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8d7411c5b0 con 0x7f8d5403de70 2024-09-10T04:53:27.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.515+0000 7f8d6b7fe640 1 -- 172.21.15.98:0/4275870010 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d7411c5b0 con 0x7f8d5403de70 2024-09-10T04:53:27.517 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T04:53:27.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 msgr2=0x7f8d54040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 0x7f8d54040330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c007fd0 tx=0x7f8d5c007aa0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 msgr2=0x7f8d74119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d640046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 shutdown_connections 2024-09-10T04:53:27.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8d5403de70 0x7f8d54040330 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 --2- 172.21.15.98:0/4275870010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d74070370 0x7f8d74119ed0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 >> 172.21.15.98:0/4275870010 conn(0x7f8d7409c640 msgr2=0x7f8d7409d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 shutdown_connections 2024-09-10T04:53:27.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.518+0000 7f8d78fec640 1 -- 172.21.15.98:0/4275870010 wait complete. 2024-09-10T04:53:27.530 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T04:53:27.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T04:53:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9069a57640 1 Processor -- start 2024-09-10T04:53:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9069a57640 1 -- start start 2024-09-10T04:53:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9069a57640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9064132390 0x7f9064134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9069a57640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906412bb00 con 0x7f906412beb0 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9069a57640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f9064073c70 con 0x7f9064132390 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f90627fc640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9064132390 0x7f9064134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9062ffd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f906412beb0 0x7f906412c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42292/0 (socket says 172.21.15.98:42292) 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9062ffd640 1 -- 172.21.15.98:0/2841241500 learned_addr learned my addr 172.21.15.98:0/2841241500 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f90627fc640 1 -- 172.21.15.98:0/2841241500 >> v1:172.21.15.98:6789/0 conn(0x7f906412beb0 legacy=0x7f906412c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f90627fc640 1 -- 172.21.15.98:0/2841241500 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906412c9a0 con 0x7f9064132390 2024-09-10T04:53:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.631+0000 7f9061ffb640 1 -- 172.21.15.98:0/2841241500 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790651893 0 0) 0x7f906412bb00 con 0x7f906412beb0 2024-09-10T04:53:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.632+0000 7f90627fc640 1 --2- 172.21.15.98:0/2841241500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9064132390 0x7f9064134780 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f904c009720 tx=0x7f904c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09c39a8deac9624 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.632+0000 7f9061ffb640 1 -- 172.21.15.98:0/2841241500 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f904c037070 con 0x7f9064132390 2024-09-10T04:53:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.632+0000 7f9061ffb640 1 -- 172.21.15.98:0/2841241500 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c02ae20 con 0x7f9064132390 2024-09-10T04:53:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.632+0000 7f9061ffb640 1 -- 172.21.15.98:0/2841241500 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f904c032590 con 0x7f9064132390 2024-09-10T04:53:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 -- 172.21.15.98:0/2841241500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9064132390 msgr2=0x7f9064134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 --2- 172.21.15.98:0/2841241500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9064132390 0x7f9064134780 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f904c009720 tx=0x7f904c02a1a0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 -- 172.21.15.98:0/2841241500 shutdown_connections 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 --2- 172.21.15.98:0/2841241500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9064132390 0x7f9064134780 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 -- 172.21.15.98:0/2841241500 >> 172.21.15.98:0/2841241500 conn(0x7f90640705a0 msgr2=0x7f9064072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 -- 172.21.15.98:0/2841241500 shutdown_connections 2024-09-10T04:53:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.633+0000 7f9069a57640 1 -- 172.21.15.98:0/2841241500 wait complete. 2024-09-10T04:53:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9069a57640 1 Processor -- start 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9069a57640 1 -- start start 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9069a57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9069a57640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9064051660 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9062ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9062ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42764/0 (socket says 172.21.15.98:42764) 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.634+0000 7f9062ffd640 1 -- 172.21.15.98:0/3810889123 learned_addr learned my addr 172.21.15.98:0/3810889123 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f9062ffd640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9064117450 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f9062ffd640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f905400c320 tx=0x7f905400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9054007410 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90540075d0 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9064129860 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9054004950 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.635+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9064117af0 con 0x7f906412beb0 2024-09-10T04:53:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f906412c290 con 0x7f906412beb0 2024-09-10T04:53:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9054011070 con 0x7f906412beb0 2024-09-10T04:53:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 0x7f9044040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f90540528a0 con 0x7f906412beb0 2024-09-10T04:53:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 0x7f904404c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9054011e70 con 0x7f904404a460 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f90540572a0 con 0x7f906412beb0 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f90627fc640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 0x7f9044040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.636+0000 7f90637fe640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 0x7f904404c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.637+0000 7f90637fe640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 0x7f904404c900 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.637+0000 7f90627fc640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 0x7f9044040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f904c034000 tx=0x7f904c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.638+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== osd.1 v2:172.21.15.145:6808/819540050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9054011e70 con 0x7f904404a460 2024-09-10T04:53:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.650+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 --> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90641183e0 con 0x7f904404a460 2024-09-10T04:53:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f905bfff640 1 -- 172.21.15.98:0/3810889123 <== osd.1 v2:172.21.15.145:6808/819540050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90641183e0 con 0x7f904404a460 2024-09-10T04:53:27.653 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T04:53:27.653 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T04:53:27.653 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T04:53:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 msgr2=0x7f904404c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 0x7f904404c900 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 msgr2=0x7f9044040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 0x7f9044040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f904c034000 tx=0x7f904c02e000 comp rx=0 tx=0).stop 2024-09-10T04:53:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 msgr2=0x7f9064124b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f905400c320 tx=0x7f905400c7e0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 shutdown_connections 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6808/819540050,v1:172.21.15.145:6809/819540050] conn(0x7f904404a460 0x7f904404c900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f904403de90 0x7f9044040350 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 --2- 172.21.15.98:0/3810889123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f906412beb0 0x7f9064124b90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 >> 172.21.15.98:0/3810889123 conn(0x7f90640705a0 msgr2=0x7f9064130e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 shutdown_connections 2024-09-10T04:53:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.651+0000 7f9069a57640 1 -- 172.21.15.98:0/3810889123 wait complete. 2024-09-10T04:53:27.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3109fc2640 1 Processor -- start 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3109fc2640 1 -- start start 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3109fc2640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3104070c00 0x7f3104070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3109fc2640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310406de00 con 0x7f3104071ec0 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3109fc2640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f3104069380 con 0x7f3104070c00 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f31037fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3104070c00 0x7f3104070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3102ffd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3104071ec0 0x7f310412b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42298/0 (socket says 172.21.15.98:42298) 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.759+0000 7f3102ffd640 1 -- 172.21.15.98:0/4114809635 learned_addr learned my addr 172.21.15.98:0/4114809635 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31037fe640 1 -- 172.21.15.98:0/4114809635 >> v1:172.21.15.98:6789/0 conn(0x7f3104071ec0 legacy=0x7f310412b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31037fe640 1 -- 172.21.15.98:0/4114809635 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310409ecd0 con 0x7f3104070c00 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31037fe640 1 --2- 172.21.15.98:0/4114809635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f3104070fe0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009720 tx=0x7f30f402b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76badfabf27b6dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31027fc640 1 -- 172.21.15.98:0/4114809635 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f4038070 con 0x7f3104070c00 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31027fc640 1 -- 172.21.15.98:0/4114809635 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4033440 con 0x7f3104070c00 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.760+0000 7f31027fc640 1 -- 172.21.15.98:0/4114809635 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f4033740 con 0x7f3104070c00 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 -- 172.21.15.98:0/4114809635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 msgr2=0x7f3104070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 --2- 172.21.15.98:0/4114809635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f3104070fe0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009720 tx=0x7f30f402b220 comp rx=0 tx=0).stop 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 -- 172.21.15.98:0/4114809635 shutdown_connections 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 --2- 172.21.15.98:0/4114809635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f3104070fe0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 -- 172.21.15.98:0/4114809635 >> 172.21.15.98:0/4114809635 conn(0x7f310409c640 msgr2=0x7f310406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 -- 172.21.15.98:0/4114809635 shutdown_connections 2024-09-10T04:53:27.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.761+0000 7f3109fc2640 1 -- 172.21.15.98:0/4114809635 wait complete. 2024-09-10T04:53:27.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.762+0000 7f3109fc2640 1 Processor -- start 2024-09-10T04:53:27.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.762+0000 7f3109fc2640 1 -- start start 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.762+0000 7f3109fc2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.762+0000 7f3109fc2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31040718b0 con 0x7f3104070c00 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.762+0000 7f31037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f31037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42776/0 (socket says 172.21.15.98:42776) 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f31037fe640 1 -- 172.21.15.98:0/2118612272 learned_addr learned my addr 172.21.15.98:0/2118612272 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f31037fe640 1 -- 172.21.15.98:0/2118612272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310411ee20 con 0x7f3104070c00 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f31037fe640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009840 tx=0x7f30f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f4040070 con 0x7f3104070c00 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f403a600 con 0x7f3104070c00 2024-09-10T04:53:27.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3104120080 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f403a900 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.763+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31041203b0 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.764+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30f404b060 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.764+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3104070fe0 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.764+0000 7f30ebfff640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 0x7f30f0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.764+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f30f4074d10 con 0x7f3104070c00 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.765+0000 7f3102ffd640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 0x7f30f0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:27.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.765+0000 7f3102ffd640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 0x7f30f0040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007fd0 tx=0x7f30f8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:27.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.769+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f30f404c3b0 con 0x7f3104070c00 2024-09-10T04:53:27.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.942+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3104073380 con 0x7f30f003de90 2024-09-10T04:53:27.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.942+0000 7f30ebfff640 1 -- 172.21.15.98:0/2118612272 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30f80058b0 con 0x7f30f003de90 2024-09-10T04:53:27.944 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 msgr2=0x7f30f0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 0x7f30f0040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30f8007fd0 tx=0x7f30f8007aa0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 msgr2=0x7f31041bfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009840 tx=0x7f30f40046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 shutdown_connections 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f30f003de90 0x7f30f0040350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 --2- 172.21.15.98:0/2118612272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3104070c00 0x7f31041bfcc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 >> 172.21.15.98:0/2118612272 conn(0x7f310409c640 msgr2=0x7f310412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.944+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 shutdown_connections 2024-09-10T04:53:27.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:27.945+0000 7f3109fc2640 1 -- 172.21.15.98:0/2118612272 wait complete. 2024-09-10T04:53:27.957 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T04:53:27.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.057+0000 7f82ece57640 1 Processor -- start 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.057+0000 7f82ece57640 1 -- start start 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.057+0000 7f82ece57640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f82e8130290 0x7f82e8132680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.057+0000 7f82ece57640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80733d0 con 0x7f82e81235f0 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.057+0000 7f82ece57640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f82e8114d60 con 0x7f82e8130290 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82e659c640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f82e81235f0 0x7f82e81239d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42304/0 (socket says 172.21.15.98:42304) 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82e659c640 1 -- 172.21.15.98:0/4128682936 learned_addr learned my addr 172.21.15.98:0/4128682936 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82ddd9b640 1 --2- 172.21.15.98:0/4128682936 >> v2:172.21.15.98:3300/0 conn(0x7f82e8130290 0x7f82e8132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82e5d9b640 1 -- 172.21.15.98:0/4128682936 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496890522 0 0) 0x7f82e80733d0 con 0x7f82e81235f0 2024-09-10T04:53:28.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82e5d9b640 1 -- 172.21.15.98:0/4128682936 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4003520 con 0x7f82e81235f0 2024-09-10T04:53:28.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82ddd9b640 1 -- 172.21.15.98:0/4128682936 >> v1:172.21.15.98:6789/0 conn(0x7f82e81235f0 legacy=0x7f82e81239d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.058+0000 7f82ddd9b640 1 -- 172.21.15.98:0/4128682936 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e81240e0 con 0x7f82e8130290 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ddd9b640 1 --2- 172.21.15.98:0/4128682936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e8130290 0x7f82e8132680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009720 tx=0x7f82d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87825a38dfdb545f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82e5d9b640 1 -- 172.21.15.98:0/4128682936 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82d0037070 con 0x7f82e8130290 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82e5d9b640 1 -- 172.21.15.98:0/4128682936 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d002ad90 con 0x7f82e8130290 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82e5d9b640 1 -- 172.21.15.98:0/4128682936 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82d0032590 con 0x7f82e8130290 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 -- 172.21.15.98:0/4128682936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e8130290 msgr2=0x7f82e8132680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 --2- 172.21.15.98:0/4128682936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e8130290 0x7f82e8132680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009720 tx=0x7f82d002a110 comp rx=0 tx=0).stop 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 -- 172.21.15.98:0/4128682936 shutdown_connections 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 --2- 172.21.15.98:0/4128682936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e8130290 0x7f82e8132680 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 -- 172.21.15.98:0/4128682936 >> 172.21.15.98:0/4128682936 conn(0x7f82e8070210 msgr2=0x7f82e8072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 -- 172.21.15.98:0/4128682936 shutdown_connections 2024-09-10T04:53:28.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.059+0000 7f82ece57640 1 -- 172.21.15.98:0/4128682936 wait complete. 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.060+0000 7f82ece57640 1 Processor -- start 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.060+0000 7f82ece57640 1 -- start start 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82ece57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82ece57640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8114380 con 0x7f82e81235f0 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82e659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82e659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42786/0 (socket says 172.21.15.98:42786) 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82e659c640 1 -- 172.21.15.98:0/3786735048 learned_addr learned my addr 172.21.15.98:0/3786735048 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:28.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82e659c640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e812e1f0 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82e659c640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c480 tx=0x7f82d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82d8017070 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d8005cd0 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e812cf50 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.061+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82d8007200 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.062+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e812dc60 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.062+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82e81239d0 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.062+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f82d801a070 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82df7fe640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 0x7f82c8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f82d8052080 con 0x7f82e81235f0 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82df7fe640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 0x7f82c804c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82c804cfd0 con 0x7f82c804a460 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f82d8059050 con 0x7f82e81235f0 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82ddd9b640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 0x7f82c8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.063+0000 7f82e6d9d640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 0x7f82c804c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.064+0000 7f82e6d9d640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 0x7f82c804c900 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.064+0000 7f82ddd9b640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 0x7f82c8040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009720 tx=0x7f82d002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.064+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== osd.2 v2:172.21.15.145:6816/1789112018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82c804cfd0 con 0x7f82c804a460 2024-09-10T04:53:28.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.076+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 --> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82e812fdd0 con 0x7f82c804a460 2024-09-10T04:53:28.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82df7fe640 1 -- 172.21.15.98:0/3786735048 <== osd.2 v2:172.21.15.145:6816/1789112018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f82e812fdd0 con 0x7f82c804a460 2024-09-10T04:53:28.079 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T04:53:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T04:53:28.079 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T04:53:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 msgr2=0x7f82c804c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 0x7f82c804c900 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 msgr2=0x7f82c8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 0x7f82c8040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009720 tx=0x7f82d002e000 comp rx=0 tx=0).stop 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 msgr2=0x7f82e812ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c480 tx=0x7f82d800c940 comp rx=0 tx=0).stop 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 shutdown_connections 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6816/1789112018,v1:172.21.15.145:6817/1789112018] conn(0x7f82c804a460 0x7f82c804c900 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f82c803de90 0x7f82c8040350 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.077+0000 7f82ece57640 1 --2- 172.21.15.98:0/3786735048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82e81235f0 0x7f82e812ebb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.078+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 >> 172.21.15.98:0/3786735048 conn(0x7f82e8070210 msgr2=0x7f82e8121ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.078+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 shutdown_connections 2024-09-10T04:53:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.078+0000 7f82ece57640 1 -- 172.21.15.98:0/3786735048 wait complete. 2024-09-10T04:53:28.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T04:53:28.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.185+0000 7f45c03f5640 1 Processor -- start 2024-09-10T04:53:28.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.185+0000 7f45c03f5640 1 -- start start 2024-09-10T04:53:28.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45c03f5640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45b8071d10 0x7f45b80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45c03f5640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b8073050 con 0x7f45b809ecd0 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45c03f5640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f45b8073600 con 0x7f45b8071d10 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45be191640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f45b8071d10 0x7f45b80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45bd990640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f45b809ecd0 0x7f45b8125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42312/0 (socket says 172.21.15.98:42312) 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45bd990640 1 -- 172.21.15.98:0/556057973 learned_addr learned my addr 172.21.15.98:0/556057973 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45be191640 1 -- 172.21.15.98:0/556057973 >> v1:172.21.15.98:6789/0 conn(0x7f45b809ecd0 legacy=0x7f45b8125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45be191640 1 -- 172.21.15.98:0/556057973 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80732f0 con 0x7f45b8071d10 2024-09-10T04:53:28.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.186+0000 7f45bd18f640 1 -- 172.21.15.98:0/556057973 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897040803 0 0) 0x7f45a8001110 con 0x7f45b809ecd0 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.187+0000 7f45be191640 1 --2- 172.21.15.98:0/556057973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b80720f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009720 tx=0x7f45b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d4a4cf01ce4846 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.187+0000 7f45bd18f640 1 -- 172.21.15.98:0/556057973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b4037070 con 0x7f45b8071d10 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.187+0000 7f45bd18f640 1 -- 172.21.15.98:0/556057973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b402ad90 con 0x7f45b8071d10 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.187+0000 7f45bd18f640 1 -- 172.21.15.98:0/556057973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b4032590 con 0x7f45b8071d10 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 -- 172.21.15.98:0/556057973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 msgr2=0x7f45b80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 --2- 172.21.15.98:0/556057973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b80720f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009720 tx=0x7f45b402a110 comp rx=0 tx=0).stop 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 -- 172.21.15.98:0/556057973 shutdown_connections 2024-09-10T04:53:28.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 --2- 172.21.15.98:0/556057973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b80720f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 -- 172.21.15.98:0/556057973 >> 172.21.15.98:0/556057973 conn(0x7f45b809c640 msgr2=0x7f45b806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 -- 172.21.15.98:0/556057973 shutdown_connections 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.188+0000 7f45c03f5640 1 -- 172.21.15.98:0/556057973 wait complete. 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45c03f5640 1 Processor -- start 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45c03f5640 1 -- start start 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45c03f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45c03f5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45b80727b0 con 0x7f45b8071d10 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45be191640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45be191640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42796/0 (socket says 172.21.15.98:42796) 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45be191640 1 -- 172.21.15.98:0/2249133055 learned_addr learned my addr 172.21.15.98:0/2249133055 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:28.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.189+0000 7f45be191640 1 -- 172.21.15.98:0/2249133055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b811f790 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45be191640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009720 tx=0x7f45b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b4041070 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b403c460 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b812b6e0 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b4037040 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.190+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b811fa90 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.191+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f45b4044070 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.191+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b811fd80 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.191+0000 7f45aeffd640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 0x7f459c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.191+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f45b40737c0 con 0x7f45b8071d10 2024-09-10T04:53:28.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.191+0000 7f45bd990640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 0x7f459c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.192+0000 7f45bd990640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 0x7f459c040380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f45a8000c00 tx=0x7f45a8001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.195+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f45b403d3f0 con 0x7f45b8071d10 2024-09-10T04:53:28.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.368+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f45b80720f0 con 0x7f459c03dec0 2024-09-10T04:53:28.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.369+0000 7f45aeffd640 1 -- 172.21.15.98:0/2249133055 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45b80720f0 con 0x7f459c03dec0 2024-09-10T04:53:28.371 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 msgr2=0x7f459c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 0x7f459c040380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f45a8000c00 tx=0x7f45a8001250 comp rx=0 tx=0).stop 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 msgr2=0x7f45b8129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009720 tx=0x7f45b40046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 shutdown_connections 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f459c03dec0 0x7f459c040380 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 --2- 172.21.15.98:0/2249133055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45b8071d10 0x7f45b8129fb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 >> 172.21.15.98:0/2249133055 conn(0x7f45b809c640 msgr2=0x7f45b812c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 shutdown_connections 2024-09-10T04:53:28.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.372+0000 7f45c03f5640 1 -- 172.21.15.98:0/2249133055 wait complete. 2024-09-10T04:53:28.384 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T04:53:28.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T04:53:28.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.483+0000 7fe61a6b8640 1 Processor -- start 2024-09-10T04:53:28.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe61a6b8640 1 -- start start 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe61a6b8640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6141325e0 0x7fe6141349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe61a6b8640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe614116d50 con 0x7fe61412bed0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe61a6b8640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fe6141170f0 con 0x7fe6141325e0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe6137fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6141325e0 0x7fe6141349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe613fff640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe61412bed0 0x7fe61412c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42320/0 (socket says 172.21.15.98:42320) 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe6137fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe6141325e0 0x7fe6141349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42804/0 (socket says 172.21.15.98:42804) 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe613fff640 1 -- 172.21.15.98:0/773475818 learned_addr learned my addr 172.21.15.98:0/773475818 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe6137fe640 1 -- 172.21.15.98:0/773475818 >> v1:172.21.15.98:6789/0 conn(0x7fe61412bed0 legacy=0x7fe61412c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.484+0000 7fe6137fe640 1 -- 172.21.15.98:0/773475818 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe614115df0 con 0x7fe6141325e0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.485+0000 7fe6137fe640 1 --2- 172.21.15.98:0/773475818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6141325e0 0x7fe6141349d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009720 tx=0x7fe5fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d9ab6c8ba466d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.485+0000 7fe612ffd640 1 -- 172.21.15.98:0/773475818 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5fc037070 con 0x7fe6141325e0 2024-09-10T04:53:28.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.485+0000 7fe612ffd640 1 -- 172.21.15.98:0/773475818 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc02ad90 con 0x7fe6141325e0 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.485+0000 7fe612ffd640 1 -- 172.21.15.98:0/773475818 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5fc032590 con 0x7fe6141325e0 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 -- 172.21.15.98:0/773475818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6141325e0 msgr2=0x7fe6141349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/773475818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6141325e0 0x7fe6141349d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009720 tx=0x7fe5fc02a110 comp rx=0 tx=0).stop 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 -- 172.21.15.98:0/773475818 shutdown_connections 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/773475818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6141325e0 0x7fe6141349d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 -- 172.21.15.98:0/773475818 >> 172.21.15.98:0/773475818 conn(0x7fe61406fb60 msgr2=0x7fe614071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 -- 172.21.15.98:0/773475818 shutdown_connections 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.486+0000 7fe61a6b8640 1 -- 172.21.15.98:0/773475818 wait complete. 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe61a6b8640 1 Processor -- start 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe61a6b8640 1 -- start start 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe61a6b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe61a6b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe6141166c0 con 0x7fe61412bed0 2024-09-10T04:53:28.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe613fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe613fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42820/0 (socket says 172.21.15.98:42820) 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.487+0000 7fe613fff640 1 -- 172.21.15.98:0/2440239246 learned_addr learned my addr 172.21.15.98:0/2440239246 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe613fff640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe614117320 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe613fff640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c380 tx=0x7fe60400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe604017070 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe604005c10 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6040070d0 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe614118990 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.488+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6140718d0 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe614118150 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe60401a070 con 0x7fe61412bed0 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 0x7fe5f4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fe604052040 con 0x7fe61412bed0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 0x7fe5f404c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe604014ec0 con 0x7fe5f404a460 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe604059050 con 0x7fe61412bed0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe6137fe640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 0x7fe5f4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.489+0000 7fe618c55640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 0x7fe5f404c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.490+0000 7fe618c55640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 0x7fe5f404c900 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.490+0000 7fe6137fe640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 0x7fe5f4040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc034000 tx=0x7fe5fc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.491+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== osd.3 v2:172.21.15.145:6800/4228232102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe604014ec0 con 0x7fe5f404a460 2024-09-10T04:53:28.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.503+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 --> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe614117d40 con 0x7fe5f404a460 2024-09-10T04:53:28.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.503+0000 7fe610ff9640 1 -- 172.21.15.98:0/2440239246 <== osd.3 v2:172.21.15.145:6800/4228232102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe60c00ad10 con 0x7fe5f404a460 2024-09-10T04:53:28.505 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T04:53:28.505 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T04:53:28.506 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T04:53:28.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.503+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 msgr2=0x7fe5f404c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 0x7fe5f404c900 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 msgr2=0x7fe5f4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 0x7fe5f4040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc034000 tx=0x7fe5fc02e000 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 msgr2=0x7fe614071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c380 tx=0x7fe60400c840 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 shutdown_connections 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6800/4228232102,v1:172.21.15.145:6801/4228232102] conn(0x7fe5f404a460 0x7fe5f404c900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fe5f403de90 0x7fe5f4040350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 --2- 172.21.15.98:0/2440239246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61412bed0 0x7fe614071390 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 >> 172.21.15.98:0/2440239246 conn(0x7fe61406fb60 msgr2=0x7fe614128640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 shutdown_connections 2024-09-10T04:53:28.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.504+0000 7fe61a6b8640 1 -- 172.21.15.98:0/2440239246 wait complete. 2024-09-10T04:53:28.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T04:53:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.612+0000 7f0d6097c640 1 Processor -- start 2024-09-10T04:53:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.612+0000 7f0d6097c640 1 -- start start 2024-09-10T04:53:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d6097c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d5c071d10 0x7f0d5c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d6097c640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c073050 con 0x7f0d5c09ecd0 2024-09-10T04:53:28.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d6097c640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c073600 con 0x7f0d5c071d10 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d5a59c640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0d5c071d10 0x7f0d5c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d51d9b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0d5c09ecd0 0x7f0d5c125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42328/0 (socket says 172.21.15.98:42328) 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d51d9b640 1 -- 172.21.15.98:0/659258634 learned_addr learned my addr 172.21.15.98:0/659258634 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d5a59c640 1 -- 172.21.15.98:0/659258634 >> v1:172.21.15.98:6789/0 conn(0x7f0d5c09ecd0 legacy=0x7f0d5c125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d5a59c640 1 -- 172.21.15.98:0/659258634 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0732f0 con 0x7f0d5c071d10 2024-09-10T04:53:28.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.613+0000 7f0d59d9b640 1 -- 172.21.15.98:0/659258634 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085882264 0 0) 0x7f0d44001110 con 0x7f0d5c09ecd0 2024-09-10T04:53:28.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d5a59c640 1 --2- 172.21.15.98:0/659258634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c0720f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009720 tx=0x7f0d4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cf2b0a52eae09c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d59d9b640 1 -- 172.21.15.98:0/659258634 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c037070 con 0x7f0d5c071d10 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d59d9b640 1 -- 172.21.15.98:0/659258634 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c02ad90 con 0x7f0d5c071d10 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d59d9b640 1 -- 172.21.15.98:0/659258634 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c032590 con 0x7f0d5c071d10 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 -- 172.21.15.98:0/659258634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 msgr2=0x7f0d5c0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 --2- 172.21.15.98:0/659258634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c0720f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009720 tx=0x7f0d4c02a110 comp rx=0 tx=0).stop 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 -- 172.21.15.98:0/659258634 shutdown_connections 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 --2- 172.21.15.98:0/659258634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c0720f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 -- 172.21.15.98:0/659258634 >> 172.21.15.98:0/659258634 conn(0x7f0d5c09c640 msgr2=0x7f0d5c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 -- 172.21.15.98:0/659258634 shutdown_connections 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.614+0000 7f0d6097c640 1 -- 172.21.15.98:0/659258634 wait complete. 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.615+0000 7f0d6097c640 1 Processor -- start 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.615+0000 7f0d6097c640 1 -- start start 2024-09-10T04:53:28.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d6097c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d6097c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0727b0 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42846/0 (socket says 172.21.15.98:42846) 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d5a59c640 1 -- 172.21.15.98:0/615493567 learned_addr learned my addr 172.21.15.98:0/615493567 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d5a59c640 1 -- 172.21.15.98:0/615493567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c11cc20 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d5a59c640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009720 tx=0x7f0d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c041070 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.616+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c03c460 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.617+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c126750 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.617+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c037040 con 0x7f0d5c071d10 2024-09-10T04:53:28.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.617+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c117d30 con 0x7f0d5c071d10 2024-09-10T04:53:28.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.618+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c0720f0 con 0x7f0d5c071d10 2024-09-10T04:53:28.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.618+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0d4c044070 con 0x7f0d5c071d10 2024-09-10T04:53:28.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.618+0000 7f0d537fe640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 0x7f0d3c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.618+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f0d4c0735f0 con 0x7f0d5c071d10 2024-09-10T04:53:28.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.618+0000 7f0d51d9b640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 0x7f0d3c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.619+0000 7f0d51d9b640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 0x7f0d3c040380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000c00 tx=0x7f0d44001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.622+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0d4c03cc60 con 0x7f0d5c071d10 2024-09-10T04:53:28.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.797+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f0d5c068da0 con 0x7f0d3c03dec0 2024-09-10T04:53:28.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.798+0000 7f0d537fe640 1 -- 172.21.15.98:0/615493567 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d5c068da0 con 0x7f0d3c03dec0 2024-09-10T04:53:28.800 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T04:53:28.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 msgr2=0x7f0d3c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 0x7f0d3c040380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000c00 tx=0x7f0d44001250 comp rx=0 tx=0).stop 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 msgr2=0x7f0d5c125680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009720 tx=0x7f0d4c0046c0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 shutdown_connections 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f0d3c03dec0 0x7f0d3c040380 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 --2- 172.21.15.98:0/615493567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d5c071d10 0x7f0d5c125680 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 >> 172.21.15.98:0/615493567 conn(0x7f0d5c09c640 msgr2=0x7f0d5c126980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 shutdown_connections 2024-09-10T04:53:28.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.800+0000 7f0d6097c640 1 -- 172.21.15.98:0/615493567 wait complete. 2024-09-10T04:53:28.813 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:53:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.909+0000 7f8cfb8bf640 1 Processor -- start 2024-09-10T04:53:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cfb8bf640 1 -- start start 2024-09-10T04:53:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cfb8bf640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cf4073020 0x7f8cf4134680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cfb8bf640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf4071de0 con 0x7f8cf4072530 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cfb8bf640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf4072220 con 0x7f8cf4073020 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cf8e5a640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8cf4073020 0x7f8cf4134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cf965b640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f8cf4072530 0x7f8cf4072910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:42340/0 (socket says 172.21.15.98:42340) 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cf965b640 1 -- 172.21.15.98:0/1425669699 learned_addr learned my addr 172.21.15.98:0/1425669699 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cf8e5a640 1 -- 172.21.15.98:0/1425669699 >> v1:172.21.15.98:6789/0 conn(0x7f8cf4072530 legacy=0x7f8cf4072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.910+0000 7f8cf8e5a640 1 -- 172.21.15.98:0/1425669699 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4073440 con 0x7f8cf4073020 2024-09-10T04:53:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.911+0000 7f8cf8e5a640 1 --2- 172.21.15.98:0/1425669699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4073020 0x7f8cf4134680 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009720 tx=0x7f8cf002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5674fd86dbc390f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.911+0000 7f8ce7fff640 1 -- 172.21.15.98:0/1425669699 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0037070 con 0x7f8cf4073020 2024-09-10T04:53:28.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.911+0000 7f8ce7fff640 1 -- 172.21.15.98:0/1425669699 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf002ad90 con 0x7f8cf4073020 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.911+0000 7f8ce7fff640 1 -- 172.21.15.98:0/1425669699 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0032590 con 0x7f8cf4073020 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1425669699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4073020 msgr2=0x7f8cf4134680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1425669699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4073020 0x7f8cf4134680 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009720 tx=0x7f8cf002a110 comp rx=0 tx=0).stop 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1425669699 shutdown_connections 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1425669699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4073020 0x7f8cf4134680 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1425669699 >> 172.21.15.98:0/1425669699 conn(0x7f8cf40a09c0 msgr2=0x7f8cf40a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1425669699 shutdown_connections 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.912+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1425669699 wait complete. 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cfb8bf640 1 Processor -- start 2024-09-10T04:53:28.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cfb8bf640 1 -- start start 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cfb8bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cfb8bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4134f50 con 0x7f8cf4072530 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cf965b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cf965b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42864/0 (socket says 172.21.15.98:42864) 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cf965b640 1 -- 172.21.15.98:0/1597701478 learned_addr learned my addr 172.21.15.98:0/1597701478 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cf965b640 1 -- 172.21.15.98:0/1597701478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf411a700 con 0x7f8cf4072530 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.913+0000 7f8cf965b640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c380 tx=0x7f8ce800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.914+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8017070 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.914+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8005c10 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.914+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf411a4c0 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.914+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80070d0 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.914+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf411b410 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.915+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8ce801a070 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.915+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf4072910 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.915+0000 7f8ce5ffb640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 0x7f8cd8040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.915+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f8ce8051fe0 con 0x7f8cf4072530 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.915+0000 7f8cf8e5a640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 0x7f8cd8040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:28.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.916+0000 7f8cf8e5a640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 0x7f8cd8040380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0034000 tx=0x7f8cf002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:28.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:28.919+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8cf411b410 con 0x7f8cf4072530 2024-09-10T04:53:29.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.090+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf411bd60 con 0x7f8cd803dec0 2024-09-10T04:53:29.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.100+0000 7f8ce5ffb640 1 -- 172.21.15.98:0/1597701478 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666095 (secure 0 0 0) 0x7f8cf0032710 con 0x7f8cd803dec0 2024-09-10T04:53:29.109 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:29.114 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 msgr2=0x7f8cd8040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 0x7f8cd8040380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0034000 tx=0x7f8cf002e000 comp rx=0 tx=0).stop 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 msgr2=0x7f8cf4128440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c380 tx=0x7f8ce800c840 comp rx=0 tx=0).stop 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 shutdown_connections 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f8cd803dec0 0x7f8cd8040380 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 --2- 172.21.15.98:0/1597701478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf4072530 0x7f8cf4128440 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:29.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 >> 172.21.15.98:0/1597701478 conn(0x7f8cf40a09c0 msgr2=0x7f8cf412d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:29.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 shutdown_connections 2024-09-10T04:53:29.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:29.105+0000 7f8cfb8bf640 1 -- 172.21.15.98:0/1597701478 wait complete. 2024-09-10T04:53:29.118 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-10T04:53:27.254646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.213647+0000","last_change":"2024-09-10T04:50:08.836558+0000","last_active":"2024-09-10T04:50:51.213647+0000","last_peered":"2024-09-10T04:50:51.213647+0000","last_clean":"2024-09-10T04:50:51.213647+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:50:51.213647+0000","last_undegraded":"2024-09-10T04:50:51.213647+0000","last_fullsized":"2024-09-10T04:50:51.213647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:07.611919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874886+0000","last_change":"2024-09-10T04:50:10.827523+0000","last_active":"2024-09-10T04:50:48.874886+0000","last_peered":"2024-09-10T04:50:48.874886+0000","last_clean":"2024-09-10T04:50:48.874886+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:50:48.874886+0000","last_undegraded":"2024-09-10T04:50:48.874886+0000","last_fullsized":"2024-09-10T04:50:48.874886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:56.905163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:13.223901+0000","last_change":"2024-09-10T04:50:08.848586+0000","last_active":"2024-09-10T04:52:13.223901+0000","last_peered":"2024-09-10T04:52:13.223901+0000","last_clean":"2024-09-10T04:52:13.223901+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:52:13.223901+0000","last_undegraded":"2024-09-10T04:52:13.223901+0000","last_fullsized":"2024-09-10T04:52:13.223901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671414+0000","last_change":"2024-09-10T04:50:10.819187+0000","last_active":"2024-09-10T04:53:17.671414+0000","last_peered":"2024-09-10T04:53:17.671414+0000","last_clean":"2024-09-10T04:53:17.671414+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:53:17.671414+0000","last_undegraded":"2024-09-10T04:53:17.671414+0000","last_fullsized":"2024-09-10T04:53:17.671414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:41.828061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881449+0000","last_change":"2024-09-10T04:50:08.839328+0000","last_active":"2024-09-10T04:50:48.881449+0000","last_peered":"2024-09-10T04:50:48.881449+0000","last_clean":"2024-09-10T04:50:48.881449+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:50:48.881449+0000","last_undegraded":"2024-09-10T04:50:48.881449+0000","last_fullsized":"2024-09-10T04:50:48.881449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:21.710828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732731+0000","last_change":"2024-09-10T04:50:48.879830+0000","last_active":"2024-09-10T04:51:33.732731+0000","last_peered":"2024-09-10T04:51:33.732731+0000","last_clean":"2024-09-10T04:51:33.732731+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:51:33.732731+0000","last_undegraded":"2024-09-10T04:51:33.732731+0000","last_fullsized":"2024-09-10T04:51:33.732731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:59.179205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871764+0000","last_change":"2024-09-10T04:50:08.841951+0000","last_active":"2024-09-10T04:50:48.871764+0000","last_peered":"2024-09-10T04:50:48.871764+0000","last_clean":"2024-09-10T04:50:48.871764+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:50:48.871764+0000","last_undegraded":"2024-09-10T04:50:48.871764+0000","last_fullsized":"2024-09-10T04:50:48.871764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:00.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.201672+0000","last_change":"2024-09-10T04:50:48.879883+0000","last_active":"2024-09-10T04:52:14.201672+0000","last_peered":"2024-09-10T04:52:14.201672+0000","last_clean":"2024-09-10T04:52:14.201672+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:52:14.201672+0000","last_undegraded":"2024-09-10T04:52:14.201672+0000","last_fullsized":"2024-09-10T04:52:14.201672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:08.771696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875513+0000","last_change":"2024-09-10T04:50:08.836256+0000","last_active":"2024-09-10T04:50:48.875513+0000","last_peered":"2024-09-10T04:50:48.875513+0000","last_clean":"2024-09-10T04:50:48.875513+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:50:48.875513+0000","last_undegraded":"2024-09-10T04:50:48.875513+0000","last_fullsized":"2024-09-10T04:50:48.875513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:21.447084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702019+0000","last_change":"2024-09-10T04:50:10.823009+0000","last_active":"2024-09-10T04:50:51.702019+0000","last_peered":"2024-09-10T04:50:51.702019+0000","last_clean":"2024-09-10T04:50:51.702019+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:50:51.702019+0000","last_undegraded":"2024-09-10T04:50:51.702019+0000","last_fullsized":"2024-09-10T04:50:51.702019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.897024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875751+0000","last_change":"2024-09-10T04:50:08.837428+0000","last_active":"2024-09-10T04:50:48.875751+0000","last_peered":"2024-09-10T04:50:48.875751+0000","last_clean":"2024-09-10T04:50:48.875751+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:50:48.875751+0000","last_undegraded":"2024-09-10T04:50:48.875751+0000","last_fullsized":"2024-09-10T04:50:48.875751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:13.131981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671731+0000","last_change":"2024-09-10T04:50:10.832647+0000","last_active":"2024-09-10T04:53:17.671731+0000","last_peered":"2024-09-10T04:53:17.671731+0000","last_clean":"2024-09-10T04:53:17.671731+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:53:17.671731+0000","last_undegraded":"2024-09-10T04:53:17.671731+0000","last_fullsized":"2024-09-10T04:53:17.671731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:30.079691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.878085+0000","last_change":"2024-09-10T04:50:08.834170+0000","last_active":"2024-09-10T04:53:17.878085+0000","last_peered":"2024-09-10T04:53:17.878085+0000","last_clean":"2024-09-10T04:53:17.878085+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:17.878085+0000","last_undegraded":"2024-09-10T04:53:17.878085+0000","last_fullsized":"2024-09-10T04:53:17.878085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:23.894994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732327+0000","last_change":"2024-09-10T04:50:10.825623+0000","last_active":"2024-09-10T04:51:33.732327+0000","last_peered":"2024-09-10T04:51:33.732327+0000","last_clean":"2024-09-10T04:51:33.732327+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:51:33.732327+0000","last_undegraded":"2024-09-10T04:51:33.732327+0000","last_fullsized":"2024-09-10T04:51:33.732327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.611215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.881294+0000","last_change":"2024-09-10T04:50:08.842334+0000","last_active":"2024-09-10T04:53:17.881294+0000","last_peered":"2024-09-10T04:53:17.881294+0000","last_clean":"2024-09-10T04:53:17.881294+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:17.881294+0000","last_undegraded":"2024-09-10T04:53:17.881294+0000","last_fullsized":"2024-09-10T04:53:17.881294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:03.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.022533+0000","last_change":"2024-09-10T04:50:10.831636+0000","last_active":"2024-09-10T04:53:18.022533+0000","last_peered":"2024-09-10T04:53:18.022533+0000","last_clean":"2024-09-10T04:53:18.022533+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:18.022533+0000","last_undegraded":"2024-09-10T04:53:18.022533+0000","last_fullsized":"2024-09-10T04:53:18.022533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:51.773869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949263+0000","last_change":"2024-09-10T04:50:10.827812+0000","last_active":"2024-09-10T04:53:17.949263+0000","last_peered":"2024-09-10T04:53:17.949263+0000","last_clean":"2024-09-10T04:53:17.949263+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:17.949263+0000","last_undegraded":"2024-09-10T04:53:17.949263+0000","last_fullsized":"2024-09-10T04:53:17.949263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.617778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879684+0000","last_change":"2024-09-10T04:50:08.849290+0000","last_active":"2024-09-10T04:50:48.879684+0000","last_peered":"2024-09-10T04:50:48.879684+0000","last_clean":"2024-09-10T04:50:48.879684+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:50:48.879684+0000","last_undegraded":"2024-09-10T04:50:48.879684+0000","last_fullsized":"2024-09-10T04:50:48.879684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:01.331992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.230916+0000","last_change":"2024-09-10T04:50:10.825696+0000","last_active":"2024-09-10T04:50:51.230916+0000","last_peered":"2024-09-10T04:50:51.230916+0000","last_clean":"2024-09-10T04:50:51.230916+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:50:51.230916+0000","last_undegraded":"2024-09-10T04:50:51.230916+0000","last_fullsized":"2024-09-10T04:50:51.230916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:21.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.249384+0000","last_change":"2024-09-10T04:50:08.855614+0000","last_active":"2024-09-10T04:52:17.249384+0000","last_peered":"2024-09-10T04:52:17.249384+0000","last_clean":"2024-09-10T04:52:17.249384+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:52:17.249384+0000","last_undegraded":"2024-09-10T04:52:17.249384+0000","last_fullsized":"2024-09-10T04:52:17.249384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:52.782524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.219735+0000","last_change":"2024-09-10T04:50:08.838188+0000","last_active":"2024-09-10T04:50:51.219735+0000","last_peered":"2024-09-10T04:50:51.219735+0000","last_clean":"2024-09-10T04:50:51.219735+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:50:51.219735+0000","last_undegraded":"2024-09-10T04:50:51.219735+0000","last_fullsized":"2024-09-10T04:50:51.219735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:02.357191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874666+0000","last_change":"2024-09-10T04:50:10.831149+0000","last_active":"2024-09-10T04:50:48.874666+0000","last_peered":"2024-09-10T04:50:48.874666+0000","last_clean":"2024-09-10T04:50:48.874666+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:50:48.874666+0000","last_undegraded":"2024-09-10T04:50:48.874666+0000","last_fullsized":"2024-09-10T04:50:48.874666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.512694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875939+0000","last_change":"2024-09-10T04:50:08.836996+0000","last_active":"2024-09-10T04:50:48.875939+0000","last_peered":"2024-09-10T04:50:48.875939+0000","last_clean":"2024-09-10T04:50:48.875939+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:50:48.875939+0000","last_undegraded":"2024-09-10T04:50:48.875939+0000","last_fullsized":"2024-09-10T04:50:48.875939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:37.196606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732464+0000","last_change":"2024-09-10T04:50:10.824023+0000","last_active":"2024-09-10T04:51:33.732464+0000","last_peered":"2024-09-10T04:51:33.732464+0000","last_clean":"2024-09-10T04:51:33.732464+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:51:33.732464+0000","last_undegraded":"2024-09-10T04:51:33.732464+0000","last_fullsized":"2024-09-10T04:51:33.732464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.559546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.545371+0000","last_change":"2024-09-10T04:50:08.846235+0000","last_active":"2024-09-10T04:53:17.545371+0000","last_peered":"2024-09-10T04:53:17.545371+0000","last_clean":"2024-09-10T04:53:17.545371+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:17.545371+0000","last_undegraded":"2024-09-10T04:53:17.545371+0000","last_fullsized":"2024-09-10T04:53:17.545371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:03.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954024+0000","last_change":"2024-09-10T04:50:10.831903+0000","last_active":"2024-09-10T04:53:17.954024+0000","last_peered":"2024-09-10T04:53:17.954024+0000","last_clean":"2024-09-10T04:53:17.954024+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:17.954024+0000","last_undegraded":"2024-09-10T04:53:17.954024+0000","last_fullsized":"2024-09-10T04:53:17.954024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:04.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879338+0000","last_change":"2024-09-10T04:50:08.838274+0000","last_active":"2024-09-10T04:50:48.879338+0000","last_peered":"2024-09-10T04:50:48.879338+0000","last_clean":"2024-09-10T04:50:48.879338+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:50:48.879338+0000","last_undegraded":"2024-09-10T04:50:48.879338+0000","last_fullsized":"2024-09-10T04:50:48.879338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:40.373059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.763257+0000","last_change":"2024-09-10T04:50:10.827657+0000","last_active":"2024-09-10T04:53:17.763257+0000","last_peered":"2024-09-10T04:53:17.763257+0000","last_clean":"2024-09-10T04:53:17.763257+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:17.763257+0000","last_undegraded":"2024-09-10T04:53:17.763257+0000","last_fullsized":"2024-09-10T04:53:17.763257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:10.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.722381+0000","last_change":"2024-09-10T04:50:08.845982+0000","last_active":"2024-09-10T04:51:33.722381+0000","last_peered":"2024-09-10T04:51:33.722381+0000","last_clean":"2024-09-10T04:51:33.722381+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:51:33.722381+0000","last_undegraded":"2024-09-10T04:51:33.722381+0000","last_fullsized":"2024-09-10T04:51:33.722381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:28.921046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.840707+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:52:15.840707+0000","last_peered":"2024-09-10T04:52:15.840707+0000","last_clean":"2024-09-10T04:52:15.840707+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:52:15.840707+0000","last_undegraded":"2024-09-10T04:52:15.840707+0000","last_fullsized":"2024-09-10T04:52:15.840707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228840+0000","last_change":"2024-09-10T04:50:10.818723+0000","last_active":"2024-09-10T04:52:38.228840+0000","last_peered":"2024-09-10T04:52:38.228840+0000","last_clean":"2024-09-10T04:52:38.228840+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:52:38.228840+0000","last_undegraded":"2024-09-10T04:52:38.228840+0000","last_fullsized":"2024-09-10T04:52:38.228840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:32.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.891329+0000","last_change":"2024-09-10T04:50:08.842024+0000","last_active":"2024-09-10T04:53:17.891329+0000","last_peered":"2024-09-10T04:53:17.891329+0000","last_clean":"2024-09-10T04:53:17.891329+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:17.891329+0000","last_undegraded":"2024-09-10T04:53:17.891329+0000","last_fullsized":"2024-09-10T04:53:17.891329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:36.641361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203915+0000","last_change":"2024-09-10T04:50:10.823064+0000","last_active":"2024-09-10T04:52:14.203915+0000","last_peered":"2024-09-10T04:52:14.203915+0000","last_clean":"2024-09-10T04:52:14.203915+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:52:14.203915+0000","last_undegraded":"2024-09-10T04:52:14.203915+0000","last_fullsized":"2024-09-10T04:52:14.203915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:26.449576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874566+0000","last_change":"2024-09-10T04:50:08.837572+0000","last_active":"2024-09-10T04:50:48.874566+0000","last_peered":"2024-09-10T04:50:48.874566+0000","last_clean":"2024-09-10T04:50:48.874566+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:50:48.874566+0000","last_undegraded":"2024-09-10T04:50:48.874566+0000","last_fullsized":"2024-09-10T04:50:48.874566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:06.915826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871643+0000","last_change":"2024-09-10T04:50:14.831883+0000","last_active":"2024-09-10T04:50:48.871643+0000","last_peered":"2024-09-10T04:50:48.871643+0000","last_clean":"2024-09-10T04:50:48.871643+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:50:48.871643+0000","last_undegraded":"2024-09-10T04:50:48.871643+0000","last_fullsized":"2024-09-10T04:50:48.871643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:08.755472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910428+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:17.910428+0000","last_peered":"2024-09-10T04:53:17.910428+0000","last_clean":"2024-09-10T04:53:17.910428+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:17.910428+0000","last_undegraded":"2024-09-10T04:53:17.910428+0000","last_fullsized":"2024-09-10T04:53:17.910428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898545+0000","last_change":"2024-09-10T04:50:10.825749+0000","last_active":"2024-09-10T04:53:17.898545+0000","last_peered":"2024-09-10T04:53:17.898545+0000","last_clean":"2024-09-10T04:53:17.898545+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:17.898545+0000","last_undegraded":"2024-09-10T04:53:17.898545+0000","last_fullsized":"2024-09-10T04:53:17.898545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:53.153695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874420+0000","last_change":"2024-09-10T04:50:08.828799+0000","last_active":"2024-09-10T04:50:48.874420+0000","last_peered":"2024-09-10T04:50:48.874420+0000","last_clean":"2024-09-10T04:50:48.874420+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:50:48.874420+0000","last_undegraded":"2024-09-10T04:50:48.874420+0000","last_fullsized":"2024-09-10T04:50:48.874420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:51.598705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.835230+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:52:15.835230+0000","last_peered":"2024-09-10T04:52:15.835230+0000","last_clean":"2024-09-10T04:52:15.835230+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:52:15.835230+0000","last_undegraded":"2024-09-10T04:52:15.835230+0000","last_fullsized":"2024-09-10T04:52:15.835230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.073926+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:18.073926+0000","last_peered":"2024-09-10T04:53:18.073926+0000","last_clean":"2024-09-10T04:53:18.073926+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:18.073926+0000","last_undegraded":"2024-09-10T04:53:18.073926+0000","last_fullsized":"2024-09-10T04:53:18.073926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974101+0000","last_change":"2024-09-10T04:50:48.878932+0000","last_active":"2024-09-10T04:53:17.974101+0000","last_peered":"2024-09-10T04:53:17.974101+0000","last_clean":"2024-09-10T04:53:17.974101+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:17.974101+0000","last_undegraded":"2024-09-10T04:53:17.974101+0000","last_fullsized":"2024-09-10T04:53:17.974101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.903742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877328+0000","last_change":"2024-09-10T04:50:08.829013+0000","last_active":"2024-09-10T04:50:48.877328+0000","last_peered":"2024-09-10T04:50:48.877328+0000","last_clean":"2024-09-10T04:50:48.877328+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:50:48.877328+0000","last_undegraded":"2024-09-10T04:50:48.877328+0000","last_fullsized":"2024-09-10T04:50:48.877328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:03.087024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874784+0000","last_change":"2024-09-10T04:50:12.833519+0000","last_active":"2024-09-10T04:50:48.874784+0000","last_peered":"2024-09-10T04:50:48.874784+0000","last_clean":"2024-09-10T04:50:48.874784+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:50:48.874784+0000","last_undegraded":"2024-09-10T04:50:48.874784+0000","last_fullsized":"2024-09-10T04:50:48.874784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:32.252245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'47","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.844592+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:52:15.844592+0000","last_peered":"2024-09-10T04:52:15.844592+0000","last_clean":"2024-09-10T04:52:15.844592+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:52:15.844592+0000","last_undegraded":"2024-09-10T04:52:15.844592+0000","last_fullsized":"2024-09-10T04:52:15.844592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.964883+0000","last_change":"2024-09-10T04:50:10.826557+0000","last_active":"2024-09-10T04:50:50.964883+0000","last_peered":"2024-09-10T04:50:50.964883+0000","last_clean":"2024-09-10T04:50:50.964883+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:50:50.964883+0000","last_undegraded":"2024-09-10T04:50:50.964883+0000","last_fullsized":"2024-09-10T04:50:50.964883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:09.614984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.202264+0000","last_change":"2024-09-10T04:50:08.828183+0000","last_active":"2024-09-10T04:52:17.202264+0000","last_peered":"2024-09-10T04:52:17.202264+0000","last_clean":"2024-09-10T04:52:17.202264+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:52:17.202264+0000","last_undegraded":"2024-09-10T04:52:17.202264+0000","last_fullsized":"2024-09-10T04:52:17.202264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:30.666210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"25'1","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937623+0000","last_change":"2024-09-10T04:50:48.899617+0000","last_active":"2024-09-10T04:52:16.937623+0000","last_peered":"2024-09-10T04:52:16.937623+0000","last_clean":"2024-09-10T04:52:16.937623+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:52:16.937623+0000","last_undegraded":"2024-09-10T04:52:16.937623+0000","last_fullsized":"2024-09-10T04:52:16.937623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:52:34.876228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.824610+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:52:15.824610+0000","last_peered":"2024-09-10T04:52:15.824610+0000","last_clean":"2024-09-10T04:52:15.824610+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:52:15.824610+0000","last_undegraded":"2024-09-10T04:52:15.824610+0000","last_fullsized":"2024-09-10T04:52:15.824610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.764151+0000","last_change":"2024-09-10T04:50:10.826946+0000","last_active":"2024-09-10T04:53:17.764151+0000","last_peered":"2024-09-10T04:53:17.764151+0000","last_clean":"2024-09-10T04:53:17.764151+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:17.764151+0000","last_undegraded":"2024-09-10T04:53:17.764151+0000","last_fullsized":"2024-09-10T04:53:17.764151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:18.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877389+0000","last_change":"2024-09-10T04:50:08.837630+0000","last_active":"2024-09-10T04:50:48.877389+0000","last_peered":"2024-09-10T04:50:48.877389+0000","last_clean":"2024-09-10T04:50:48.877389+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:50:48.877389+0000","last_undegraded":"2024-09-10T04:50:48.877389+0000","last_fullsized":"2024-09-10T04:50:48.877389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:31.546596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880639+0000","last_change":"2024-09-10T04:50:48.878506+0000","last_active":"2024-09-10T04:50:48.880639+0000","last_peered":"2024-09-10T04:50:48.880639+0000","last_clean":"2024-09-10T04:50:48.880639+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:50:48.880639+0000","last_undegraded":"2024-09-10T04:50:48.880639+0000","last_fullsized":"2024-09-10T04:50:48.880639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:02.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.846385+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:52:15.846385+0000","last_peered":"2024-09-10T04:52:15.846385+0000","last_clean":"2024-09-10T04:52:15.846385+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:52:15.846385+0000","last_undegraded":"2024-09-10T04:52:15.846385+0000","last_fullsized":"2024-09-10T04:52:15.846385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.083067+0000","last_change":"2024-09-10T04:50:16.854603+0000","last_active":"2024-09-10T04:53:18.083067+0000","last_peered":"2024-09-10T04:53:18.083067+0000","last_clean":"2024-09-10T04:53:18.083067+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:53:18.083067+0000","last_undegraded":"2024-09-10T04:53:18.083067+0000","last_fullsized":"2024-09-10T04:53:18.083067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:42.247342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671118+0000","last_change":"2024-09-10T04:50:10.835108+0000","last_active":"2024-09-10T04:53:17.671118+0000","last_peered":"2024-09-10T04:53:17.671118+0000","last_clean":"2024-09-10T04:53:17.671118+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:17.671118+0000","last_undegraded":"2024-09-10T04:53:17.671118+0000","last_fullsized":"2024-09-10T04:53:17.671118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:45.228769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.517912+0000","last_change":"2024-09-10T04:50:08.829010+0000","last_active":"2024-09-10T04:51:33.517912+0000","last_peered":"2024-09-10T04:51:33.517912+0000","last_clean":"2024-09-10T04:51:33.517912+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:51:33.517912+0000","last_undegraded":"2024-09-10T04:51:33.517912+0000","last_fullsized":"2024-09-10T04:51:33.517912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:13.348983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871409+0000","last_change":"2024-09-10T04:50:12.828963+0000","last_active":"2024-09-10T04:50:48.871409+0000","last_peered":"2024-09-10T04:50:48.871409+0000","last_clean":"2024-09-10T04:50:48.871409+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:50:48.871409+0000","last_undegraded":"2024-09-10T04:50:48.871409+0000","last_fullsized":"2024-09-10T04:50:48.871409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:51.183596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.848473+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:52:15.848473+0000","last_peered":"2024-09-10T04:52:15.848473+0000","last_clean":"2024-09-10T04:52:15.848473+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:52:15.848473+0000","last_undegraded":"2024-09-10T04:52:15.848473+0000","last_fullsized":"2024-09-10T04:52:15.848473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871299+0000","last_change":"2024-09-10T04:50:16.852342+0000","last_active":"2024-09-10T04:50:48.871299+0000","last_peered":"2024-09-10T04:50:48.871299+0000","last_clean":"2024-09-10T04:50:48.871299+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:50:48.871299+0000","last_undegraded":"2024-09-10T04:50:48.871299+0000","last_fullsized":"2024-09-10T04:50:48.871299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:43.920861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:28.226751+0000","last_change":"2024-09-10T04:50:10.822366+0000","last_active":"2024-09-10T04:52:28.226751+0000","last_peered":"2024-09-10T04:52:28.226751+0000","last_clean":"2024-09-10T04:52:28.226751+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:52:28.226751+0000","last_undegraded":"2024-09-10T04:52:28.226751+0000","last_fullsized":"2024-09-10T04:52:28.226751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:25.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.884332+0000","last_change":"2024-09-10T04:50:08.845577+0000","last_active":"2024-09-10T04:50:48.884332+0000","last_peered":"2024-09-10T04:50:48.884332+0000","last_clean":"2024-09-10T04:50:48.884332+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:50:48.884332+0000","last_undegraded":"2024-09-10T04:50:48.884332+0000","last_fullsized":"2024-09-10T04:50:48.884332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:01.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872733+0000","last_change":"2024-09-10T04:50:12.826302+0000","last_active":"2024-09-10T04:50:48.872733+0000","last_peered":"2024-09-10T04:50:48.872733+0000","last_clean":"2024-09-10T04:50:48.872733+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:50:48.872733+0000","last_undegraded":"2024-09-10T04:50:48.872733+0000","last_fullsized":"2024-09-10T04:50:48.872733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:05.064578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.828772+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:52:15.828772+0000","last_peered":"2024-09-10T04:52:15.828772+0000","last_clean":"2024-09-10T04:52:15.828772+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:52:15.828772+0000","last_undegraded":"2024-09-10T04:52:15.828772+0000","last_fullsized":"2024-09-10T04:52:15.828772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702241+0000","last_change":"2024-09-10T04:50:10.826967+0000","last_active":"2024-09-10T04:50:51.702241+0000","last_peered":"2024-09-10T04:50:51.702241+0000","last_clean":"2024-09-10T04:50:51.702241+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:50:51.702241+0000","last_undegraded":"2024-09-10T04:50:51.702241+0000","last_fullsized":"2024-09-10T04:50:51.702241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:18.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875461+0000","last_change":"2024-09-10T04:50:08.828776+0000","last_active":"2024-09-10T04:50:48.875461+0000","last_peered":"2024-09-10T04:50:48.875461+0000","last_clean":"2024-09-10T04:50:48.875461+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:50:48.875461+0000","last_undegraded":"2024-09-10T04:50:48.875461+0000","last_fullsized":"2024-09-10T04:50:48.875461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:19.564788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.928233+0000","last_change":"2024-09-10T04:50:12.834219+0000","last_active":"2024-09-10T04:52:16.928233+0000","last_peered":"2024-09-10T04:52:16.928233+0000","last_clean":"2024-09-10T04:52:16.928233+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:52:16.928233+0000","last_undegraded":"2024-09-10T04:52:16.928233+0000","last_fullsized":"2024-09-10T04:52:16.928233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:03.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227534+0000","last_change":"2024-09-10T04:50:14.837587+0000","last_active":"2024-09-10T04:52:33.227534+0000","last_peered":"2024-09-10T04:52:33.227534+0000","last_clean":"2024-09-10T04:52:33.227534+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:52:33.227534+0000","last_undegraded":"2024-09-10T04:52:33.227534+0000","last_fullsized":"2024-09-10T04:52:33.227534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:07.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.064451+0000","last_change":"2024-09-10T04:50:16.854229+0000","last_active":"2024-09-10T04:53:18.064451+0000","last_peered":"2024-09-10T04:53:18.064451+0000","last_clean":"2024-09-10T04:53:18.064451+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:53:18.064451+0000","last_undegraded":"2024-09-10T04:53:18.064451+0000","last_fullsized":"2024-09-10T04:53:18.064451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:18.182840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.021671+0000","last_change":"2024-09-10T04:50:10.826497+0000","last_active":"2024-09-10T04:53:18.021671+0000","last_peered":"2024-09-10T04:53:18.021671+0000","last_clean":"2024-09-10T04:53:18.021671+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:18.021671+0000","last_undegraded":"2024-09-10T04:53:18.021671+0000","last_fullsized":"2024-09-10T04:53:18.021671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:32.092320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878748+0000","last_change":"2024-09-10T04:50:08.843627+0000","last_active":"2024-09-10T04:50:48.878748+0000","last_peered":"2024-09-10T04:50:48.878748+0000","last_clean":"2024-09-10T04:50:48.878748+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:50:48.878748+0000","last_undegraded":"2024-09-10T04:50:48.878748+0000","last_fullsized":"2024-09-10T04:50:48.878748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.987359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:16.937306+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:52:16.937306+0000","last_peered":"2024-09-10T04:52:16.937306+0000","last_clean":"2024-09-10T04:52:16.937306+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:52:16.937306+0000","last_undegraded":"2024-09-10T04:52:16.937306+0000","last_fullsized":"2024-09-10T04:52:16.937306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":511,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.026279+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:18.026279+0000","last_peered":"2024-09-10T04:53:18.026279+0000","last_clean":"2024-09-10T04:53:18.026279+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:18.026279+0000","last_undegraded":"2024-09-10T04:53:18.026279+0000","last_fullsized":"2024-09-10T04:53:18.026279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974264+0000","last_change":"2024-09-10T04:50:10.829724+0000","last_active":"2024-09-10T04:53:17.974264+0000","last_peered":"2024-09-10T04:53:17.974264+0000","last_clean":"2024-09-10T04:53:17.974264+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:17.974264+0000","last_undegraded":"2024-09-10T04:53:17.974264+0000","last_fullsized":"2024-09-10T04:53:17.974264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:38.586579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878679+0000","last_change":"2024-09-10T04:50:08.842002+0000","last_active":"2024-09-10T04:50:48.878679+0000","last_peered":"2024-09-10T04:50:48.878679+0000","last_clean":"2024-09-10T04:50:48.878679+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:50:48.878679+0000","last_undegraded":"2024-09-10T04:50:48.878679+0000","last_fullsized":"2024-09-10T04:50:48.878679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:41.938317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883061+0000","last_change":"2024-09-10T04:50:12.829555+0000","last_active":"2024-09-10T04:50:48.883061+0000","last_peered":"2024-09-10T04:50:48.883061+0000","last_clean":"2024-09-10T04:50:48.883061+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:50:48.883061+0000","last_undegraded":"2024-09-10T04:50:48.883061+0000","last_fullsized":"2024-09-10T04:50:48.883061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:09:48.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:33.227887+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:52:33.227887+0000","last_peered":"2024-09-10T04:52:33.227887+0000","last_clean":"2024-09-10T04:52:33.227887+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:52:33.227887+0000","last_undegraded":"2024-09-10T04:52:33.227887+0000","last_fullsized":"2024-09-10T04:52:33.227887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974080+0000","last_change":"2024-09-10T04:50:10.832812+0000","last_active":"2024-09-10T04:53:17.974080+0000","last_peered":"2024-09-10T04:53:17.974080+0000","last_clean":"2024-09-10T04:53:17.974080+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:17.974080+0000","last_undegraded":"2024-09-10T04:53:17.974080+0000","last_fullsized":"2024-09-10T04:53:17.974080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:10.931903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874246+0000","last_change":"2024-09-10T04:49:54.975986+0000","last_active":"2024-09-10T04:50:48.874246+0000","last_peered":"2024-09-10T04:50:48.874246+0000","last_clean":"2024-09-10T04:50:48.874246+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:50:48.874246+0000","last_undegraded":"2024-09-10T04:50:48.874246+0000","last_fullsized":"2024-09-10T04:50:48.874246+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:53.499548+0000","last_clean_scrub_stamp":"2024-09-10T04:49:53.499548+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:37.045847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875222+0000","last_change":"2024-09-10T04:50:01.531111+0000","last_active":"2024-09-10T04:50:48.875222+0000","last_peered":"2024-09-10T04:50:48.875222+0000","last_clean":"2024-09-10T04:50:48.875222+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:50:48.875222+0000","last_undegraded":"2024-09-10T04:50:48.875222+0000","last_fullsized":"2024-09-10T04:50:48.875222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:46.585110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879878+0000","last_change":"2024-09-10T04:50:08.838594+0000","last_active":"2024-09-10T04:50:48.879878+0000","last_peered":"2024-09-10T04:50:48.879878+0000","last_clean":"2024-09-10T04:50:48.879878+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:50:48.879878+0000","last_undegraded":"2024-09-10T04:50:48.879878+0000","last_fullsized":"2024-09-10T04:50:48.879878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:13.728249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876718+0000","last_change":"2024-09-10T04:50:12.831368+0000","last_active":"2024-09-10T04:50:48.876718+0000","last_peered":"2024-09-10T04:50:48.876718+0000","last_clean":"2024-09-10T04:50:48.876718+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:50:48.876718+0000","last_undegraded":"2024-09-10T04:50:48.876718+0000","last_fullsized":"2024-09-10T04:50:48.876718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:47.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'83","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.298706+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:52:17.298706+0000","last_peered":"2024-09-10T04:52:17.298706+0000","last_clean":"2024-09-10T04:52:17.298706+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:52:17.298706+0000","last_undegraded":"2024-09-10T04:52:17.298706+0000","last_fullsized":"2024-09-10T04:52:17.298706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882688+0000","last_change":"2024-09-10T04:50:10.823205+0000","last_active":"2024-09-10T04:50:48.882688+0000","last_peered":"2024-09-10T04:50:48.882688+0000","last_clean":"2024-09-10T04:50:48.882688+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:50:48.882688+0000","last_undegraded":"2024-09-10T04:50:48.882688+0000","last_fullsized":"2024-09-10T04:50:48.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:34.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874960+0000","last_change":"2024-09-10T04:50:01.530424+0000","last_active":"2024-09-10T04:50:48.874960+0000","last_peered":"2024-09-10T04:50:48.874960+0000","last_clean":"2024-09-10T04:50:48.874960+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:50:48.874960+0000","last_undegraded":"2024-09-10T04:50:48.874960+0000","last_fullsized":"2024-09-10T04:50:48.874960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:07.932405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.631341+0000","last_change":"2024-09-10T04:50:08.836446+0000","last_active":"2024-09-10T04:53:17.631341+0000","last_peered":"2024-09-10T04:53:17.631341+0000","last_clean":"2024-09-10T04:53:17.631341+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:17.631341+0000","last_undegraded":"2024-09-10T04:53:17.631341+0000","last_fullsized":"2024-09-10T04:53:17.631341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878323+0000","last_change":"2024-09-10T04:50:12.829152+0000","last_active":"2024-09-10T04:50:48.878323+0000","last_peered":"2024-09-10T04:50:48.878323+0000","last_clean":"2024-09-10T04:50:48.878323+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:50:48.878323+0000","last_undegraded":"2024-09-10T04:50:48.878323+0000","last_fullsized":"2024-09-10T04:50:48.878323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:57.426370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":489,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910575+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:17.910575+0000","last_peered":"2024-09-10T04:53:17.910575+0000","last_clean":"2024-09-10T04:53:17.910575+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:17.910575+0000","last_undegraded":"2024-09-10T04:53:17.910575+0000","last_fullsized":"2024-09-10T04:53:17.910575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974004+0000","last_change":"2024-09-10T04:50:10.829015+0000","last_active":"2024-09-10T04:53:17.974004+0000","last_peered":"2024-09-10T04:53:17.974004+0000","last_clean":"2024-09-10T04:53:17.974004+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:17.974004+0000","last_undegraded":"2024-09-10T04:53:17.974004+0000","last_fullsized":"2024-09-10T04:53:17.974004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:58.709020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870077+0000","last_change":"2024-09-10T04:50:01.948014+0000","last_active":"2024-09-10T04:50:48.870077+0000","last_peered":"2024-09-10T04:50:48.870077+0000","last_clean":"2024-09-10T04:50:48.870077+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:50:48.870077+0000","last_undegraded":"2024-09-10T04:50:48.870077+0000","last_fullsized":"2024-09-10T04:50:48.870077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:09.432524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874373+0000","last_change":"2024-09-10T04:50:08.847331+0000","last_active":"2024-09-10T04:50:48.874373+0000","last_peered":"2024-09-10T04:50:48.874373+0000","last_clean":"2024-09-10T04:50:48.874373+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:50:48.874373+0000","last_undegraded":"2024-09-10T04:50:48.874373+0000","last_fullsized":"2024-09-10T04:50:48.874373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.881835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874638+0000","last_change":"2024-09-10T04:50:12.825223+0000","last_active":"2024-09-10T04:50:48.874638+0000","last_peered":"2024-09-10T04:50:48.874638+0000","last_clean":"2024-09-10T04:50:48.874638+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:50:48.874638+0000","last_undegraded":"2024-09-10T04:50:48.874638+0000","last_fullsized":"2024-09-10T04:50:48.874638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:17.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910723+0000","last_change":"2024-09-10T04:50:48.893450+0000","last_active":"2024-09-10T04:53:17.910723+0000","last_peered":"2024-09-10T04:53:17.910723+0000","last_clean":"2024-09-10T04:53:17.910723+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:53:17.910723+0000","last_undegraded":"2024-09-10T04:53:17.910723+0000","last_fullsized":"2024-09-10T04:53:17.910723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:31.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.770722+0000","last_change":"2024-09-10T04:50:10.836057+0000","last_active":"2024-09-10T04:53:17.770722+0000","last_peered":"2024-09-10T04:53:17.770722+0000","last_clean":"2024-09-10T04:53:17.770722+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:17.770722+0000","last_undegraded":"2024-09-10T04:53:17.770722+0000","last_fullsized":"2024-09-10T04:53:17.770722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:55.248455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875284+0000","last_change":"2024-09-10T04:50:01.530758+0000","last_active":"2024-09-10T04:50:48.875284+0000","last_peered":"2024-09-10T04:50:48.875284+0000","last_clean":"2024-09-10T04:50:48.875284+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:50:48.875284+0000","last_undegraded":"2024-09-10T04:50:48.875284+0000","last_fullsized":"2024-09-10T04:50:48.875284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:51.232366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875446+0000","last_change":"2024-09-10T04:50:08.828278+0000","last_active":"2024-09-10T04:50:48.875446+0000","last_peered":"2024-09-10T04:50:48.875446+0000","last_clean":"2024-09-10T04:50:48.875446+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:50:48.875446+0000","last_undegraded":"2024-09-10T04:50:48.875446+0000","last_fullsized":"2024-09-10T04:50:48.875446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:04.354850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877039+0000","last_change":"2024-09-10T04:50:12.829769+0000","last_active":"2024-09-10T04:50:48.877039+0000","last_peered":"2024-09-10T04:50:48.877039+0000","last_clean":"2024-09-10T04:50:48.877039+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:50:48.877039+0000","last_undegraded":"2024-09-10T04:50:48.877039+0000","last_fullsized":"2024-09-10T04:50:48.877039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:09.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876234+0000","last_change":"2024-09-10T04:50:10.829364+0000","last_active":"2024-09-10T04:50:48.876234+0000","last_peered":"2024-09-10T04:50:48.876234+0000","last_clean":"2024-09-10T04:50:48.876234+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:50:48.876234+0000","last_undegraded":"2024-09-10T04:50:48.876234+0000","last_fullsized":"2024-09-10T04:50:48.876234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.090089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877512+0000","last_change":"2024-09-10T04:50:08.837043+0000","last_active":"2024-09-10T04:50:48.877512+0000","last_peered":"2024-09-10T04:50:48.877512+0000","last_clean":"2024-09-10T04:50:48.877512+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:50:48.877512+0000","last_undegraded":"2024-09-10T04:50:48.877512+0000","last_fullsized":"2024-09-10T04:50:48.877512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:17.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877579+0000","last_change":"2024-09-10T04:50:01.535701+0000","last_active":"2024-09-10T04:50:48.877579+0000","last_peered":"2024-09-10T04:50:48.877579+0000","last_clean":"2024-09-10T04:50:48.877579+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:50:48.877579+0000","last_undegraded":"2024-09-10T04:50:48.877579+0000","last_fullsized":"2024-09-10T04:50:48.877579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:41:35.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224774+0000","last_change":"2024-09-10T04:50:12.830001+0000","last_active":"2024-09-10T04:52:18.224774+0000","last_peered":"2024-09-10T04:52:18.224774+0000","last_clean":"2024-09-10T04:52:18.224774+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:52:18.224774+0000","last_undegraded":"2024-09-10T04:52:18.224774+0000","last_fullsized":"2024-09-10T04:52:18.224774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:30.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224683+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:52:18.224683+0000","last_peered":"2024-09-10T04:52:18.224683+0000","last_clean":"2024-09-10T04:52:18.224683+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:52:18.224683+0000","last_undegraded":"2024-09-10T04:52:18.224683+0000","last_fullsized":"2024-09-10T04:52:18.224683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296859+0000","last_change":"2024-09-10T04:50:48.895495+0000","last_active":"2024-09-10T04:52:17.296859+0000","last_peered":"2024-09-10T04:52:17.296859+0000","last_clean":"2024-09-10T04:52:17.296859+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:52:17.296859+0000","last_undegraded":"2024-09-10T04:52:17.296859+0000","last_fullsized":"2024-09-10T04:52:17.296859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:15.353442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878026+0000","last_change":"2024-09-10T04:50:08.836453+0000","last_active":"2024-09-10T04:50:48.878026+0000","last_peered":"2024-09-10T04:50:48.878026+0000","last_clean":"2024-09-10T04:50:48.878026+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:50:48.878026+0000","last_undegraded":"2024-09-10T04:50:48.878026+0000","last_fullsized":"2024-09-10T04:50:48.878026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:00.092299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877301+0000","last_change":"2024-09-10T04:50:01.530452+0000","last_active":"2024-09-10T04:50:48.877301+0000","last_peered":"2024-09-10T04:50:48.877301+0000","last_clean":"2024-09-10T04:50:48.877301+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:50:48.877301+0000","last_undegraded":"2024-09-10T04:50:48.877301+0000","last_fullsized":"2024-09-10T04:50:48.877301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:51.870177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910637+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:17.910637+0000","last_peered":"2024-09-10T04:53:17.910637+0000","last_clean":"2024-09-10T04:53:17.910637+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:17.910637+0000","last_undegraded":"2024-09-10T04:53:17.910637+0000","last_fullsized":"2024-09-10T04:53:17.910637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949075+0000","last_change":"2024-09-10T04:50:10.836157+0000","last_active":"2024-09-10T04:53:17.949075+0000","last_peered":"2024-09-10T04:53:17.949075+0000","last_clean":"2024-09-10T04:53:17.949075+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:17.949075+0000","last_undegraded":"2024-09-10T04:53:17.949075+0000","last_fullsized":"2024-09-10T04:53:17.949075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:51:54.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881873+0000","last_change":"2024-09-10T04:50:08.846597+0000","last_active":"2024-09-10T04:50:48.881873+0000","last_peered":"2024-09-10T04:50:48.881873+0000","last_clean":"2024-09-10T04:50:48.881873+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:50:48.881873+0000","last_undegraded":"2024-09-10T04:50:48.881873+0000","last_fullsized":"2024-09-10T04:50:48.881873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:30.509630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878039+0000","last_change":"2024-09-10T04:50:01.535690+0000","last_active":"2024-09-10T04:50:48.878039+0000","last_peered":"2024-09-10T04:50:48.878039+0000","last_clean":"2024-09-10T04:50:48.878039+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:50:48.878039+0000","last_undegraded":"2024-09-10T04:50:48.878039+0000","last_fullsized":"2024-09-10T04:50:48.878039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:07.112148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875429+0000","last_change":"2024-09-10T04:50:12.828001+0000","last_active":"2024-09-10T04:50:48.875429+0000","last_peered":"2024-09-10T04:50:48.875429+0000","last_clean":"2024-09-10T04:50:48.875429+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:50:48.875429+0000","last_undegraded":"2024-09-10T04:50:48.875429+0000","last_fullsized":"2024-09-10T04:50:48.875429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:19.857340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.061187+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:18.061187+0000","last_peered":"2024-09-10T04:53:18.061187+0000","last_clean":"2024-09-10T04:53:18.061187+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:18.061187+0000","last_undegraded":"2024-09-10T04:53:18.061187+0000","last_fullsized":"2024-09-10T04:53:18.061187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296426+0000","last_change":"2024-09-10T04:50:10.825130+0000","last_active":"2024-09-10T04:52:17.296426+0000","last_peered":"2024-09-10T04:52:17.296426+0000","last_clean":"2024-09-10T04:52:17.296426+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:52:17.296426+0000","last_undegraded":"2024-09-10T04:52:17.296426+0000","last_fullsized":"2024-09-10T04:52:17.296426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:52.976061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.589847+0000","last_change":"2024-09-10T04:50:08.837605+0000","last_active":"2024-09-10T04:50:50.589847+0000","last_peered":"2024-09-10T04:50:50.589847+0000","last_clean":"2024-09-10T04:50:50.589847+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:50:50.589847+0000","last_undegraded":"2024-09-10T04:50:50.589847+0000","last_fullsized":"2024-09-10T04:50:50.589847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:53.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878172+0000","last_change":"2024-09-10T04:50:01.530808+0000","last_active":"2024-09-10T04:50:48.878172+0000","last_peered":"2024-09-10T04:50:48.878172+0000","last_clean":"2024-09-10T04:50:48.878172+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:50:48.878172+0000","last_undegraded":"2024-09-10T04:50:48.878172+0000","last_fullsized":"2024-09-10T04:50:48.878172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:49:58.516536+0000","last_clean_scrub_stamp":"2024-09-10T04:49:58.516536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:29.673943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881108+0000","last_change":"2024-09-10T04:50:12.833099+0000","last_active":"2024-09-10T04:50:48.881108+0000","last_peered":"2024-09-10T04:50:48.881108+0000","last_clean":"2024-09-10T04:50:48.881108+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:50:48.881108+0000","last_undegraded":"2024-09-10T04:50:48.881108+0000","last_fullsized":"2024-09-10T04:50:48.881108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:10.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'88","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.839664+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:52:15.839664+0000","last_peered":"2024-09-10T04:52:15.839664+0000","last_clean":"2024-09-10T04:52:15.839664+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:52:15.839664+0000","last_undegraded":"2024-09-10T04:52:15.839664+0000","last_fullsized":"2024-09-10T04:52:15.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.231272+0000","last_change":"2024-09-10T04:50:10.824890+0000","last_active":"2024-09-10T04:50:51.231272+0000","last_peered":"2024-09-10T04:50:51.231272+0000","last_clean":"2024-09-10T04:50:51.231272+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:50:51.231272+0000","last_undegraded":"2024-09-10T04:50:51.231272+0000","last_fullsized":"2024-09-10T04:50:51.231272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.915338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875830+0000","last_change":"2024-09-10T04:50:08.827991+0000","last_active":"2024-09-10T04:50:48.875830+0000","last_peered":"2024-09-10T04:50:48.875830+0000","last_clean":"2024-09-10T04:50:48.875830+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:50:48.875830+0000","last_undegraded":"2024-09-10T04:50:48.875830+0000","last_fullsized":"2024-09-10T04:50:48.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:27.065767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873861+0000","last_change":"2024-09-10T04:50:12.833107+0000","last_active":"2024-09-10T04:50:48.873861+0000","last_peered":"2024-09-10T04:50:48.873861+0000","last_clean":"2024-09-10T04:50:48.873861+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:50:48.873861+0000","last_undegraded":"2024-09-10T04:50:48.873861+0000","last_fullsized":"2024-09-10T04:50:48.873861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:21.150621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.845543+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:52:15.845543+0000","last_peered":"2024-09-10T04:52:15.845543+0000","last_clean":"2024-09-10T04:52:15.845543+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:52:15.845543+0000","last_undegraded":"2024-09-10T04:52:15.845543+0000","last_fullsized":"2024-09-10T04:52:15.845543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.701581+0000","last_change":"2024-09-10T04:50:10.829358+0000","last_active":"2024-09-10T04:50:51.701581+0000","last_peered":"2024-09-10T04:50:51.701581+0000","last_clean":"2024-09-10T04:50:51.701581+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:50:51.701581+0000","last_undegraded":"2024-09-10T04:50:51.701581+0000","last_fullsized":"2024-09-10T04:50:51.701581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871928+0000","last_change":"2024-09-10T04:50:08.844912+0000","last_active":"2024-09-10T04:50:48.871928+0000","last_peered":"2024-09-10T04:50:48.871928+0000","last_clean":"2024-09-10T04:50:48.871928+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:50:48.871928+0000","last_undegraded":"2024-09-10T04:50:48.871928+0000","last_fullsized":"2024-09-10T04:50:48.871928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:44.401270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872992+0000","last_change":"2024-09-10T04:50:16.850075+0000","last_active":"2024-09-10T04:50:48.872992+0000","last_peered":"2024-09-10T04:50:48.872992+0000","last_clean":"2024-09-10T04:50:48.872992+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:50:48.872992+0000","last_undegraded":"2024-09-10T04:50:48.872992+0000","last_fullsized":"2024-09-10T04:50:48.872992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:56:01.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.615428+0000","last_change":"2024-09-10T04:50:10.820033+0000","last_active":"2024-09-10T04:50:50.615428+0000","last_peered":"2024-09-10T04:50:50.615428+0000","last_clean":"2024-09-10T04:50:50.615428+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:50:50.615428+0000","last_undegraded":"2024-09-10T04:50:50.615428+0000","last_fullsized":"2024-09-10T04:50:50.615428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:57.856874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877343+0000","last_change":"2024-09-10T04:50:08.836435+0000","last_active":"2024-09-10T04:50:48.877343+0000","last_peered":"2024-09-10T04:50:48.877343+0000","last_clean":"2024-09-10T04:50:48.877343+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:50:48.877343+0000","last_undegraded":"2024-09-10T04:50:48.877343+0000","last_fullsized":"2024-09-10T04:50:48.877343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:00:09.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.369040+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:17.369040+0000","last_peered":"2024-09-10T04:53:17.369040+0000","last_clean":"2024-09-10T04:53:17.369040+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:17.369040+0000","last_undegraded":"2024-09-10T04:53:17.369040+0000","last_fullsized":"2024-09-10T04:53:17.369040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898536+0000","last_change":"2024-09-10T04:50:10.834917+0000","last_active":"2024-09-10T04:53:17.898536+0000","last_peered":"2024-09-10T04:53:17.898536+0000","last_clean":"2024-09-10T04:53:17.898536+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:17.898536+0000","last_undegraded":"2024-09-10T04:53:17.898536+0000","last_fullsized":"2024-09-10T04:53:17.898536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.969513+0000","last_change":"2024-09-10T04:50:08.848711+0000","last_active":"2024-09-10T04:53:17.969513+0000","last_peered":"2024-09-10T04:53:17.969513+0000","last_clean":"2024-09-10T04:53:17.969513+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:17.969513+0000","last_undegraded":"2024-09-10T04:53:17.969513+0000","last_fullsized":"2024-09-10T04:53:17.969513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:39.749808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.830813+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:52:15.830813+0000","last_peered":"2024-09-10T04:52:15.830813+0000","last_clean":"2024-09-10T04:52:15.830813+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:52:15.830813+0000","last_undegraded":"2024-09-10T04:52:15.830813+0000","last_fullsized":"2024-09-10T04:52:15.830813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878107+0000","last_change":"2024-09-10T04:50:10.826794+0000","last_active":"2024-09-10T04:50:48.878107+0000","last_peered":"2024-09-10T04:50:48.878107+0000","last_clean":"2024-09-10T04:50:48.878107+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:50:48.878107+0000","last_undegraded":"2024-09-10T04:50:48.878107+0000","last_fullsized":"2024-09-10T04:50:48.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:52.554993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.119492+0000","last_change":"2024-09-10T04:50:08.841684+0000","last_active":"2024-09-10T04:50:50.119492+0000","last_peered":"2024-09-10T04:50:50.119492+0000","last_clean":"2024-09-10T04:50:50.119492+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:50:50.119492+0000","last_undegraded":"2024-09-10T04:50:50.119492+0000","last_fullsized":"2024-09-10T04:50:50.119492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:23.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.851860+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:52:15.851860+0000","last_peered":"2024-09-10T04:52:15.851860+0000","last_clean":"2024-09-10T04:52:15.851860+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:52:15.851860+0000","last_undegraded":"2024-09-10T04:52:15.851860+0000","last_fullsized":"2024-09-10T04:52:15.851860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":69,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898584+0000","last_change":"2024-09-10T04:50:10.832030+0000","last_active":"2024-09-10T04:53:17.898584+0000","last_peered":"2024-09-10T04:53:17.898584+0000","last_clean":"2024-09-10T04:53:17.898584+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:17.898584+0000","last_undegraded":"2024-09-10T04:53:17.898584+0000","last_fullsized":"2024-09-10T04:53:17.898584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:06.264467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873902+0000","last_change":"2024-09-10T04:50:08.848820+0000","last_active":"2024-09-10T04:50:48.873902+0000","last_peered":"2024-09-10T04:50:48.873902+0000","last_clean":"2024-09-10T04:50:48.873902+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:50:48.873902+0000","last_undegraded":"2024-09-10T04:50:48.873902+0000","last_fullsized":"2024-09-10T04:50:48.873902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:38.304965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.831889+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:52:15.831889+0000","last_peered":"2024-09-10T04:52:15.831889+0000","last_clean":"2024-09-10T04:52:15.831889+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:52:15.831889+0000","last_undegraded":"2024-09-10T04:52:15.831889+0000","last_fullsized":"2024-09-10T04:52:15.831889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881759+0000","last_change":"2024-09-10T04:50:10.829229+0000","last_active":"2024-09-10T04:50:48.881759+0000","last_peered":"2024-09-10T04:50:48.881759+0000","last_clean":"2024-09-10T04:50:48.881759+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:50:48.881759+0000","last_undegraded":"2024-09-10T04:50:48.881759+0000","last_fullsized":"2024-09-10T04:50:48.881759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.888344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.135770+0000","last_change":"2024-09-10T04:50:08.829094+0000","last_active":"2024-09-10T04:52:17.135770+0000","last_peered":"2024-09-10T04:52:17.135770+0000","last_clean":"2024-09-10T04:52:17.135770+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:52:17.135770+0000","last_undegraded":"2024-09-10T04:52:17.135770+0000","last_fullsized":"2024-09-10T04:52:17.135770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:06.234076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.849560+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:52:15.849560+0000","last_peered":"2024-09-10T04:52:15.849560+0000","last_clean":"2024-09-10T04:52:15.849560+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:52:15.849560+0000","last_undegraded":"2024-09-10T04:52:15.849560+0000","last_fullsized":"2024-09-10T04:52:15.849560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980768+0000","last_change":"2024-09-10T04:50:10.833243+0000","last_active":"2024-09-10T04:53:17.980768+0000","last_peered":"2024-09-10T04:53:17.980768+0000","last_clean":"2024-09-10T04:53:17.980768+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:17.980768+0000","last_undegraded":"2024-09-10T04:53:17.980768+0000","last_fullsized":"2024-09-10T04:53:17.980768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:23.713893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883823+0000","last_change":"2024-09-10T04:50:08.845251+0000","last_active":"2024-09-10T04:50:48.883823+0000","last_peered":"2024-09-10T04:50:48.883823+0000","last_clean":"2024-09-10T04:50:48.883823+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:50:48.883823+0000","last_undegraded":"2024-09-10T04:50:48.883823+0000","last_fullsized":"2024-09-10T04:50:48.883823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:49.213273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910364+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:17.910364+0000","last_peered":"2024-09-10T04:53:17.910364+0000","last_clean":"2024-09-10T04:53:17.910364+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:17.910364+0000","last_undegraded":"2024-09-10T04:53:17.910364+0000","last_fullsized":"2024-09-10T04:53:17.910364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203867+0000","last_change":"2024-09-10T04:50:10.831574+0000","last_active":"2024-09-10T04:52:14.203867+0000","last_peered":"2024-09-10T04:52:14.203867+0000","last_clean":"2024-09-10T04:52:14.203867+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:52:14.203867+0000","last_undegraded":"2024-09-10T04:52:14.203867+0000","last_fullsized":"2024-09-10T04:52:14.203867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:00.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228408+0000","last_change":"2024-09-10T04:50:08.847637+0000","last_active":"2024-09-10T04:52:38.228408+0000","last_peered":"2024-09-10T04:52:38.228408+0000","last_clean":"2024-09-10T04:52:38.228408+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:52:38.228408+0000","last_undegraded":"2024-09-10T04:52:38.228408+0000","last_fullsized":"2024-09-10T04:52:38.228408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:06.730845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874087+0000","last_change":"2024-09-10T04:50:12.834537+0000","last_active":"2024-09-10T04:50:48.874087+0000","last_peered":"2024-09-10T04:50:48.874087+0000","last_clean":"2024-09-10T04:50:48.874087+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:50:48.874087+0000","last_undegraded":"2024-09-10T04:50:48.874087+0000","last_fullsized":"2024-09-10T04:50:48.874087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:56.571156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'61","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:43.229803+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:52:43.229803+0000","last_peered":"2024-09-10T04:52:43.229803+0000","last_clean":"2024-09-10T04:52:43.229803+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:52:43.229803+0000","last_undegraded":"2024-09-10T04:52:43.229803+0000","last_fullsized":"2024-09-10T04:52:43.229803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.673337+0000","last_change":"2024-09-10T04:50:10.827125+0000","last_active":"2024-09-10T04:53:17.673337+0000","last_peered":"2024-09-10T04:53:17.673337+0000","last_clean":"2024-09-10T04:53:17.673337+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:17.673337+0000","last_undegraded":"2024-09-10T04:53:17.673337+0000","last_fullsized":"2024-09-10T04:53:17.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:39.825343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876983+0000","last_change":"2024-09-10T04:50:08.838072+0000","last_active":"2024-09-10T04:50:48.876983+0000","last_peered":"2024-09-10T04:50:48.876983+0000","last_clean":"2024-09-10T04:50:48.876983+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:50:48.876983+0000","last_undegraded":"2024-09-10T04:50:48.876983+0000","last_fullsized":"2024-09-10T04:50:48.876983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:05.923861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.823561+0000","last_change":"2024-09-10T04:50:14.845070+0000","last_active":"2024-09-10T04:52:15.823561+0000","last_peered":"2024-09-10T04:52:15.823561+0000","last_clean":"2024-09-10T04:52:15.823561+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:52:15.823561+0000","last_undegraded":"2024-09-10T04:52:15.823561+0000","last_fullsized":"2024-09-10T04:52:15.823561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:53.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974120+0000","last_change":"2024-09-10T04:50:10.826976+0000","last_active":"2024-09-10T04:53:17.974120+0000","last_peered":"2024-09-10T04:53:17.974120+0000","last_clean":"2024-09-10T04:53:17.974120+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:53:17.974120+0000","last_undegraded":"2024-09-10T04:53:17.974120+0000","last_fullsized":"2024-09-10T04:53:17.974120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:07.818212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881536+0000","last_change":"2024-09-10T04:50:08.840484+0000","last_active":"2024-09-10T04:50:48.881536+0000","last_peered":"2024-09-10T04:50:48.881536+0000","last_clean":"2024-09-10T04:50:48.881536+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:50:48.881536+0000","last_undegraded":"2024-09-10T04:50:48.881536+0000","last_fullsized":"2024-09-10T04:50:48.881536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:38.776585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874056+0000","last_change":"2024-09-10T04:50:12.834557+0000","last_active":"2024-09-10T04:50:48.874056+0000","last_peered":"2024-09-10T04:50:48.874056+0000","last_clean":"2024-09-10T04:50:48.874056+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:50:48.874056+0000","last_undegraded":"2024-09-10T04:50:48.874056+0000","last_fullsized":"2024-09-10T04:50:48.874056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:02.966548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:48.230344+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:52:48.230344+0000","last_peered":"2024-09-10T04:52:48.230344+0000","last_clean":"2024-09-10T04:52:48.230344+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:52:48.230344+0000","last_undegraded":"2024-09-10T04:52:48.230344+0000","last_fullsized":"2024-09-10T04:52:48.230344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954522+0000","last_change":"2024-09-10T04:50:48.883931+0000","last_active":"2024-09-10T04:53:17.954522+0000","last_peered":"2024-09-10T04:53:17.954522+0000","last_clean":"2024-09-10T04:53:17.954522+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:17.954522+0000","last_undegraded":"2024-09-10T04:53:17.954522+0000","last_fullsized":"2024-09-10T04:53:17.954522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:24.168136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879567+0000","last_change":"2024-09-10T04:50:08.849572+0000","last_active":"2024-09-10T04:50:48.879567+0000","last_peered":"2024-09-10T04:50:48.879567+0000","last_clean":"2024-09-10T04:50:48.879567+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:50:48.879567+0000","last_undegraded":"2024-09-10T04:50:48.879567+0000","last_fullsized":"2024-09-10T04:50:48.879567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:35.230547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.535579+0000","last_change":"2024-09-10T04:50:48.897508+0000","last_active":"2024-09-10T04:52:14.535579+0000","last_peered":"2024-09-10T04:52:14.535579+0000","last_clean":"2024-09-10T04:52:14.535579+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:52:14.535579+0000","last_undegraded":"2024-09-10T04:52:14.535579+0000","last_fullsized":"2024-09-10T04:52:14.535579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:16.163407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.315908+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:17.315908+0000","last_peered":"2024-09-10T04:53:17.315908+0000","last_clean":"2024-09-10T04:53:17.315908+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:17.315908+0000","last_undegraded":"2024-09-10T04:53:17.315908+0000","last_fullsized":"2024-09-10T04:53:17.315908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296217+0000","last_change":"2024-09-10T04:50:10.831509+0000","last_active":"2024-09-10T04:52:17.296217+0000","last_peered":"2024-09-10T04:52:17.296217+0000","last_clean":"2024-09-10T04:52:17.296217+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:52:17.296217+0000","last_undegraded":"2024-09-10T04:52:17.296217+0000","last_fullsized":"2024-09-10T04:52:17.296217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:08.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871169+0000","last_change":"2024-09-10T04:50:08.856704+0000","last_active":"2024-09-10T04:50:48.871169+0000","last_peered":"2024-09-10T04:50:48.871169+0000","last_clean":"2024-09-10T04:50:48.871169+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:50:48.871169+0000","last_undegraded":"2024-09-10T04:50:48.871169+0000","last_fullsized":"2024-09-10T04:50:48.871169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:15.081087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.204249+0000","last_change":"2024-09-10T04:50:10.835492+0000","last_active":"2024-09-10T04:52:14.204249+0000","last_peered":"2024-09-10T04:52:14.204249+0000","last_clean":"2024-09-10T04:52:14.204249+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:52:14.204249+0000","last_undegraded":"2024-09-10T04:52:14.204249+0000","last_fullsized":"2024-09-10T04:52:14.204249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.215580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870244+0000","last_change":"2024-09-10T04:50:08.856062+0000","last_active":"2024-09-10T04:50:48.870244+0000","last_peered":"2024-09-10T04:50:48.870244+0000","last_clean":"2024-09-10T04:50:48.870244+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:50:48.870244+0000","last_undegraded":"2024-09-10T04:50:48.870244+0000","last_fullsized":"2024-09-10T04:50:48.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:44.016447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.527212+0000","last_change":"2024-09-10T04:50:10.827487+0000","last_active":"2024-09-10T04:51:33.527212+0000","last_peered":"2024-09-10T04:51:33.527212+0000","last_clean":"2024-09-10T04:51:33.527212+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:51:33.527212+0000","last_undegraded":"2024-09-10T04:51:33.527212+0000","last_fullsized":"2024-09-10T04:51:33.527212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:31.140771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.189762+0000","last_change":"2024-09-10T04:50:08.839647+0000","last_active":"2024-09-10T04:52:14.189762+0000","last_peered":"2024-09-10T04:52:14.189762+0000","last_clean":"2024-09-10T04:52:14.189762+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:52:14.189762+0000","last_undegraded":"2024-09-10T04:52:14.189762+0000","last_fullsized":"2024-09-10T04:52:14.189762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:50.972996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.297469+0000","last_change":"2024-09-10T04:50:10.836518+0000","last_active":"2024-09-10T04:52:17.297469+0000","last_peered":"2024-09-10T04:52:17.297469+0000","last_clean":"2024-09-10T04:52:17.297469+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:52:17.297469+0000","last_undegraded":"2024-09-10T04:52:17.297469+0000","last_fullsized":"2024-09-10T04:52:17.297469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:31.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.887688+0000","last_change":"2024-09-10T04:50:08.840487+0000","last_active":"2024-09-10T04:53:17.887688+0000","last_peered":"2024-09-10T04:53:17.887688+0000","last_clean":"2024-09-10T04:53:17.887688+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:17.887688+0000","last_undegraded":"2024-09-10T04:53:17.887688+0000","last_fullsized":"2024-09-10T04:53:17.887688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:15.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949045+0000","last_change":"2024-09-10T04:50:10.819238+0000","last_active":"2024-09-10T04:53:17.949045+0000","last_peered":"2024-09-10T04:53:17.949045+0000","last_clean":"2024-09-10T04:53:17.949045+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:53:17.949045+0000","last_undegraded":"2024-09-10T04:53:17.949045+0000","last_fullsized":"2024-09-10T04:53:17.949045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.471522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883009+0000","last_change":"2024-09-10T04:50:08.841048+0000","last_active":"2024-09-10T04:50:48.883009+0000","last_peered":"2024-09-10T04:50:48.883009+0000","last_clean":"2024-09-10T04:50:48.883009+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:50:48.883009+0000","last_undegraded":"2024-09-10T04:50:48.883009+0000","last_fullsized":"2024-09-10T04:50:48.883009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.225704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203735+0000","last_change":"2024-09-10T04:50:10.831470+0000","last_active":"2024-09-10T04:52:14.203735+0000","last_peered":"2024-09-10T04:52:14.203735+0000","last_clean":"2024-09-10T04:52:14.203735+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:52:14.203735+0000","last_undegraded":"2024-09-10T04:52:14.203735+0000","last_fullsized":"2024-09-10T04:52:14.203735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.221117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.884302+0000","last_change":"2024-09-10T04:50:08.846442+0000","last_active":"2024-09-10T04:53:17.884302+0000","last_peered":"2024-09-10T04:53:17.884302+0000","last_clean":"2024-09-10T04:53:17.884302+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:17.884302+0000","last_undegraded":"2024-09-10T04:53:17.884302+0000","last_fullsized":"2024-09-10T04:53:17.884302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:16.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946963+0000","last_change":"2024-09-10T04:50:10.827486+0000","last_active":"2024-09-10T04:53:17.946963+0000","last_peered":"2024-09-10T04:53:17.946963+0000","last_clean":"2024-09-10T04:53:17.946963+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:53:17.946963+0000","last_undegraded":"2024-09-10T04:53:17.946963+0000","last_fullsized":"2024-09-10T04:53:17.946963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:33.726146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224842+0000","last_change":"2024-09-10T04:50:08.844203+0000","last_active":"2024-09-10T04:52:18.224842+0000","last_peered":"2024-09-10T04:52:18.224842+0000","last_clean":"2024-09-10T04:52:18.224842+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:52:18.224842+0000","last_undegraded":"2024-09-10T04:52:18.224842+0000","last_fullsized":"2024-09-10T04:52:18.224842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:18.749197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974089+0000","last_change":"2024-09-10T04:50:10.827432+0000","last_active":"2024-09-10T04:53:17.974089+0000","last_peered":"2024-09-10T04:53:17.974089+0000","last_clean":"2024-09-10T04:53:17.974089+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:17.974089+0000","last_undegraded":"2024-09-10T04:53:17.974089+0000","last_fullsized":"2024-09-10T04:53:17.974089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.651962+0000","last_change":"2024-09-10T04:50:08.846314+0000","last_active":"2024-09-10T04:53:17.651962+0000","last_peered":"2024-09-10T04:53:17.651962+0000","last_clean":"2024-09-10T04:53:17.651962+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:17.651962+0000","last_undegraded":"2024-09-10T04:53:17.651962+0000","last_fullsized":"2024-09-10T04:53:17.651962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:46.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898539+0000","last_change":"2024-09-10T04:50:10.835695+0000","last_active":"2024-09-10T04:53:17.898539+0000","last_peered":"2024-09-10T04:53:17.898539+0000","last_clean":"2024-09-10T04:53:17.898539+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:17.898539+0000","last_undegraded":"2024-09-10T04:53:17.898539+0000","last_fullsized":"2024-09-10T04:53:17.898539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:38.631225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878570+0000","last_change":"2024-09-10T04:50:08.839014+0000","last_active":"2024-09-10T04:50:48.878570+0000","last_peered":"2024-09-10T04:50:48.878570+0000","last_clean":"2024-09-10T04:50:48.878570+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:50:48.878570+0000","last_undegraded":"2024-09-10T04:50:48.878570+0000","last_fullsized":"2024-09-10T04:50:48.878570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:44.696031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898521+0000","last_change":"2024-09-10T04:50:10.829938+0000","last_active":"2024-09-10T04:53:17.898521+0000","last_peered":"2024-09-10T04:53:17.898521+0000","last_clean":"2024-09-10T04:53:17.898521+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:53:17.898521+0000","last_undegraded":"2024-09-10T04:53:17.898521+0000","last_fullsized":"2024-09-10T04:53:17.898521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.656906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878982+0000","last_change":"2024-09-10T04:50:08.840107+0000","last_active":"2024-09-10T04:50:48.878982+0000","last_peered":"2024-09-10T04:50:48.878982+0000","last_clean":"2024-09-10T04:50:48.878982+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:50:48.878982+0000","last_undegraded":"2024-09-10T04:50:48.878982+0000","last_fullsized":"2024-09-10T04:50:48.878982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:13.824817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296935+0000","last_change":"2024-09-10T04:50:10.831991+0000","last_active":"2024-09-10T04:52:17.296935+0000","last_peered":"2024-09-10T04:52:17.296935+0000","last_clean":"2024-09-10T04:52:17.296935+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:52:17.296935+0000","last_undegraded":"2024-09-10T04:52:17.296935+0000","last_fullsized":"2024-09-10T04:52:17.296935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:15.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.226174+0000","last_change":"2024-09-10T04:50:08.837010+0000","last_active":"2024-09-10T04:52:23.226174+0000","last_peered":"2024-09-10T04:52:23.226174+0000","last_clean":"2024-09-10T04:52:23.226174+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:52:23.226174+0000","last_undegraded":"2024-09-10T04:52:23.226174+0000","last_fullsized":"2024-09-10T04:52:23.226174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.112191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.947710+0000","last_change":"2024-09-10T04:50:10.829211+0000","last_active":"2024-09-10T04:53:17.947710+0000","last_peered":"2024-09-10T04:53:17.947710+0000","last_clean":"2024-09-10T04:53:17.947710+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:17.947710+0000","last_undegraded":"2024-09-10T04:53:17.947710+0000","last_fullsized":"2024-09-10T04:53:17.947710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:38.433783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875118+0000","last_change":"2024-09-10T04:50:08.848180+0000","last_active":"2024-09-10T04:50:48.875118+0000","last_peered":"2024-09-10T04:50:48.875118+0000","last_clean":"2024-09-10T04:50:48.875118+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:50:48.875118+0000","last_undegraded":"2024-09-10T04:50:48.875118+0000","last_fullsized":"2024-09-10T04:50:48.875118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:10.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949266+0000","last_change":"2024-09-10T04:50:10.826724+0000","last_active":"2024-09-10T04:53:17.949266+0000","last_peered":"2024-09-10T04:53:17.949266+0000","last_clean":"2024-09-10T04:53:17.949266+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:17.949266+0000","last_undegraded":"2024-09-10T04:53:17.949266+0000","last_fullsized":"2024-09-10T04:53:17.949266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:23.940844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883171+0000","last_change":"2024-09-10T04:50:08.841143+0000","last_active":"2024-09-10T04:50:48.883171+0000","last_peered":"2024-09-10T04:50:48.883171+0000","last_clean":"2024-09-10T04:50:48.883171+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:50:48.883171+0000","last_undegraded":"2024-09-10T04:50:48.883171+0000","last_fullsized":"2024-09-10T04:50:48.883171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:49.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946926+0000","last_change":"2024-09-10T04:50:10.829656+0000","last_active":"2024-09-10T04:53:17.946926+0000","last_peered":"2024-09-10T04:53:17.946926+0000","last_clean":"2024-09-10T04:53:17.946926+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:17.946926+0000","last_undegraded":"2024-09-10T04:53:17.946926+0000","last_fullsized":"2024-09-10T04:53:17.946926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.419467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.117840+0000","last_change":"2024-09-10T04:50:08.841015+0000","last_active":"2024-09-10T04:50:50.117840+0000","last_peered":"2024-09-10T04:50:50.117840+0000","last_clean":"2024-09-10T04:50:50.117840+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:50:50.117840+0000","last_undegraded":"2024-09-10T04:50:50.117840+0000","last_fullsized":"2024-09-10T04:50:50.117840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:30.089256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.965106+0000","last_change":"2024-09-10T04:50:10.827238+0000","last_active":"2024-09-10T04:50:50.965106+0000","last_peered":"2024-09-10T04:50:50.965106+0000","last_clean":"2024-09-10T04:50:50.965106+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:50:50.965106+0000","last_undegraded":"2024-09-10T04:50:50.965106+0000","last_fullsized":"2024-09-10T04:50:50.965106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:11.286717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873207+0000","last_change":"2024-09-10T04:50:08.843693+0000","last_active":"2024-09-10T04:50:48.873207+0000","last_peered":"2024-09-10T04:50:48.873207+0000","last_clean":"2024-09-10T04:50:48.873207+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:50:48.873207+0000","last_undegraded":"2024-09-10T04:50:48.873207+0000","last_fullsized":"2024-09-10T04:50:48.873207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:17.375028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.905075+0000","last_change":"2024-09-10T04:50:10.827173+0000","last_active":"2024-09-10T04:53:17.905075+0000","last_peered":"2024-09-10T04:53:17.905075+0000","last_clean":"2024-09-10T04:53:17.905075+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:17.905075+0000","last_undegraded":"2024-09-10T04:53:17.905075+0000","last_fullsized":"2024-09-10T04:53:17.905075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:28.319087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882780+0000","last_change":"2024-09-10T04:50:08.841506+0000","last_active":"2024-09-10T04:50:48.882780+0000","last_peered":"2024-09-10T04:50:48.882780+0000","last_clean":"2024-09-10T04:50:48.882780+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:50:48.882780+0000","last_undegraded":"2024-09-10T04:50:48.882780+0000","last_fullsized":"2024-09-10T04:50:48.882780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:11.919356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874624+0000","last_change":"2024-09-10T04:50:08.828047+0000","last_active":"2024-09-10T04:50:48.874624+0000","last_peered":"2024-09-10T04:50:48.874624+0000","last_clean":"2024-09-10T04:50:48.874624+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:50:48.874624+0000","last_undegraded":"2024-09-10T04:50:48.874624+0000","last_fullsized":"2024-09-10T04:50:48.874624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:53.770216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974118+0000","last_change":"2024-09-10T04:50:10.831624+0000","last_active":"2024-09-10T04:53:17.974118+0000","last_peered":"2024-09-10T04:53:17.974118+0000","last_clean":"2024-09-10T04:53:17.974118+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:17.974118+0000","last_undegraded":"2024-09-10T04:53:17.974118+0000","last_fullsized":"2024-09-10T04:53:17.974118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:40.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.275559+0000","last_change":"2024-09-10T04:50:08.848380+0000","last_active":"2024-09-10T04:52:17.275559+0000","last_peered":"2024-09-10T04:52:17.275559+0000","last_clean":"2024-09-10T04:52:17.275559+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:52:17.275559+0000","last_undegraded":"2024-09-10T04:52:17.275559+0000","last_fullsized":"2024-09-10T04:52:17.275559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.809904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.904798+0000","last_change":"2024-09-10T04:50:10.833818+0000","last_active":"2024-09-10T04:53:17.904798+0000","last_peered":"2024-09-10T04:53:17.904798+0000","last_clean":"2024-09-10T04:53:17.904798+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:53:17.904798+0000","last_undegraded":"2024-09-10T04:53:17.904798+0000","last_fullsized":"2024-09-10T04:53:17.904798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:10.568818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1469,"ondisk_log_size":1469,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":9048064,"data_stored":8757315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44732,"kb_used_data":9388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327108,"statfs":{"total":96636764160,"available":96590958592,"internally_reserved":0,"allocated":9613312,"data_stored":9346366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673005,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":9662464,"data_stored":9349694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673005,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8759353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.128 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.129 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.130 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.131 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.132 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.133 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.134 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.135 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.136 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.137 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.138 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T04:49:53.499548+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.139 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.140 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.141 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.142 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.143 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.144 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T04:49:58.516536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=49, tm_sec=58, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.145 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.146 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.147 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.148 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.149 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.150 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.151 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.152 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.153 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.154 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.155 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.156 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.157 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.158 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:29.158 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T04:53:49.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:53:49.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.267+0000 7f4bb0623640 1 Processor -- start 2024-09-10T04:53:49.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.267+0000 7f4bb0623640 1 -- start start 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bb0623640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4ba8130270 0x7f4ba8132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bb0623640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba806dc00 con 0x7f4ba8129d80 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bb0623640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba81299c0 con 0x7f4ba8130270 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4badbbe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4ba8130270 0x7f4ba8132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bae3bf640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f4ba8129d80 0x7f4ba812a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:57842/0 (socket says 172.21.15.98:57842) 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bae3bf640 1 -- 172.21.15.98:0/3228092529 learned_addr learned my addr 172.21.15.98:0/3228092529 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4badbbe640 1 --2- 172.21.15.98:0/3228092529 >> v2:172.21.15.98:3300/0 conn(0x7f4ba8130270 0x7f4ba8132660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56758/0 (socket says 172.21.15.98:56758) 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4badbbe640 1 -- 172.21.15.98:0/3228092529 >> v1:172.21.15.98:6789/0 conn(0x7f4ba8129d80 legacy=0x7f4ba812a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:49.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4badbbe640 1 -- 172.21.15.98:0/3228092529 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba812a870 con 0x7f4ba8130270 2024-09-10T04:53:49.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.268+0000 7f4bad3bd640 1 -- 172.21.15.98:0/3228092529 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091526401 0 0) 0x7f4ba806dc00 con 0x7f4ba8129d80 2024-09-10T04:53:49.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4badbbe640 1 --2- 172.21.15.98:0/3228092529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8130270 0x7f4ba8132660 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009720 tx=0x7f4b9802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500d855a8f27345f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:49.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bad3bd640 1 -- 172.21.15.98:0/3228092529 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b98037070 con 0x7f4ba8130270 2024-09-10T04:53:49.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bad3bd640 1 -- 172.21.15.98:0/3228092529 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9802ad90 con 0x7f4ba8130270 2024-09-10T04:53:49.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bad3bd640 1 -- 172.21.15.98:0/3228092529 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b98032590 con 0x7f4ba8130270 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bb0623640 1 -- 172.21.15.98:0/3228092529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8130270 msgr2=0x7f4ba8132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bb0623640 1 --2- 172.21.15.98:0/3228092529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8130270 0x7f4ba8132660 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009720 tx=0x7f4b9802a110 comp rx=0 tx=0).stop 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bb0623640 1 -- 172.21.15.98:0/3228092529 shutdown_connections 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bb0623640 1 --2- 172.21.15.98:0/3228092529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8130270 0x7f4ba8132660 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.269+0000 7f4bb0623640 1 -- 172.21.15.98:0/3228092529 >> 172.21.15.98:0/3228092529 conn(0x7f4ba8070850 msgr2=0x7f4ba8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.270+0000 7f4bb0623640 1 -- 172.21.15.98:0/3228092529 shutdown_connections 2024-09-10T04:53:49.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.270+0000 7f4bb0623640 1 -- 172.21.15.98:0/3228092529 wait complete. 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.270+0000 7f4bb0623640 1 Processor -- start 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.270+0000 7f4bb0623640 1 -- start start 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bb0623640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bb0623640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8073a10 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bae3bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bae3bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56770/0 (socket says 172.21.15.98:56770) 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bae3bf640 1 -- 172.21.15.98:0/1968797352 learned_addr learned my addr 172.21.15.98:0/1968797352 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bae3bf640 1 -- 172.21.15.98:0/1968797352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba8117520 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bae3bf640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c3d0 tx=0x7f4ba400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba40074d0 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba40047e0 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba8118520 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.271+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4007670 con 0x7f4ba8129d80 2024-09-10T04:53:49.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.272+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba8118960 con 0x7f4ba8129d80 2024-09-10T04:53:49.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.272+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4ba4011070 con 0x7f4ba8129d80 2024-09-10T04:53:49.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.273+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba812a160 con 0x7f4ba8129d80 2024-09-10T04:53:49.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.273+0000 7f4b9effd640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 0x7f4b8c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:53:49.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.273+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f4ba40529c0 con 0x7f4ba8129d80 2024-09-10T04:53:49.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.273+0000 7f4badbbe640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 0x7f4b8c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:53:49.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.274+0000 7f4badbbe640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 0x7f4b8c040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b98034000 tx=0x7f4b9802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:53:49.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.277+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4ba4012dd0 con 0x7f4ba8129d80 2024-09-10T04:53:49.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.450+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ba8068da0 con 0x7f4b8c03de90 2024-09-10T04:53:49.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.461+0000 7f4b9effd640 1 -- 172.21.15.98:0/1968797352 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666048 (secure 0 0 0) 0x7f4ba8068da0 con 0x7f4b8c03de90 2024-09-10T04:53:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:53:49.476 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 msgr2=0x7f4b8c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 0x7f4b8c040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b98034000 tx=0x7f4b9802e000 comp rx=0 tx=0).stop 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 msgr2=0x7f4ba8115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c3d0 tx=0x7f4ba400c890 comp rx=0 tx=0).stop 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 shutdown_connections 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f4b8c03de90 0x7f4b8c040350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 --2- 172.21.15.98:0/1968797352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ba8129d80 0x7f4ba8115750 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 >> 172.21.15.98:0/1968797352 conn(0x7f4ba8070850 msgr2=0x7f4ba81282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 shutdown_connections 2024-09-10T04:53:49.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:53:49.466+0000 7f4bb0623640 1 -- 172.21.15.98:0/1968797352 wait complete. 2024-09-10T04:53:49.480 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-10T04:53:49.261307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4762,"ondisk_log_size":4762,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156768,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330592,"statfs":{"total":386547056640,"available":386386526208,"internally_reserved":0,"allocated":2981888,"data_stored":1786524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":157476632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003628"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.213647+0000","last_change":"2024-09-10T04:50:08.836558+0000","last_active":"2024-09-10T04:50:51.213647+0000","last_peered":"2024-09-10T04:50:51.213647+0000","last_clean":"2024-09-10T04:50:51.213647+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:50:51.213647+0000","last_undegraded":"2024-09-10T04:50:51.213647+0000","last_fullsized":"2024-09-10T04:50:51.213647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:07.611919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874886+0000","last_change":"2024-09-10T04:50:10.827523+0000","last_active":"2024-09-10T04:50:48.874886+0000","last_peered":"2024-09-10T04:50:48.874886+0000","last_clean":"2024-09-10T04:50:48.874886+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:50:48.874886+0000","last_undegraded":"2024-09-10T04:50:48.874886+0000","last_fullsized":"2024-09-10T04:50:48.874886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:56.905163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.001358+0000","last_change":"2024-09-10T04:53:43.001358+0000","last_active":"2024-09-10T04:53:43.001358+0000","last_peered":"2024-09-10T04:53:43.001358+0000","last_clean":"2024-09-10T04:53:43.001358+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:53:43.001358+0000","last_undegraded":"2024-09-10T04:53:43.001358+0000","last_fullsized":"2024-09-10T04:53:43.001358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.001271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:10.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671414+0000","last_change":"2024-09-10T04:50:10.819187+0000","last_active":"2024-09-10T04:53:17.671414+0000","last_peered":"2024-09-10T04:53:17.671414+0000","last_clean":"2024-09-10T04:53:17.671414+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:53:17.671414+0000","last_undegraded":"2024-09-10T04:53:17.671414+0000","last_fullsized":"2024-09-10T04:53:17.671414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:41.828061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881449+0000","last_change":"2024-09-10T04:50:08.839328+0000","last_active":"2024-09-10T04:50:48.881449+0000","last_peered":"2024-09-10T04:50:48.881449+0000","last_clean":"2024-09-10T04:50:48.881449+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:50:48.881449+0000","last_undegraded":"2024-09-10T04:50:48.881449+0000","last_fullsized":"2024-09-10T04:50:48.881449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:21.710828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732731+0000","last_change":"2024-09-10T04:50:48.879830+0000","last_active":"2024-09-10T04:51:33.732731+0000","last_peered":"2024-09-10T04:51:33.732731+0000","last_clean":"2024-09-10T04:51:33.732731+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:51:33.732731+0000","last_undegraded":"2024-09-10T04:51:33.732731+0000","last_fullsized":"2024-09-10T04:51:33.732731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:59.179205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.350530+0000","last_change":"2024-09-10T04:53:37.350530+0000","last_active":"2024-09-10T04:53:37.350530+0000","last_peered":"2024-09-10T04:53:37.350530+0000","last_clean":"2024-09-10T04:53:37.350530+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:53:37.350530+0000","last_undegraded":"2024-09-10T04:53:37.350530+0000","last_fullsized":"2024-09-10T04:53:37.350530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.350444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:41.145937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.201672+0000","last_change":"2024-09-10T04:50:48.879883+0000","last_active":"2024-09-10T04:52:14.201672+0000","last_peered":"2024-09-10T04:52:14.201672+0000","last_clean":"2024-09-10T04:52:14.201672+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:52:14.201672+0000","last_undegraded":"2024-09-10T04:52:14.201672+0000","last_fullsized":"2024-09-10T04:52:14.201672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:08.771696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.688036+0000","last_change":"2024-09-10T04:53:47.688036+0000","last_active":"2024-09-10T04:53:47.688036+0000","last_peered":"2024-09-10T04:53:47.688036+0000","last_clean":"2024-09-10T04:53:47.688036+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:53:47.688036+0000","last_undegraded":"2024-09-10T04:53:47.688036+0000","last_fullsized":"2024-09-10T04:53:47.688036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.687954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:11.907238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702019+0000","last_change":"2024-09-10T04:50:10.823009+0000","last_active":"2024-09-10T04:50:51.702019+0000","last_peered":"2024-09-10T04:50:51.702019+0000","last_clean":"2024-09-10T04:50:51.702019+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:50:51.702019+0000","last_undegraded":"2024-09-10T04:50:51.702019+0000","last_fullsized":"2024-09-10T04:50:51.702019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.897024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875751+0000","last_change":"2024-09-10T04:50:08.837428+0000","last_active":"2024-09-10T04:50:48.875751+0000","last_peered":"2024-09-10T04:50:48.875751+0000","last_clean":"2024-09-10T04:50:48.875751+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:50:48.875751+0000","last_undegraded":"2024-09-10T04:50:48.875751+0000","last_fullsized":"2024-09-10T04:50:48.875751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:13.131981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.671731+0000","last_change":"2024-09-10T04:50:10.832647+0000","last_active":"2024-09-10T04:53:17.671731+0000","last_peered":"2024-09-10T04:53:17.671731+0000","last_clean":"2024-09-10T04:53:17.671731+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:53:17.671731+0000","last_undegraded":"2024-09-10T04:53:17.671731+0000","last_fullsized":"2024-09-10T04:53:17.671731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:30.079691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.878085+0000","last_change":"2024-09-10T04:50:08.834170+0000","last_active":"2024-09-10T04:53:17.878085+0000","last_peered":"2024-09-10T04:53:17.878085+0000","last_clean":"2024-09-10T04:53:17.878085+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:17.878085+0000","last_undegraded":"2024-09-10T04:53:17.878085+0000","last_fullsized":"2024-09-10T04:53:17.878085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:23.894994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.732327+0000","last_change":"2024-09-10T04:50:10.825623+0000","last_active":"2024-09-10T04:51:33.732327+0000","last_peered":"2024-09-10T04:51:33.732327+0000","last_clean":"2024-09-10T04:51:33.732327+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:51:33.732327+0000","last_undegraded":"2024-09-10T04:51:33.732327+0000","last_fullsized":"2024-09-10T04:51:33.732327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.611215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.881294+0000","last_change":"2024-09-10T04:50:08.842334+0000","last_active":"2024-09-10T04:53:17.881294+0000","last_peered":"2024-09-10T04:53:17.881294+0000","last_clean":"2024-09-10T04:53:17.881294+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:17.881294+0000","last_undegraded":"2024-09-10T04:53:17.881294+0000","last_fullsized":"2024-09-10T04:53:17.881294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:03.445171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.022533+0000","last_change":"2024-09-10T04:50:10.831636+0000","last_active":"2024-09-10T04:53:18.022533+0000","last_peered":"2024-09-10T04:53:18.022533+0000","last_clean":"2024-09-10T04:53:18.022533+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:18.022533+0000","last_undegraded":"2024-09-10T04:53:18.022533+0000","last_fullsized":"2024-09-10T04:53:18.022533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:51.773869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949263+0000","last_change":"2024-09-10T04:50:10.827812+0000","last_active":"2024-09-10T04:53:17.949263+0000","last_peered":"2024-09-10T04:53:17.949263+0000","last_clean":"2024-09-10T04:53:17.949263+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:17.949263+0000","last_undegraded":"2024-09-10T04:53:17.949263+0000","last_fullsized":"2024-09-10T04:53:17.949263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.617778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.004475+0000","last_change":"2024-09-10T04:53:42.004475+0000","last_active":"2024-09-10T04:53:42.004475+0000","last_peered":"2024-09-10T04:53:42.004475+0000","last_clean":"2024-09-10T04:53:42.004475+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:53:42.004475+0000","last_undegraded":"2024-09-10T04:53:42.004475+0000","last_fullsized":"2024-09-10T04:53:42.004475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.004361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.230916+0000","last_change":"2024-09-10T04:50:10.825696+0000","last_active":"2024-09-10T04:50:51.230916+0000","last_peered":"2024-09-10T04:50:51.230916+0000","last_clean":"2024-09-10T04:50:51.230916+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:50:51.230916+0000","last_undegraded":"2024-09-10T04:50:51.230916+0000","last_fullsized":"2024-09-10T04:50:51.230916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:21.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.373882+0000","last_change":"2024-09-10T04:53:38.373882+0000","last_active":"2024-09-10T04:53:38.373882+0000","last_peered":"2024-09-10T04:53:38.373882+0000","last_clean":"2024-09-10T04:53:38.373882+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:53:38.373882+0000","last_undegraded":"2024-09-10T04:53:38.373882+0000","last_fullsized":"2024-09-10T04:53:38.373882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.373750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:37.943360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.758491+0000","last_change":"2024-09-10T04:53:45.758491+0000","last_active":"2024-09-10T04:53:45.758491+0000","last_peered":"2024-09-10T04:53:45.758491+0000","last_clean":"2024-09-10T04:53:45.758491+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:53:45.758491+0000","last_undegraded":"2024-09-10T04:53:45.758491+0000","last_fullsized":"2024-09-10T04:53:45.758491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.758406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:20.305511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874666+0000","last_change":"2024-09-10T04:50:10.831149+0000","last_active":"2024-09-10T04:50:48.874666+0000","last_peered":"2024-09-10T04:50:48.874666+0000","last_clean":"2024-09-10T04:50:48.874666+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:50:48.874666+0000","last_undegraded":"2024-09-10T04:50:48.874666+0000","last_fullsized":"2024-09-10T04:50:48.874666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.512694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.726404+0000","last_change":"2024-09-10T04:53:46.726404+0000","last_active":"2024-09-10T04:53:46.726404+0000","last_peered":"2024-09-10T04:53:46.726404+0000","last_clean":"2024-09-10T04:53:46.726404+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:53:46.726404+0000","last_undegraded":"2024-09-10T04:53:46.726404+0000","last_fullsized":"2024-09-10T04:53:46.726404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.726317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:16.025123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.294652+0000","last_change":"2024-09-10T04:53:47.294652+0000","last_active":"2024-09-10T04:53:47.294652+0000","last_peered":"2024-09-10T04:53:47.294652+0000","last_clean":"2024-09-10T04:53:47.294652+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:53:47.294652+0000","last_undegraded":"2024-09-10T04:53:47.294652+0000","last_fullsized":"2024-09-10T04:53:47.294652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.294557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:04:50.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.324104+0000","last_change":"2024-09-10T04:53:47.324104+0000","last_active":"2024-09-10T04:53:47.324104+0000","last_peered":"2024-09-10T04:53:47.324104+0000","last_clean":"2024-09-10T04:53:47.324104+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:47.324104+0000","last_undegraded":"2024-09-10T04:53:47.324104+0000","last_fullsized":"2024-09-10T04:53:47.324104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.324019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:42.318106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.954024+0000","last_change":"2024-09-10T04:50:10.831903+0000","last_active":"2024-09-10T04:53:17.954024+0000","last_peered":"2024-09-10T04:53:17.954024+0000","last_clean":"2024-09-10T04:53:17.954024+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:17.954024+0000","last_undegraded":"2024-09-10T04:53:17.954024+0000","last_fullsized":"2024-09-10T04:53:17.954024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:04.706974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.313891+0000","last_change":"2024-09-10T04:53:46.313891+0000","last_active":"2024-09-10T04:53:46.313891+0000","last_peered":"2024-09-10T04:53:46.313891+0000","last_clean":"2024-09-10T04:53:46.313891+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:53:46.313891+0000","last_undegraded":"2024-09-10T04:53:46.313891+0000","last_fullsized":"2024-09-10T04:53:46.313891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.313767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:23.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.763257+0000","last_change":"2024-09-10T04:50:10.827657+0000","last_active":"2024-09-10T04:53:17.763257+0000","last_peered":"2024-09-10T04:53:17.763257+0000","last_clean":"2024-09-10T04:53:17.763257+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:17.763257+0000","last_undegraded":"2024-09-10T04:53:17.763257+0000","last_fullsized":"2024-09-10T04:53:17.763257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:10.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.335583+0000","last_change":"2024-09-10T04:53:35.335583+0000","last_active":"2024-09-10T04:53:35.335583+0000","last_peered":"2024-09-10T04:53:35.335583+0000","last_clean":"2024-09-10T04:53:35.335583+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:53:35.335583+0000","last_undegraded":"2024-09-10T04:53:35.335583+0000","last_fullsized":"2024-09-10T04:53:35.335583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.335499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:57.235909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.612641+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:53:24.612641+0000","last_peered":"2024-09-10T04:53:24.612641+0000","last_clean":"2024-09-10T04:53:24.612641+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:53:24.612641+0000","last_undegraded":"2024-09-10T04:53:24.612641+0000","last_fullsized":"2024-09-10T04:53:24.612641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:38.228840+0000","last_change":"2024-09-10T04:50:10.818723+0000","last_active":"2024-09-10T04:52:38.228840+0000","last_peered":"2024-09-10T04:52:38.228840+0000","last_clean":"2024-09-10T04:52:38.228840+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:52:38.228840+0000","last_undegraded":"2024-09-10T04:52:38.228840+0000","last_fullsized":"2024-09-10T04:52:38.228840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:32.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.477349+0000","last_change":"2024-09-10T04:53:30.477349+0000","last_active":"2024-09-10T04:53:30.477349+0000","last_peered":"2024-09-10T04:53:30.477349+0000","last_clean":"2024-09-10T04:53:30.477349+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:30.477349+0000","last_undegraded":"2024-09-10T04:53:30.477349+0000","last_fullsized":"2024-09-10T04:53:30.477349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.477261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:40.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203915+0000","last_change":"2024-09-10T04:50:10.823064+0000","last_active":"2024-09-10T04:52:14.203915+0000","last_peered":"2024-09-10T04:52:14.203915+0000","last_clean":"2024-09-10T04:52:14.203915+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:52:14.203915+0000","last_undegraded":"2024-09-10T04:52:14.203915+0000","last_fullsized":"2024-09-10T04:52:14.203915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:26.449576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.682127+0000","last_change":"2024-09-10T04:53:39.682127+0000","last_active":"2024-09-10T04:53:39.682127+0000","last_peered":"2024-09-10T04:53:39.682127+0000","last_clean":"2024-09-10T04:53:39.682127+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:53:39.682127+0000","last_undegraded":"2024-09-10T04:53:39.682127+0000","last_fullsized":"2024-09-10T04:53:39.682127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.682042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:15.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'22","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871643+0000","last_change":"2024-09-10T04:50:14.831883+0000","last_active":"2024-09-10T04:50:48.871643+0000","last_peered":"2024-09-10T04:50:48.871643+0000","last_clean":"2024-09-10T04:50:48.871643+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:50:48.871643+0000","last_undegraded":"2024-09-10T04:50:48.871643+0000","last_fullsized":"2024-09-10T04:50:48.871643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:08.755472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.499186+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:24.499186+0000","last_peered":"2024-09-10T04:53:24.499186+0000","last_clean":"2024-09-10T04:53:24.499186+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:24.499186+0000","last_undegraded":"2024-09-10T04:53:24.499186+0000","last_fullsized":"2024-09-10T04:53:24.499186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898545+0000","last_change":"2024-09-10T04:50:10.825749+0000","last_active":"2024-09-10T04:53:17.898545+0000","last_peered":"2024-09-10T04:53:17.898545+0000","last_clean":"2024-09-10T04:53:17.898545+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:17.898545+0000","last_undegraded":"2024-09-10T04:53:17.898545+0000","last_fullsized":"2024-09-10T04:53:17.898545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:53.153695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.654294+0000","last_change":"2024-09-10T04:53:38.654294+0000","last_active":"2024-09-10T04:53:38.654294+0000","last_peered":"2024-09-10T04:53:38.654294+0000","last_clean":"2024-09-10T04:53:38.654294+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:53:38.654294+0000","last_undegraded":"2024-09-10T04:53:38.654294+0000","last_fullsized":"2024-09-10T04:53:38.654294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.654187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:34.763819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'42","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.597877+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:53:24.597877+0000","last_peered":"2024-09-10T04:53:24.597877+0000","last_clean":"2024-09-10T04:53:24.597877+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:53:24.597877+0000","last_undegraded":"2024-09-10T04:53:24.597877+0000","last_fullsized":"2024-09-10T04:53:24.597877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.503620+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:24.503620+0000","last_peered":"2024-09-10T04:53:24.503620+0000","last_clean":"2024-09-10T04:53:24.503620+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:24.503620+0000","last_undegraded":"2024-09-10T04:53:24.503620+0000","last_fullsized":"2024-09-10T04:53:24.503620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.322241+0000","last_change":"2024-09-10T04:53:40.322241+0000","last_active":"2024-09-10T04:53:40.322241+0000","last_peered":"2024-09-10T04:53:40.322241+0000","last_clean":"2024-09-10T04:53:40.322241+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:40.322241+0000","last_undegraded":"2024-09-10T04:53:40.322241+0000","last_fullsized":"2024-09-10T04:53:40.322241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.322153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:47.658822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.659561+0000","last_change":"2024-09-10T04:53:41.659561+0000","last_active":"2024-09-10T04:53:41.659561+0000","last_peered":"2024-09-10T04:53:41.659561+0000","last_clean":"2024-09-10T04:53:41.659561+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:53:41.659561+0000","last_undegraded":"2024-09-10T04:53:41.659561+0000","last_fullsized":"2024-09-10T04:53:41.659561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.659470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:46.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874784+0000","last_change":"2024-09-10T04:50:12.833519+0000","last_active":"2024-09-10T04:50:48.874784+0000","last_peered":"2024-09-10T04:50:48.874784+0000","last_clean":"2024-09-10T04:50:48.874784+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:50:48.874784+0000","last_undegraded":"2024-09-10T04:50:48.874784+0000","last_fullsized":"2024-09-10T04:50:48.874784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:32.252245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'50","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.640112+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:53:24.640112+0000","last_peered":"2024-09-10T04:53:24.640112+0000","last_clean":"2024-09-10T04:53:24.640112+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:53:24.640112+0000","last_undegraded":"2024-09-10T04:53:24.640112+0000","last_fullsized":"2024-09-10T04:53:24.640112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.968650+0000","last_change":"2024-09-10T04:53:46.968650+0000","last_active":"2024-09-10T04:53:46.968650+0000","last_peered":"2024-09-10T04:53:46.968650+0000","last_clean":"2024-09-10T04:53:46.968650+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:53:46.968650+0000","last_undegraded":"2024-09-10T04:53:46.968650+0000","last_fullsized":"2024-09-10T04:53:46.968650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.968570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:17.768222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.646386+0000","last_change":"2024-09-10T04:53:37.646386+0000","last_active":"2024-09-10T04:53:37.646386+0000","last_peered":"2024-09-10T04:53:37.646386+0000","last_clean":"2024-09-10T04:53:37.646386+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:53:37.646386+0000","last_undegraded":"2024-09-10T04:53:37.646386+0000","last_fullsized":"2024-09-10T04:53:37.646386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.646297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"25'1","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.473112+0000","last_change":"2024-09-10T04:50:48.899617+0000","last_active":"2024-09-10T04:53:24.473112+0000","last_peered":"2024-09-10T04:53:24.473112+0000","last_clean":"2024-09-10T04:53:24.473112+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:53:24.473112+0000","last_undegraded":"2024-09-10T04:53:24.473112+0000","last_fullsized":"2024-09-10T04:53:24.473112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:52:34.876228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.568237+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:53:24.568237+0000","last_peered":"2024-09-10T04:53:24.568237+0000","last_clean":"2024-09-10T04:53:24.568237+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:53:24.568237+0000","last_undegraded":"2024-09-10T04:53:24.568237+0000","last_fullsized":"2024-09-10T04:53:24.568237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.764151+0000","last_change":"2024-09-10T04:50:10.826946+0000","last_active":"2024-09-10T04:53:17.764151+0000","last_peered":"2024-09-10T04:53:17.764151+0000","last_clean":"2024-09-10T04:53:17.764151+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:17.764151+0000","last_undegraded":"2024-09-10T04:53:17.764151+0000","last_fullsized":"2024-09-10T04:53:17.764151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:18.370480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.674057+0000","last_change":"2024-09-10T04:53:36.674057+0000","last_active":"2024-09-10T04:53:36.674057+0000","last_peered":"2024-09-10T04:53:36.674057+0000","last_clean":"2024-09-10T04:53:36.674057+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:53:36.674057+0000","last_undegraded":"2024-09-10T04:53:36.674057+0000","last_fullsized":"2024-09-10T04:53:36.674057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.673934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:50.127843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880639+0000","last_change":"2024-09-10T04:50:48.878506+0000","last_active":"2024-09-10T04:50:48.880639+0000","last_peered":"2024-09-10T04:50:48.880639+0000","last_clean":"2024-09-10T04:50:48.880639+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:50:48.880639+0000","last_undegraded":"2024-09-10T04:50:48.880639+0000","last_fullsized":"2024-09-10T04:50:48.880639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:02.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'51","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.645961+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:53:24.645961+0000","last_peered":"2024-09-10T04:53:24.645961+0000","last_clean":"2024-09-10T04:53:24.645961+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:53:24.645961+0000","last_undegraded":"2024-09-10T04:53:24.645961+0000","last_fullsized":"2024-09-10T04:53:24.645961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.504648+0000","last_change":"2024-09-10T04:50:16.854603+0000","last_active":"2024-09-10T04:53:24.504648+0000","last_peered":"2024-09-10T04:53:24.504648+0000","last_clean":"2024-09-10T04:53:24.504648+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:53:24.504648+0000","last_undegraded":"2024-09-10T04:53:24.504648+0000","last_fullsized":"2024-09-10T04:53:24.504648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:42.247342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.315791+0000","last_change":"2024-09-10T04:53:42.315791+0000","last_active":"2024-09-10T04:53:42.315791+0000","last_peered":"2024-09-10T04:53:42.315791+0000","last_clean":"2024-09-10T04:53:42.315791+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:42.315791+0000","last_undegraded":"2024-09-10T04:53:42.315791+0000","last_fullsized":"2024-09-10T04:53:42.315791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.315680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:17.255872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.698115+0000","last_change":"2024-09-10T04:53:34.698115+0000","last_active":"2024-09-10T04:53:34.698115+0000","last_peered":"2024-09-10T04:53:34.698115+0000","last_clean":"2024-09-10T04:53:34.698115+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:53:34.698115+0000","last_undegraded":"2024-09-10T04:53:34.698115+0000","last_fullsized":"2024-09-10T04:53:34.698115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.698035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:37.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871409+0000","last_change":"2024-09-10T04:50:12.828963+0000","last_active":"2024-09-10T04:50:48.871409+0000","last_peered":"2024-09-10T04:50:48.871409+0000","last_clean":"2024-09-10T04:50:48.871409+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:50:48.871409+0000","last_undegraded":"2024-09-10T04:50:48.871409+0000","last_fullsized":"2024-09-10T04:50:48.871409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:51.183596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.651808+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:53:24.651808+0000","last_peered":"2024-09-10T04:53:24.651808+0000","last_clean":"2024-09-10T04:53:24.651808+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:53:24.651808+0000","last_undegraded":"2024-09-10T04:53:24.651808+0000","last_fullsized":"2024-09-10T04:53:24.651808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871299+0000","last_change":"2024-09-10T04:50:16.852342+0000","last_active":"2024-09-10T04:50:48.871299+0000","last_peered":"2024-09-10T04:50:48.871299+0000","last_clean":"2024-09-10T04:50:48.871299+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:50:48.871299+0000","last_undegraded":"2024-09-10T04:50:48.871299+0000","last_fullsized":"2024-09-10T04:50:48.871299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:43.920861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.926197+0000","last_change":"2024-09-10T04:53:47.926197+0000","last_active":"2024-09-10T04:53:47.926197+0000","last_peered":"2024-09-10T04:53:47.926197+0000","last_clean":"2024-09-10T04:53:47.926197+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:53:47.926197+0000","last_undegraded":"2024-09-10T04:53:47.926197+0000","last_fullsized":"2024-09-10T04:53:47.926197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.926107+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.345795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.316210+0000","last_change":"2024-09-10T04:53:34.316210+0000","last_active":"2024-09-10T04:53:34.316210+0000","last_peered":"2024-09-10T04:53:34.316210+0000","last_clean":"2024-09-10T04:53:34.316210+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:53:34.316210+0000","last_undegraded":"2024-09-10T04:53:34.316210+0000","last_fullsized":"2024-09-10T04:53:34.316210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.316125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:51.933570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872733+0000","last_change":"2024-09-10T04:50:12.826302+0000","last_active":"2024-09-10T04:50:48.872733+0000","last_peered":"2024-09-10T04:50:48.872733+0000","last_clean":"2024-09-10T04:50:48.872733+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:50:48.872733+0000","last_undegraded":"2024-09-10T04:50:48.872733+0000","last_fullsized":"2024-09-10T04:50:48.872733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:05.064578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.580315+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:53:24.580315+0000","last_peered":"2024-09-10T04:53:24.580315+0000","last_clean":"2024-09-10T04:53:24.580315+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:53:24.580315+0000","last_undegraded":"2024-09-10T04:53:24.580315+0000","last_fullsized":"2024-09-10T04:53:24.580315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.702241+0000","last_change":"2024-09-10T04:50:10.826967+0000","last_active":"2024-09-10T04:50:51.702241+0000","last_peered":"2024-09-10T04:50:51.702241+0000","last_clean":"2024-09-10T04:50:51.702241+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:50:51.702241+0000","last_undegraded":"2024-09-10T04:50:51.702241+0000","last_fullsized":"2024-09-10T04:50:51.702241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:18.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.705492+0000","last_change":"2024-09-10T04:53:33.705492+0000","last_active":"2024-09-10T04:53:33.705492+0000","last_peered":"2024-09-10T04:53:33.705492+0000","last_clean":"2024-09-10T04:53:33.705492+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:53:33.705492+0000","last_undegraded":"2024-09-10T04:53:33.705492+0000","last_fullsized":"2024-09-10T04:53:33.705492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.705362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:44.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.471734+0000","last_change":"2024-09-10T04:50:12.834219+0000","last_active":"2024-09-10T04:53:24.471734+0000","last_peered":"2024-09-10T04:53:24.471734+0000","last_clean":"2024-09-10T04:53:24.471734+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:53:24.471734+0000","last_undegraded":"2024-09-10T04:53:24.471734+0000","last_fullsized":"2024-09-10T04:53:24.471734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:03.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.558794+0000","last_change":"2024-09-10T04:50:14.837587+0000","last_active":"2024-09-10T04:53:24.558794+0000","last_peered":"2024-09-10T04:53:24.558794+0000","last_clean":"2024-09-10T04:53:24.558794+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:53:24.558794+0000","last_undegraded":"2024-09-10T04:53:24.558794+0000","last_fullsized":"2024-09-10T04:53:24.558794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:07.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.499889+0000","last_change":"2024-09-10T04:50:16.854229+0000","last_active":"2024-09-10T04:53:24.499889+0000","last_peered":"2024-09-10T04:53:24.499889+0000","last_clean":"2024-09-10T04:53:24.499889+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:53:24.499889+0000","last_undegraded":"2024-09-10T04:53:24.499889+0000","last_fullsized":"2024-09-10T04:53:24.499889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:18.182840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.303154+0000","last_change":"2024-09-10T04:53:41.303154+0000","last_active":"2024-09-10T04:53:41.303154+0000","last_peered":"2024-09-10T04:53:41.303154+0000","last_clean":"2024-09-10T04:53:41.303154+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:41.303154+0000","last_undegraded":"2024-09-10T04:53:41.303154+0000","last_fullsized":"2024-09-10T04:53:41.303154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.303062+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:36.191501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.277832+0000","last_change":"2024-09-10T04:53:32.277832+0000","last_active":"2024-09-10T04:53:32.277832+0000","last_peered":"2024-09-10T04:53:32.277832+0000","last_clean":"2024-09-10T04:53:32.277832+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:53:32.277832+0000","last_undegraded":"2024-09-10T04:53:32.277832+0000","last_fullsized":"2024-09-10T04:53:32.277832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.277745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:40.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.482581+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:53:24.482581+0000","last_peered":"2024-09-10T04:53:24.482581+0000","last_clean":"2024-09-10T04:53:24.482581+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:53:24.482581+0000","last_undegraded":"2024-09-10T04:53:24.482581+0000","last_fullsized":"2024-09-10T04:53:24.482581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.501181+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:24.501181+0000","last_peered":"2024-09-10T04:53:24.501181+0000","last_clean":"2024-09-10T04:53:24.501181+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:24.501181+0000","last_undegraded":"2024-09-10T04:53:24.501181+0000","last_fullsized":"2024-09-10T04:53:24.501181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974264+0000","last_change":"2024-09-10T04:50:10.829724+0000","last_active":"2024-09-10T04:53:17.974264+0000","last_peered":"2024-09-10T04:53:17.974264+0000","last_clean":"2024-09-10T04:53:17.974264+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:17.974264+0000","last_undegraded":"2024-09-10T04:53:17.974264+0000","last_fullsized":"2024-09-10T04:53:17.974264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:38.586579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.328609+0000","last_change":"2024-09-10T04:53:30.328609+0000","last_active":"2024-09-10T04:53:30.328609+0000","last_peered":"2024-09-10T04:53:30.328609+0000","last_clean":"2024-09-10T04:53:30.328609+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:53:30.328609+0000","last_undegraded":"2024-09-10T04:53:30.328609+0000","last_fullsized":"2024-09-10T04:53:30.328609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.328488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:00.918192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883061+0000","last_change":"2024-09-10T04:50:12.829555+0000","last_active":"2024-09-10T04:50:48.883061+0000","last_peered":"2024-09-10T04:50:48.883061+0000","last_clean":"2024-09-10T04:50:48.883061+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:50:48.883061+0000","last_undegraded":"2024-09-10T04:50:48.883061+0000","last_fullsized":"2024-09-10T04:50:48.883061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:09:48.298312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'43","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.629080+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:53:24.629080+0000","last_peered":"2024-09-10T04:53:24.629080+0000","last_clean":"2024-09-10T04:53:24.629080+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:53:24.629080+0000","last_undegraded":"2024-09-10T04:53:24.629080+0000","last_fullsized":"2024-09-10T04:53:24.629080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974080+0000","last_change":"2024-09-10T04:50:10.832812+0000","last_active":"2024-09-10T04:53:17.974080+0000","last_peered":"2024-09-10T04:53:17.974080+0000","last_clean":"2024-09-10T04:53:17.974080+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:17.974080+0000","last_undegraded":"2024-09-10T04:53:17.974080+0000","last_fullsized":"2024-09-10T04:53:17.974080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:10.931903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.032422+0000","last_change":"2024-09-10T04:53:29.032422+0000","last_active":"2024-09-10T04:53:29.032422+0000","last_peered":"2024-09-10T04:53:29.032422+0000","last_clean":"2024-09-10T04:53:29.032422+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:53:29.032422+0000","last_undegraded":"2024-09-10T04:53:29.032422+0000","last_fullsized":"2024-09-10T04:53:29.032422+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.032316+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:21.648097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.757540+0000","last_change":"2024-09-10T04:53:28.757540+0000","last_active":"2024-09-10T04:53:28.757540+0000","last_peered":"2024-09-10T04:53:28.757540+0000","last_clean":"2024-09-10T04:53:28.757540+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:53:28.757540+0000","last_undegraded":"2024-09-10T04:53:28.757540+0000","last_fullsized":"2024-09-10T04:53:28.757540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.757471+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:58.706956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.317328+0000","last_change":"2024-09-10T04:53:29.317328+0000","last_active":"2024-09-10T04:53:29.317328+0000","last_peered":"2024-09-10T04:53:29.317328+0000","last_clean":"2024-09-10T04:53:29.317328+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:53:29.317328+0000","last_undegraded":"2024-09-10T04:53:29.317328+0000","last_fullsized":"2024-09-10T04:53:29.317328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.317231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:37.108405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876718+0000","last_change":"2024-09-10T04:50:12.831368+0000","last_active":"2024-09-10T04:50:48.876718+0000","last_peered":"2024-09-10T04:50:48.876718+0000","last_clean":"2024-09-10T04:50:48.876718+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:50:48.876718+0000","last_undegraded":"2024-09-10T04:50:48.876718+0000","last_fullsized":"2024-09-10T04:50:48.876718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:47.493042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'92","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.637003+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:53:24.637003+0000","last_peered":"2024-09-10T04:53:24.637003+0000","last_clean":"2024-09-10T04:53:24.637003+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:53:24.637003+0000","last_undegraded":"2024-09-10T04:53:24.637003+0000","last_fullsized":"2024-09-10T04:53:24.637003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882688+0000","last_change":"2024-09-10T04:50:10.823205+0000","last_active":"2024-09-10T04:50:48.882688+0000","last_peered":"2024-09-10T04:50:48.882688+0000","last_clean":"2024-09-10T04:50:48.882688+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:50:48.882688+0000","last_undegraded":"2024-09-10T04:50:48.882688+0000","last_fullsized":"2024-09-10T04:50:48.882688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:34.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:27.781601+0000","last_change":"2024-09-10T04:53:27.781601+0000","last_active":"2024-09-10T04:53:27.781601+0000","last_peered":"2024-09-10T04:53:27.781601+0000","last_clean":"2024-09-10T04:53:27.781601+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:53:27.781601+0000","last_undegraded":"2024-09-10T04:53:27.781601+0000","last_fullsized":"2024-09-10T04:53:27.781601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_clean_scrub_stamp":"2024-09-10T04:53:27.781512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:07.001654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.064620+0000","last_change":"2024-09-10T04:53:31.064620+0000","last_active":"2024-09-10T04:53:31.064620+0000","last_peered":"2024-09-10T04:53:31.064620+0000","last_clean":"2024-09-10T04:53:31.064620+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:31.064620+0000","last_undegraded":"2024-09-10T04:53:31.064620+0000","last_fullsized":"2024-09-10T04:53:31.064620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.064527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:59.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878323+0000","last_change":"2024-09-10T04:50:12.829152+0000","last_active":"2024-09-10T04:50:48.878323+0000","last_peered":"2024-09-10T04:50:48.878323+0000","last_clean":"2024-09-10T04:50:48.878323+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:50:48.878323+0000","last_undegraded":"2024-09-10T04:50:48.878323+0000","last_fullsized":"2024-09-10T04:50:48.878323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:57.426370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":513,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.634960+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:24.634960+0000","last_peered":"2024-09-10T04:53:24.634960+0000","last_clean":"2024-09-10T04:53:24.634960+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:24.634960+0000","last_undegraded":"2024-09-10T04:53:24.634960+0000","last_fullsized":"2024-09-10T04:53:24.634960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.984615+0000","last_change":"2024-09-10T04:53:45.984615+0000","last_active":"2024-09-10T04:53:45.984615+0000","last_peered":"2024-09-10T04:53:45.984615+0000","last_clean":"2024-09-10T04:53:45.984615+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:45.984615+0000","last_undegraded":"2024-09-10T04:53:45.984615+0000","last_fullsized":"2024-09-10T04:53:45.984615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.984537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:29.250023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.495317+0000","last_change":"2024-09-10T04:53:28.495317+0000","last_active":"2024-09-10T04:53:28.495317+0000","last_peered":"2024-09-10T04:53:28.495317+0000","last_clean":"2024-09-10T04:53:28.495317+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:53:28.495317+0000","last_undegraded":"2024-09-10T04:53:28.495317+0000","last_fullsized":"2024-09-10T04:53:28.495317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.495201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:10.015044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.088819+0000","last_change":"2024-09-10T04:53:32.088819+0000","last_active":"2024-09-10T04:53:32.088819+0000","last_peered":"2024-09-10T04:53:32.088819+0000","last_clean":"2024-09-10T04:53:32.088819+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:53:32.088819+0000","last_undegraded":"2024-09-10T04:53:32.088819+0000","last_fullsized":"2024-09-10T04:53:32.088819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.088738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:21.007330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874638+0000","last_change":"2024-09-10T04:50:12.825223+0000","last_active":"2024-09-10T04:50:48.874638+0000","last_peered":"2024-09-10T04:50:48.874638+0000","last_clean":"2024-09-10T04:50:48.874638+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:50:48.874638+0000","last_undegraded":"2024-09-10T04:50:48.874638+0000","last_fullsized":"2024-09-10T04:50:48.874638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:17.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.910723+0000","last_change":"2024-09-10T04:50:48.893450+0000","last_active":"2024-09-10T04:53:17.910723+0000","last_peered":"2024-09-10T04:53:17.910723+0000","last_clean":"2024-09-10T04:53:17.910723+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:53:17.910723+0000","last_undegraded":"2024-09-10T04:53:17.910723+0000","last_fullsized":"2024-09-10T04:53:17.910723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:31.752190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.992890+0000","last_change":"2024-09-10T04:53:44.992890+0000","last_active":"2024-09-10T04:53:44.992890+0000","last_peered":"2024-09-10T04:53:44.992890+0000","last_clean":"2024-09-10T04:53:44.992890+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:44.992890+0000","last_undegraded":"2024-09-10T04:53:44.992890+0000","last_fullsized":"2024-09-10T04:53:44.992890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.992795+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:39.339709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.729827+0000","last_change":"2024-09-10T04:53:31.729827+0000","last_active":"2024-09-10T04:53:31.729827+0000","last_peered":"2024-09-10T04:53:31.729827+0000","last_clean":"2024-09-10T04:53:31.729827+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:53:31.729827+0000","last_undegraded":"2024-09-10T04:53:31.729827+0000","last_fullsized":"2024-09-10T04:53:31.729827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.729700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:08.937521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.700634+0000","last_change":"2024-09-10T04:53:32.700634+0000","last_active":"2024-09-10T04:53:32.700634+0000","last_peered":"2024-09-10T04:53:32.700634+0000","last_clean":"2024-09-10T04:53:32.700634+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:53:32.700634+0000","last_undegraded":"2024-09-10T04:53:32.700634+0000","last_fullsized":"2024-09-10T04:53:32.700634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.700535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:14.164930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877039+0000","last_change":"2024-09-10T04:50:12.829769+0000","last_active":"2024-09-10T04:50:48.877039+0000","last_peered":"2024-09-10T04:50:48.877039+0000","last_clean":"2024-09-10T04:50:48.877039+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:50:48.877039+0000","last_undegraded":"2024-09-10T04:50:48.877039+0000","last_fullsized":"2024-09-10T04:50:48.877039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:09.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.983700+0000","last_change":"2024-09-10T04:53:43.983700+0000","last_active":"2024-09-10T04:53:43.983700+0000","last_peered":"2024-09-10T04:53:43.983700+0000","last_clean":"2024-09-10T04:53:43.983700+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:53:43.983700+0000","last_undegraded":"2024-09-10T04:53:43.983700+0000","last_fullsized":"2024-09-10T04:53:43.983700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.983610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:36.479094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.659260+0000","last_change":"2024-09-10T04:53:35.659260+0000","last_active":"2024-09-10T04:53:35.659260+0000","last_peered":"2024-09-10T04:53:35.659260+0000","last_clean":"2024-09-10T04:53:35.659260+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:53:35.659260+0000","last_undegraded":"2024-09-10T04:53:35.659260+0000","last_fullsized":"2024-09-10T04:53:35.659260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.659161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:32.447113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.041761+0000","last_change":"2024-09-10T04:53:30.041761+0000","last_active":"2024-09-10T04:53:30.041761+0000","last_peered":"2024-09-10T04:53:30.041761+0000","last_clean":"2024-09-10T04:53:30.041761+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:53:30.041761+0000","last_undegraded":"2024-09-10T04:53:30.041761+0000","last_fullsized":"2024-09-10T04:53:30.041761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.041666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:16.050227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.082550+0000","last_change":"2024-09-10T04:50:12.830001+0000","last_active":"2024-09-10T04:53:18.082550+0000","last_peered":"2024-09-10T04:53:18.082550+0000","last_clean":"2024-09-10T04:53:18.082550+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:53:18.082550+0000","last_undegraded":"2024-09-10T04:53:18.082550+0000","last_fullsized":"2024-09-10T04:53:18.082550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:30.299617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'80","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.601128+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:53:24.601128+0000","last_peered":"2024-09-10T04:53:24.601128+0000","last_clean":"2024-09-10T04:53:24.601128+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:53:24.601128+0000","last_undegraded":"2024-09-10T04:53:24.601128+0000","last_fullsized":"2024-09-10T04:53:24.601128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.346585+0000","last_change":"2024-09-10T04:53:39.346585+0000","last_active":"2024-09-10T04:53:39.346585+0000","last_peered":"2024-09-10T04:53:39.346585+0000","last_clean":"2024-09-10T04:53:39.346585+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:53:39.346585+0000","last_undegraded":"2024-09-10T04:53:39.346585+0000","last_fullsized":"2024-09-10T04:53:39.346585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.346475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:40.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.040101+0000","last_change":"2024-09-10T04:53:33.040101+0000","last_active":"2024-09-10T04:53:33.040101+0000","last_peered":"2024-09-10T04:53:33.040101+0000","last_clean":"2024-09-10T04:53:33.040101+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:53:33.040101+0000","last_undegraded":"2024-09-10T04:53:33.040101+0000","last_fullsized":"2024-09-10T04:53:33.040101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.040007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:13.761147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.707464+0000","last_change":"2024-09-10T04:53:29.707464+0000","last_active":"2024-09-10T04:53:29.707464+0000","last_peered":"2024-09-10T04:53:29.707464+0000","last_clean":"2024-09-10T04:53:29.707464+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:53:29.707464+0000","last_undegraded":"2024-09-10T04:53:29.707464+0000","last_fullsized":"2024-09-10T04:53:29.707464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.707394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:41.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":390,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.497726+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:24.497726+0000","last_peered":"2024-09-10T04:53:24.497726+0000","last_clean":"2024-09-10T04:53:24.497726+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:24.497726+0000","last_undegraded":"2024-09-10T04:53:24.497726+0000","last_fullsized":"2024-09-10T04:53:24.497726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949075+0000","last_change":"2024-09-10T04:50:10.836157+0000","last_active":"2024-09-10T04:53:17.949075+0000","last_peered":"2024-09-10T04:53:17.949075+0000","last_clean":"2024-09-10T04:53:17.949075+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:17.949075+0000","last_undegraded":"2024-09-10T04:53:17.949075+0000","last_fullsized":"2024-09-10T04:53:17.949075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:51:54.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.288641+0000","last_change":"2024-09-10T04:53:31.288641+0000","last_active":"2024-09-10T04:53:31.288641+0000","last_peered":"2024-09-10T04:53:31.288641+0000","last_clean":"2024-09-10T04:53:31.288641+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:53:31.288641+0000","last_undegraded":"2024-09-10T04:53:31.288641+0000","last_fullsized":"2024-09-10T04:53:31.288641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.288558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:03.075476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.028196+0000","last_change":"2024-09-10T04:53:28.028196+0000","last_active":"2024-09-10T04:53:28.028196+0000","last_peered":"2024-09-10T04:53:28.028196+0000","last_clean":"2024-09-10T04:53:28.028196+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:53:28.028196+0000","last_undegraded":"2024-09-10T04:53:28.028196+0000","last_fullsized":"2024-09-10T04:53:28.028196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.028080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:07.938226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875429+0000","last_change":"2024-09-10T04:50:12.828001+0000","last_active":"2024-09-10T04:50:48.875429+0000","last_peered":"2024-09-10T04:50:48.875429+0000","last_clean":"2024-09-10T04:50:48.875429+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:50:48.875429+0000","last_undegraded":"2024-09-10T04:50:48.875429+0000","last_fullsized":"2024-09-10T04:50:48.875429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:19.857340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":402,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.502251+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:24.502251+0000","last_peered":"2024-09-10T04:53:24.502251+0000","last_clean":"2024-09-10T04:53:24.502251+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:24.502251+0000","last_undegraded":"2024-09-10T04:53:24.502251+0000","last_fullsized":"2024-09-10T04:53:24.502251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.367879+0000","last_change":"2024-09-10T04:53:36.367879+0000","last_active":"2024-09-10T04:53:36.367879+0000","last_peered":"2024-09-10T04:53:36.367879+0000","last_clean":"2024-09-10T04:53:36.367879+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:53:36.367879+0000","last_undegraded":"2024-09-10T04:53:36.367879+0000","last_fullsized":"2024-09-10T04:53:36.367879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.367750+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:06.024488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.090383+0000","last_change":"2024-09-10T04:53:34.090383+0000","last_active":"2024-09-10T04:53:34.090383+0000","last_peered":"2024-09-10T04:53:34.090383+0000","last_clean":"2024-09-10T04:53:34.090383+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:53:34.090383+0000","last_undegraded":"2024-09-10T04:53:34.090383+0000","last_fullsized":"2024-09-10T04:53:34.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.090296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:53.934110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.721726+0000","last_change":"2024-09-10T04:53:30.721726+0000","last_active":"2024-09-10T04:53:30.721726+0000","last_peered":"2024-09-10T04:53:30.721726+0000","last_clean":"2024-09-10T04:53:30.721726+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:53:30.721726+0000","last_undegraded":"2024-09-10T04:53:30.721726+0000","last_fullsized":"2024-09-10T04:53:30.721726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.721635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:26.199513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881108+0000","last_change":"2024-09-10T04:50:12.833099+0000","last_active":"2024-09-10T04:50:48.881108+0000","last_peered":"2024-09-10T04:50:48.881108+0000","last_clean":"2024-09-10T04:50:48.881108+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:50:48.881108+0000","last_undegraded":"2024-09-10T04:50:48.881108+0000","last_fullsized":"2024-09-10T04:50:48.881108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:10.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'97","reported_seq":188,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.609690+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:53:24.609690+0000","last_peered":"2024-09-10T04:53:24.609690+0000","last_clean":"2024-09-10T04:53:24.609690+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:53:24.609690+0000","last_undegraded":"2024-09-10T04:53:24.609690+0000","last_fullsized":"2024-09-10T04:53:24.609690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.327819+0000","last_change":"2024-09-10T04:53:44.327819+0000","last_active":"2024-09-10T04:53:44.327819+0000","last_peered":"2024-09-10T04:53:44.327819+0000","last_clean":"2024-09-10T04:53:44.327819+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:53:44.327819+0000","last_undegraded":"2024-09-10T04:53:44.327819+0000","last_fullsized":"2024-09-10T04:53:44.327819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.327731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:17.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.678937+0000","last_change":"2024-09-10T04:53:40.678937+0000","last_active":"2024-09-10T04:53:40.678937+0000","last_peered":"2024-09-10T04:53:40.678937+0000","last_clean":"2024-09-10T04:53:40.678937+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:53:40.678937+0000","last_undegraded":"2024-09-10T04:53:40.678937+0000","last_fullsized":"2024-09-10T04:53:40.678937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.678849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:37.929824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873861+0000","last_change":"2024-09-10T04:50:12.833107+0000","last_active":"2024-09-10T04:50:48.873861+0000","last_peered":"2024-09-10T04:50:48.873861+0000","last_clean":"2024-09-10T04:50:48.873861+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:50:48.873861+0000","last_undegraded":"2024-09-10T04:50:48.873861+0000","last_fullsized":"2024-09-10T04:50:48.873861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:21.150621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.642995+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:53:24.642995+0000","last_peered":"2024-09-10T04:53:24.642995+0000","last_clean":"2024-09-10T04:53:24.642995+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:53:24.642995+0000","last_undegraded":"2024-09-10T04:53:24.642995+0000","last_fullsized":"2024-09-10T04:53:24.642995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.701581+0000","last_change":"2024-09-10T04:50:10.829358+0000","last_active":"2024-09-10T04:50:51.701581+0000","last_peered":"2024-09-10T04:50:51.701581+0000","last_clean":"2024-09-10T04:50:51.701581+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:50:51.701581+0000","last_undegraded":"2024-09-10T04:50:51.701581+0000","last_fullsized":"2024-09-10T04:50:51.701581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.418743+0000","last_change":"2024-09-10T04:53:32.418743+0000","last_active":"2024-09-10T04:53:32.418743+0000","last_peered":"2024-09-10T04:53:32.418743+0000","last_clean":"2024-09-10T04:53:32.418743+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:53:32.418743+0000","last_undegraded":"2024-09-10T04:53:32.418743+0000","last_fullsized":"2024-09-10T04:53:32.418743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.418643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:14.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.872992+0000","last_change":"2024-09-10T04:50:16.850075+0000","last_active":"2024-09-10T04:50:48.872992+0000","last_peered":"2024-09-10T04:50:48.872992+0000","last_clean":"2024-09-10T04:50:48.872992+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:50:48.872992+0000","last_undegraded":"2024-09-10T04:50:48.872992+0000","last_fullsized":"2024-09-10T04:50:48.872992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:56:01.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.615428+0000","last_change":"2024-09-10T04:50:10.820033+0000","last_active":"2024-09-10T04:50:50.615428+0000","last_peered":"2024-09-10T04:50:50.615428+0000","last_clean":"2024-09-10T04:50:50.615428+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:50:50.615428+0000","last_undegraded":"2024-09-10T04:50:50.615428+0000","last_fullsized":"2024-09-10T04:50:50.615428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:57.856874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.663976+0000","last_change":"2024-09-10T04:53:42.663976+0000","last_active":"2024-09-10T04:53:42.663976+0000","last_peered":"2024-09-10T04:53:42.663976+0000","last_clean":"2024-09-10T04:53:42.663976+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:53:42.663976+0000","last_undegraded":"2024-09-10T04:53:42.663976+0000","last_fullsized":"2024-09-10T04:53:42.663976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.663888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.429104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.595003+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:24.595003+0000","last_peered":"2024-09-10T04:53:24.595003+0000","last_clean":"2024-09-10T04:53:24.595003+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:24.595003+0000","last_undegraded":"2024-09-10T04:53:24.595003+0000","last_fullsized":"2024-09-10T04:53:24.595003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898536+0000","last_change":"2024-09-10T04:50:10.834917+0000","last_active":"2024-09-10T04:53:17.898536+0000","last_peered":"2024-09-10T04:53:17.898536+0000","last_clean":"2024-09-10T04:53:17.898536+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:17.898536+0000","last_undegraded":"2024-09-10T04:53:17.898536+0000","last_fullsized":"2024-09-10T04:53:17.898536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.053335+0000","last_change":"2024-09-10T04:53:35.053335+0000","last_active":"2024-09-10T04:53:35.053335+0000","last_peered":"2024-09-10T04:53:35.053335+0000","last_clean":"2024-09-10T04:53:35.053335+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:35.053335+0000","last_undegraded":"2024-09-10T04:53:35.053335+0000","last_fullsized":"2024-09-10T04:53:35.053335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.053227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:06:46.229845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.586161+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:53:24.586161+0000","last_peered":"2024-09-10T04:53:24.586161+0000","last_clean":"2024-09-10T04:53:24.586161+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:53:24.586161+0000","last_undegraded":"2024-09-10T04:53:24.586161+0000","last_fullsized":"2024-09-10T04:53:24.586161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878107+0000","last_change":"2024-09-10T04:50:10.826794+0000","last_active":"2024-09-10T04:50:48.878107+0000","last_peered":"2024-09-10T04:50:48.878107+0000","last_clean":"2024-09-10T04:50:48.878107+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:50:48.878107+0000","last_undegraded":"2024-09-10T04:50:48.878107+0000","last_fullsized":"2024-09-10T04:50:48.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:52.554993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.318043+0000","last_change":"2024-09-10T04:53:33.318043+0000","last_active":"2024-09-10T04:53:33.318043+0000","last_peered":"2024-09-10T04:53:33.318043+0000","last_clean":"2024-09-10T04:53:33.318043+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:53:33.318043+0000","last_undegraded":"2024-09-10T04:53:33.318043+0000","last_fullsized":"2024-09-10T04:53:33.318043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.317954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:35.852351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'68","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.583389+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:53:24.583389+0000","last_peered":"2024-09-10T04:53:24.583389+0000","last_clean":"2024-09-10T04:53:24.583389+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:53:24.583389+0000","last_undegraded":"2024-09-10T04:53:24.583389+0000","last_fullsized":"2024-09-10T04:53:24.583389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":84,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898584+0000","last_change":"2024-09-10T04:50:10.832030+0000","last_active":"2024-09-10T04:53:17.898584+0000","last_peered":"2024-09-10T04:53:17.898584+0000","last_clean":"2024-09-10T04:53:17.898584+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:17.898584+0000","last_undegraded":"2024-09-10T04:53:17.898584+0000","last_fullsized":"2024-09-10T04:53:17.898584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:06.264467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.010426+0000","last_change":"2024-09-10T04:53:36.010426+0000","last_active":"2024-09-10T04:53:36.010426+0000","last_peered":"2024-09-10T04:53:36.010426+0000","last_clean":"2024-09-10T04:53:36.010426+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:53:36.010426+0000","last_undegraded":"2024-09-10T04:53:36.010426+0000","last_fullsized":"2024-09-10T04:53:36.010426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.010317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:47.997647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.589047+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:53:24.589047+0000","last_peered":"2024-09-10T04:53:24.589047+0000","last_clean":"2024-09-10T04:53:24.589047+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:53:24.589047+0000","last_undegraded":"2024-09-10T04:53:24.589047+0000","last_fullsized":"2024-09-10T04:53:24.589047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881759+0000","last_change":"2024-09-10T04:50:10.829229+0000","last_active":"2024-09-10T04:50:48.881759+0000","last_peered":"2024-09-10T04:50:48.881759+0000","last_clean":"2024-09-10T04:50:48.881759+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:50:48.881759+0000","last_undegraded":"2024-09-10T04:50:48.881759+0000","last_fullsized":"2024-09-10T04:50:48.881759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.888344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.135770+0000","last_change":"2024-09-10T04:50:08.829094+0000","last_active":"2024-09-10T04:52:17.135770+0000","last_peered":"2024-09-10T04:52:17.135770+0000","last_clean":"2024-09-10T04:52:17.135770+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:52:17.135770+0000","last_undegraded":"2024-09-10T04:52:17.135770+0000","last_fullsized":"2024-09-10T04:52:17.135770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:06.234076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.655072+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:53:24.655072+0000","last_peered":"2024-09-10T04:53:24.655072+0000","last_clean":"2024-09-10T04:53:24.655072+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:53:24.655072+0000","last_undegraded":"2024-09-10T04:53:24.655072+0000","last_fullsized":"2024-09-10T04:53:24.655072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.340290+0000","last_change":"2024-09-10T04:53:46.340290+0000","last_active":"2024-09-10T04:53:46.340290+0000","last_peered":"2024-09-10T04:53:46.340290+0000","last_clean":"2024-09-10T04:53:46.340290+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:46.340290+0000","last_undegraded":"2024-09-10T04:53:46.340290+0000","last_fullsized":"2024-09-10T04:53:46.340290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.340190+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:49.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.375559+0000","last_change":"2024-09-10T04:53:37.375559+0000","last_active":"2024-09-10T04:53:37.375559+0000","last_peered":"2024-09-10T04:53:37.375559+0000","last_clean":"2024-09-10T04:53:37.375559+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:53:37.375559+0000","last_undegraded":"2024-09-10T04:53:37.375559+0000","last_fullsized":"2024-09-10T04:53:37.375559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.375475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:54.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":376,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.496406+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:24.496406+0000","last_peered":"2024-09-10T04:53:24.496406+0000","last_clean":"2024-09-10T04:53:24.496406+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:24.496406+0000","last_undegraded":"2024-09-10T04:53:24.496406+0000","last_fullsized":"2024-09-10T04:53:24.496406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.310068+0000","last_change":"2024-09-10T04:53:45.310068+0000","last_active":"2024-09-10T04:53:45.310068+0000","last_peered":"2024-09-10T04:53:45.310068+0000","last_clean":"2024-09-10T04:53:45.310068+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:53:45.310068+0000","last_undegraded":"2024-09-10T04:53:45.310068+0000","last_fullsized":"2024-09-10T04:53:45.310068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.309974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.962640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.966331+0000","last_change":"2024-09-10T04:53:36.966331+0000","last_active":"2024-09-10T04:53:36.966331+0000","last_peered":"2024-09-10T04:53:36.966331+0000","last_clean":"2024-09-10T04:53:36.966331+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:53:36.966331+0000","last_undegraded":"2024-09-10T04:53:36.966331+0000","last_fullsized":"2024-09-10T04:53:36.966331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.966245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.697203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874087+0000","last_change":"2024-09-10T04:50:12.834537+0000","last_active":"2024-09-10T04:50:48.874087+0000","last_peered":"2024-09-10T04:50:48.874087+0000","last_clean":"2024-09-10T04:50:48.874087+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:50:48.874087+0000","last_undegraded":"2024-09-10T04:50:48.874087+0000","last_fullsized":"2024-09-10T04:50:48.874087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:56.571156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.562035+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:53:24.562035+0000","last_peered":"2024-09-10T04:53:24.562035+0000","last_clean":"2024-09-10T04:53:24.562035+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:53:24.562035+0000","last_undegraded":"2024-09-10T04:53:24.562035+0000","last_fullsized":"2024-09-10T04:53:24.562035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.673337+0000","last_change":"2024-09-10T04:50:10.827125+0000","last_active":"2024-09-10T04:53:17.673337+0000","last_peered":"2024-09-10T04:53:17.673337+0000","last_clean":"2024-09-10T04:53:17.673337+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:17.673337+0000","last_undegraded":"2024-09-10T04:53:17.673337+0000","last_fullsized":"2024-09-10T04:53:17.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:39.825343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.701876+0000","last_change":"2024-09-10T04:53:43.701876+0000","last_active":"2024-09-10T04:53:43.701876+0000","last_peered":"2024-09-10T04:53:43.701876+0000","last_clean":"2024-09-10T04:53:43.701876+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:53:43.701876+0000","last_undegraded":"2024-09-10T04:53:43.701876+0000","last_fullsized":"2024-09-10T04:53:43.701876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.701760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:03.638962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'39","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.565082+0000","last_change":"2024-09-10T04:50:14.845070+0000","last_active":"2024-09-10T04:53:24.565082+0000","last_peered":"2024-09-10T04:53:24.565082+0000","last_clean":"2024-09-10T04:53:24.565082+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:53:24.565082+0000","last_undegraded":"2024-09-10T04:53:24.565082+0000","last_fullsized":"2024-09-10T04:53:24.565082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:53.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974120+0000","last_change":"2024-09-10T04:50:10.826976+0000","last_active":"2024-09-10T04:53:17.974120+0000","last_peered":"2024-09-10T04:53:17.974120+0000","last_clean":"2024-09-10T04:53:17.974120+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:53:17.974120+0000","last_undegraded":"2024-09-10T04:53:17.974120+0000","last_fullsized":"2024-09-10T04:53:17.974120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:07.818212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.338818+0000","last_change":"2024-09-10T04:53:36.338818+0000","last_active":"2024-09-10T04:53:36.338818+0000","last_peered":"2024-09-10T04:53:36.338818+0000","last_clean":"2024-09-10T04:53:36.338818+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:53:36.338818+0000","last_undegraded":"2024-09-10T04:53:36.338818+0000","last_fullsized":"2024-09-10T04:53:36.338818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.338731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:42.753949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874056+0000","last_change":"2024-09-10T04:50:12.834557+0000","last_active":"2024-09-10T04:50:48.874056+0000","last_peered":"2024-09-10T04:50:48.874056+0000","last_clean":"2024-09-10T04:50:48.874056+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:50:48.874056+0000","last_undegraded":"2024-09-10T04:50:48.874056+0000","last_fullsized":"2024-09-10T04:50:48.874056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:02.966548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.649016+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:53:24.649016+0000","last_peered":"2024-09-10T04:53:24.649016+0000","last_clean":"2024-09-10T04:53:24.649016+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:53:24.649016+0000","last_undegraded":"2024-09-10T04:53:24.649016+0000","last_fullsized":"2024-09-10T04:53:24.649016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.326879+0000","last_change":"2024-09-10T04:53:43.326879+0000","last_active":"2024-09-10T04:53:43.326879+0000","last_peered":"2024-09-10T04:53:43.326879+0000","last_clean":"2024-09-10T04:53:43.326879+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:43.326879+0000","last_undegraded":"2024-09-10T04:53:43.326879+0000","last_fullsized":"2024-09-10T04:53:43.326879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.326755+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:11.173395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.936400+0000","last_change":"2024-09-10T04:53:37.936400+0000","last_active":"2024-09-10T04:53:37.936400+0000","last_peered":"2024-09-10T04:53:37.936400+0000","last_clean":"2024-09-10T04:53:37.936400+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:53:37.936400+0000","last_undegraded":"2024-09-10T04:53:37.936400+0000","last_fullsized":"2024-09-10T04:53:37.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.936312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:39.782085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.535579+0000","last_change":"2024-09-10T04:50:48.897508+0000","last_active":"2024-09-10T04:52:14.535579+0000","last_peered":"2024-09-10T04:52:14.535579+0000","last_clean":"2024-09-10T04:52:14.535579+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:52:14.535579+0000","last_undegraded":"2024-09-10T04:52:14.535579+0000","last_fullsized":"2024-09-10T04:52:14.535579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:16.163407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.547057+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:24.547057+0000","last_peered":"2024-09-10T04:53:24.547057+0000","last_clean":"2024-09-10T04:53:24.547057+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:24.547057+0000","last_undegraded":"2024-09-10T04:53:24.547057+0000","last_fullsized":"2024-09-10T04:53:24.547057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296217+0000","last_change":"2024-09-10T04:50:10.831509+0000","last_active":"2024-09-10T04:52:17.296217+0000","last_peered":"2024-09-10T04:52:17.296217+0000","last_clean":"2024-09-10T04:52:17.296217+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:52:17.296217+0000","last_undegraded":"2024-09-10T04:52:17.296217+0000","last_fullsized":"2024-09-10T04:52:17.296217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:08.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.409733+0000","last_change":"2024-09-10T04:53:33.409733+0000","last_active":"2024-09-10T04:53:33.409733+0000","last_peered":"2024-09-10T04:53:33.409733+0000","last_clean":"2024-09-10T04:53:33.409733+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:53:33.409733+0000","last_undegraded":"2024-09-10T04:53:33.409733+0000","last_fullsized":"2024-09-10T04:53:33.409733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.409644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:22.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.204249+0000","last_change":"2024-09-10T04:50:10.835492+0000","last_active":"2024-09-10T04:52:14.204249+0000","last_peered":"2024-09-10T04:52:14.204249+0000","last_clean":"2024-09-10T04:52:14.204249+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:52:14.204249+0000","last_undegraded":"2024-09-10T04:52:14.204249+0000","last_fullsized":"2024-09-10T04:52:14.204249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.215580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.459612+0000","last_change":"2024-09-10T04:53:29.459612+0000","last_active":"2024-09-10T04:53:29.459612+0000","last_peered":"2024-09-10T04:53:29.459612+0000","last_clean":"2024-09-10T04:53:29.459612+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:53:29.459612+0000","last_undegraded":"2024-09-10T04:53:29.459612+0000","last_fullsized":"2024-09-10T04:53:29.459612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.459526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.879419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.527212+0000","last_change":"2024-09-10T04:50:10.827487+0000","last_active":"2024-09-10T04:51:33.527212+0000","last_peered":"2024-09-10T04:51:33.527212+0000","last_clean":"2024-09-10T04:51:33.527212+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:51:33.527212+0000","last_undegraded":"2024-09-10T04:51:33.527212+0000","last_fullsized":"2024-09-10T04:51:33.527212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:31.140771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.374381+0000","last_change":"2024-09-10T04:53:40.374381+0000","last_active":"2024-09-10T04:53:40.374381+0000","last_peered":"2024-09-10T04:53:40.374381+0000","last_clean":"2024-09-10T04:53:40.374381+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:53:40.374381+0000","last_undegraded":"2024-09-10T04:53:40.374381+0000","last_fullsized":"2024-09-10T04:53:40.374381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.374287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:13:03.190933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.297469+0000","last_change":"2024-09-10T04:50:10.836518+0000","last_active":"2024-09-10T04:52:17.297469+0000","last_peered":"2024-09-10T04:52:17.297469+0000","last_clean":"2024-09-10T04:52:17.297469+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:52:17.297469+0000","last_undegraded":"2024-09-10T04:52:17.297469+0000","last_fullsized":"2024-09-10T04:52:17.297469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:31.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.460543+0000","last_change":"2024-09-10T04:53:31.460543+0000","last_active":"2024-09-10T04:53:31.460543+0000","last_peered":"2024-09-10T04:53:31.460543+0000","last_clean":"2024-09-10T04:53:31.460543+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:31.460543+0000","last_undegraded":"2024-09-10T04:53:31.460543+0000","last_fullsized":"2024-09-10T04:53:31.460543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.460459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.855491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949045+0000","last_change":"2024-09-10T04:50:10.819238+0000","last_active":"2024-09-10T04:53:17.949045+0000","last_peered":"2024-09-10T04:53:17.949045+0000","last_clean":"2024-09-10T04:53:17.949045+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:53:17.949045+0000","last_undegraded":"2024-09-10T04:53:17.949045+0000","last_fullsized":"2024-09-10T04:53:17.949045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.471522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.374822+0000","last_change":"2024-09-10T04:53:38.374822+0000","last_active":"2024-09-10T04:53:38.374822+0000","last_peered":"2024-09-10T04:53:38.374822+0000","last_clean":"2024-09-10T04:53:38.374822+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:53:38.374822+0000","last_undegraded":"2024-09-10T04:53:38.374822+0000","last_fullsized":"2024-09-10T04:53:38.374822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.374741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:27.594977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.203735+0000","last_change":"2024-09-10T04:50:10.831470+0000","last_active":"2024-09-10T04:52:14.203735+0000","last_peered":"2024-09-10T04:52:14.203735+0000","last_clean":"2024-09-10T04:52:14.203735+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:52:14.203735+0000","last_undegraded":"2024-09-10T04:52:14.203735+0000","last_fullsized":"2024-09-10T04:52:14.203735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.221117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.929329+0000","last_change":"2024-09-10T04:53:38.929329+0000","last_active":"2024-09-10T04:53:38.929329+0000","last_peered":"2024-09-10T04:53:38.929329+0000","last_clean":"2024-09-10T04:53:38.929329+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:38.929329+0000","last_undegraded":"2024-09-10T04:53:38.929329+0000","last_fullsized":"2024-09-10T04:53:38.929329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.929243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.588007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946963+0000","last_change":"2024-09-10T04:50:10.827486+0000","last_active":"2024-09-10T04:53:17.946963+0000","last_peered":"2024-09-10T04:53:17.946963+0000","last_clean":"2024-09-10T04:53:17.946963+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:53:17.946963+0000","last_undegraded":"2024-09-10T04:53:17.946963+0000","last_fullsized":"2024-09-10T04:53:17.946963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:33.726146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.391611+0000","last_change":"2024-09-10T04:53:34.391611+0000","last_active":"2024-09-10T04:53:34.391611+0000","last_peered":"2024-09-10T04:53:34.391611+0000","last_clean":"2024-09-10T04:53:34.391611+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:53:34.391611+0000","last_undegraded":"2024-09-10T04:53:34.391611+0000","last_fullsized":"2024-09-10T04:53:34.391611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.391516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:34.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974089+0000","last_change":"2024-09-10T04:50:10.827432+0000","last_active":"2024-09-10T04:53:17.974089+0000","last_peered":"2024-09-10T04:53:17.974089+0000","last_clean":"2024-09-10T04:53:17.974089+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:17.974089+0000","last_undegraded":"2024-09-10T04:53:17.974089+0000","last_fullsized":"2024-09-10T04:53:17.974089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.923990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.361951+0000","last_change":"2024-09-10T04:53:39.361951+0000","last_active":"2024-09-10T04:53:39.361951+0000","last_peered":"2024-09-10T04:53:39.361951+0000","last_clean":"2024-09-10T04:53:39.361951+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:39.361951+0000","last_undegraded":"2024-09-10T04:53:39.361951+0000","last_fullsized":"2024-09-10T04:53:39.361951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.361846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:31.211856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898539+0000","last_change":"2024-09-10T04:50:10.835695+0000","last_active":"2024-09-10T04:53:17.898539+0000","last_peered":"2024-09-10T04:53:17.898539+0000","last_clean":"2024-09-10T04:53:17.898539+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:17.898539+0000","last_undegraded":"2024-09-10T04:53:17.898539+0000","last_fullsized":"2024-09-10T04:53:17.898539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:38.631225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.328369+0000","last_change":"2024-09-10T04:53:41.328369+0000","last_active":"2024-09-10T04:53:41.328369+0000","last_peered":"2024-09-10T04:53:41.328369+0000","last_clean":"2024-09-10T04:53:41.328369+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:53:41.328369+0000","last_undegraded":"2024-09-10T04:53:41.328369+0000","last_fullsized":"2024-09-10T04:53:41.328369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.328263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:49.638518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.898521+0000","last_change":"2024-09-10T04:50:10.829938+0000","last_active":"2024-09-10T04:53:17.898521+0000","last_peered":"2024-09-10T04:53:17.898521+0000","last_clean":"2024-09-10T04:53:17.898521+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:53:17.898521+0000","last_undegraded":"2024-09-10T04:53:17.898521+0000","last_fullsized":"2024-09-10T04:53:17.898521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.656906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.299822+0000","last_change":"2024-09-10T04:53:44.299822+0000","last_active":"2024-09-10T04:53:44.299822+0000","last_peered":"2024-09-10T04:53:44.299822+0000","last_clean":"2024-09-10T04:53:44.299822+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:53:44.299822+0000","last_undegraded":"2024-09-10T04:53:44.299822+0000","last_fullsized":"2024-09-10T04:53:44.299822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.299714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:38.816159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.296935+0000","last_change":"2024-09-10T04:50:10.831991+0000","last_active":"2024-09-10T04:52:17.296935+0000","last_peered":"2024-09-10T04:52:17.296935+0000","last_clean":"2024-09-10T04:52:17.296935+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:52:17.296935+0000","last_undegraded":"2024-09-10T04:52:17.296935+0000","last_fullsized":"2024-09-10T04:52:17.296935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:15.731313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.607389+0000","last_change":"2024-09-10T04:50:08.837010+0000","last_active":"2024-09-10T04:53:17.607389+0000","last_peered":"2024-09-10T04:53:17.607389+0000","last_clean":"2024-09-10T04:53:17.607389+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:53:17.607389+0000","last_undegraded":"2024-09-10T04:53:17.607389+0000","last_fullsized":"2024-09-10T04:53:17.607389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:07.796232+0000","last_clean_scrub_stamp":"2024-09-10T04:50:07.796232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.112191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.947710+0000","last_change":"2024-09-10T04:50:10.829211+0000","last_active":"2024-09-10T04:53:17.947710+0000","last_peered":"2024-09-10T04:53:17.947710+0000","last_clean":"2024-09-10T04:53:17.947710+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:17.947710+0000","last_undegraded":"2024-09-10T04:53:17.947710+0000","last_fullsized":"2024-09-10T04:53:17.947710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:38.433783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.927198+0000","last_change":"2024-09-10T04:53:39.927198+0000","last_active":"2024-09-10T04:53:39.927198+0000","last_peered":"2024-09-10T04:53:39.927198+0000","last_clean":"2024-09-10T04:53:39.927198+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:53:39.927198+0000","last_undegraded":"2024-09-10T04:53:39.927198+0000","last_fullsized":"2024-09-10T04:53:39.927198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.927110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:58.183080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.949266+0000","last_change":"2024-09-10T04:50:10.826724+0000","last_active":"2024-09-10T04:53:17.949266+0000","last_peered":"2024-09-10T04:53:17.949266+0000","last_clean":"2024-09-10T04:53:17.949266+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:17.949266+0000","last_undegraded":"2024-09-10T04:53:17.949266+0000","last_fullsized":"2024-09-10T04:53:17.949266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:23.940844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.285400+0000","last_change":"2024-09-10T04:53:43.285400+0000","last_active":"2024-09-10T04:53:43.285400+0000","last_peered":"2024-09-10T04:53:43.285400+0000","last_clean":"2024-09-10T04:53:43.285400+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:53:43.285400+0000","last_undegraded":"2024-09-10T04:53:43.285400+0000","last_fullsized":"2024-09-10T04:53:43.285400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.285314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:24.124746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.946926+0000","last_change":"2024-09-10T04:50:10.829656+0000","last_active":"2024-09-10T04:53:17.946926+0000","last_peered":"2024-09-10T04:53:17.946926+0000","last_clean":"2024-09-10T04:53:17.946926+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:17.946926+0000","last_undegraded":"2024-09-10T04:53:17.946926+0000","last_fullsized":"2024-09-10T04:53:17.946926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.419467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.323633+0000","last_change":"2024-09-10T04:53:45.323633+0000","last_active":"2024-09-10T04:53:45.323633+0000","last_peered":"2024-09-10T04:53:45.323633+0000","last_clean":"2024-09-10T04:53:45.323633+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:53:45.323633+0000","last_undegraded":"2024-09-10T04:53:45.323633+0000","last_fullsized":"2024-09-10T04:53:45.323633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.323515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:03:20.165760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.965106+0000","last_change":"2024-09-10T04:50:10.827238+0000","last_active":"2024-09-10T04:50:50.965106+0000","last_peered":"2024-09-10T04:50:50.965106+0000","last_clean":"2024-09-10T04:50:50.965106+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:50:50.965106+0000","last_undegraded":"2024-09-10T04:50:50.965106+0000","last_fullsized":"2024-09-10T04:50:50.965106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:11.286717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.402809+0000","last_change":"2024-09-10T04:53:35.402809+0000","last_active":"2024-09-10T04:53:35.402809+0000","last_peered":"2024-09-10T04:53:35.402809+0000","last_clean":"2024-09-10T04:53:35.402809+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:53:35.402809+0000","last_undegraded":"2024-09-10T04:53:35.402809+0000","last_fullsized":"2024-09-10T04:53:35.402809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.402723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:03.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.905075+0000","last_change":"2024-09-10T04:50:10.827173+0000","last_active":"2024-09-10T04:53:17.905075+0000","last_peered":"2024-09-10T04:53:17.905075+0000","last_clean":"2024-09-10T04:53:17.905075+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:17.905075+0000","last_undegraded":"2024-09-10T04:53:17.905075+0000","last_fullsized":"2024-09-10T04:53:17.905075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:28.319087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.311732+0000","last_change":"2024-09-10T04:53:42.311732+0000","last_active":"2024-09-10T04:53:42.311732+0000","last_peered":"2024-09-10T04:53:42.311732+0000","last_clean":"2024-09-10T04:53:42.311732+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:53:42.311732+0000","last_undegraded":"2024-09-10T04:53:42.311732+0000","last_fullsized":"2024-09-10T04:53:42.311732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.311649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:45.625094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.725409+0000","last_change":"2024-09-10T04:53:44.725409+0000","last_active":"2024-09-10T04:53:44.725409+0000","last_peered":"2024-09-10T04:53:44.725409+0000","last_clean":"2024-09-10T04:53:44.725409+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:53:44.725409+0000","last_undegraded":"2024-09-10T04:53:44.725409+0000","last_fullsized":"2024-09-10T04:53:44.725409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.725321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:54.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.974118+0000","last_change":"2024-09-10T04:50:10.831624+0000","last_active":"2024-09-10T04:53:17.974118+0000","last_peered":"2024-09-10T04:53:17.974118+0000","last_clean":"2024-09-10T04:53:17.974118+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:17.974118+0000","last_undegraded":"2024-09-10T04:53:17.974118+0000","last_fullsized":"2024-09-10T04:53:17.974118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:40.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.954477+0000","last_change":"2024-09-10T04:53:40.954477+0000","last_active":"2024-09-10T04:53:40.954477+0000","last_peered":"2024-09-10T04:53:40.954477+0000","last_clean":"2024-09-10T04:53:40.954477+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:53:40.954477+0000","last_undegraded":"2024-09-10T04:53:40.954477+0000","last_fullsized":"2024-09-10T04:53:40.954477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.954395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:35.066147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.904798+0000","last_change":"2024-09-10T04:50:10.833818+0000","last_active":"2024-09-10T04:53:17.904798+0000","last_peered":"2024-09-10T04:53:17.904798+0000","last_clean":"2024-09-10T04:53:17.904798+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:53:17.904798+0000","last_undegraded":"2024-09-10T04:53:17.904798+0000","last_fullsized":"2024-09-10T04:53:17.904798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:10.568818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1568,"ondisk_log_size":1568,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35776,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336064,"statfs":{"total":96636764160,"available":96600129536,"internally_reserved":0,"allocated":442368,"data_stored":151619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":740670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":742288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673010,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.490 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.491 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.492 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.493 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.494 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.495 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.496 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.497 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.498 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.499 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.500 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.501 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.502 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.503 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.504 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.505 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.506 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.507 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.508 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.509 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.510 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.511 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T04:50:07.796232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=7, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.512 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.513 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:53:49.513 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T04:54:09.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21b1f91640 1 Processor -- start 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21b1f91640 1 -- start start 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21b1f91640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21ac110d90 0x7f21ac111170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21b1f91640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac1116b0 con 0x7f21ac112050 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21b1f91640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7f21ac06de70 con 0x7f21ac110d90 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21ab7fe640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21ac110d90 0x7f21ac111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21aaffd640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f21ac112050 0x7f21ac133680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:38668/0 (socket says 172.21.15.98:38668) 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.623+0000 7f21aaffd640 1 -- 172.21.15.98:0/222803582 learned_addr learned my addr 172.21.15.98:0/222803582 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.624+0000 7f21ab7fe640 1 -- 172.21.15.98:0/222803582 >> v1:172.21.15.98:6789/0 conn(0x7f21ac112050 legacy=0x7f21ac133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:09.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.624+0000 7f21ab7fe640 1 -- 172.21.15.98:0/222803582 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac111880 con 0x7f21ac110d90 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.624+0000 7f21ab7fe640 1 --2- 172.21.15.98:0/222803582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac111170 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f219c009720 tx=0x7f219c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86c28bb4844ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21aa7fc640 1 -- 172.21.15.98:0/222803582 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21ac110d90 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21aa7fc640 1 -- 172.21.15.98:0/222803582 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c02ad90 con 0x7f21ac110d90 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21aa7fc640 1 -- 172.21.15.98:0/222803582 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c032590 con 0x7f21ac110d90 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 -- 172.21.15.98:0/222803582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 msgr2=0x7f21ac111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 --2- 172.21.15.98:0/222803582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac111170 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f219c009720 tx=0x7f219c02a110 comp rx=0 tx=0).stop 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 -- 172.21.15.98:0/222803582 shutdown_connections 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 --2- 172.21.15.98:0/222803582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac111170 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:09.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 -- 172.21.15.98:0/222803582 >> 172.21.15.98:0/222803582 conn(0x7f21ac070850 msgr2=0x7f21ac072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 -- 172.21.15.98:0/222803582 shutdown_connections 2024-09-10T04:54:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.625+0000 7f21b1f91640 1 -- 172.21.15.98:0/222803582 wait complete. 2024-09-10T04:54:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.626+0000 7f21b1f91640 1 Processor -- start 2024-09-10T04:54:09.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.626+0000 7f21b1f91640 1 -- start start 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21b1f91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21b1f91640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac134120 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21ab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21ab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38450/0 (socket says 172.21.15.98:38450) 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21ab7fe640 1 -- 172.21.15.98:0/1733586862 learned_addr learned my addr 172.21.15.98:0/1733586862 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21ab7fe640 1 -- 172.21.15.98:0/1733586862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac128830 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21ab7fe640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f219c009840 tx=0x7f219c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c041020 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c03d550 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac12a0d0 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c037040 con 0x7f21ac110d90 2024-09-10T04:54:09.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.627+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac1276e0 con 0x7f21ac110d90 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.628+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f219c044020 con 0x7f21ac110d90 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.628+0000 7f2193fff640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 0x7f2198040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.628+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7f219c0734b0 con 0x7f21ac110d90 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.628+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac114260 con 0x7f21ac110d90 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.629+0000 7f21aaffd640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 0x7f2198040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.629+0000 7f21aaffd640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 0x7f2198040300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:09.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.633+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f21ac114260 con 0x7f21ac110d90 2024-09-10T04:54:09.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.804+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21ac111170 con 0x7f219803de40 2024-09-10T04:54:09.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.815+0000 7f2193fff640 1 -- 172.21.15.98:0/1733586862 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666220 (secure 0 0 0) 0x7f21ac111170 con 0x7f219803de40 2024-09-10T04:54:09.823 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:54:09.828 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:54:09.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 msgr2=0x7f2198040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:09.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 0x7f2198040300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007aa0 comp rx=0 tx=0).stop 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 msgr2=0x7f21ac1271a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f219c009840 tx=0x7f219c0046c0 comp rx=0 tx=0).stop 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 shutdown_connections 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7f219803de40 0x7f2198040300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 --2- 172.21.15.98:0/1733586862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21ac110d90 0x7f21ac1271a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 >> 172.21.15.98:0/1733586862 conn(0x7f21ac070850 msgr2=0x7f21ac0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.819+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 shutdown_connections 2024-09-10T04:54:09.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:09.820+0000 7f21b1f91640 1 -- 172.21.15.98:0/1733586862 wait complete. 2024-09-10T04:54:09.831 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-10T04:54:09.267745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4800,"ondisk_log_size":4800,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1786524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":161736472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003575"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.698685+0000","last_change":"2024-09-10T04:53:49.698685+0000","last_active":"2024-09-10T04:53:49.698685+0000","last_peered":"2024-09-10T04:53:49.698685+0000","last_clean":"2024-09-10T04:53:49.698685+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:53:49.698685+0000","last_undegraded":"2024-09-10T04:53:49.698685+0000","last_fullsized":"2024-09-10T04:53:49.698685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.698611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:57.933974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.700485+0000","last_change":"2024-09-10T04:54:02.700485+0000","last_active":"2024-09-10T04:54:02.700485+0000","last_peered":"2024-09-10T04:54:02.700485+0000","last_clean":"2024-09-10T04:54:02.700485+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:54:02.700485+0000","last_undegraded":"2024-09-10T04:54:02.700485+0000","last_fullsized":"2024-09-10T04:54:02.700485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.700385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.433289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.001358+0000","last_change":"2024-09-10T04:53:43.001358+0000","last_active":"2024-09-10T04:53:43.001358+0000","last_peered":"2024-09-10T04:53:43.001358+0000","last_clean":"2024-09-10T04:53:43.001358+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:53:43.001358+0000","last_undegraded":"2024-09-10T04:53:43.001358+0000","last_fullsized":"2024-09-10T04:53:43.001358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.001271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:10.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.327201+0000","last_change":"2024-09-10T04:54:06.327201+0000","last_active":"2024-09-10T04:54:06.327201+0000","last_peered":"2024-09-10T04:54:06.327201+0000","last_clean":"2024-09-10T04:54:06.327201+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:54:06.327201+0000","last_undegraded":"2024-09-10T04:54:06.327201+0000","last_fullsized":"2024-09-10T04:54:06.327201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.327112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:25.832246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.279273+0000","last_change":"2024-09-10T04:53:50.279273+0000","last_active":"2024-09-10T04:53:50.279273+0000","last_peered":"2024-09-10T04:53:50.279273+0000","last_clean":"2024-09-10T04:53:50.279273+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:53:50.279273+0000","last_undegraded":"2024-09-10T04:53:50.279273+0000","last_fullsized":"2024-09-10T04:53:50.279273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.279186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:17.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.275840+0000","last_change":"2024-09-10T04:53:50.275840+0000","last_active":"2024-09-10T04:53:50.275840+0000","last_peered":"2024-09-10T04:53:50.275840+0000","last_clean":"2024-09-10T04:53:50.275840+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:53:50.275840+0000","last_undegraded":"2024-09-10T04:53:50.275840+0000","last_fullsized":"2024-09-10T04:53:50.275840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.275751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:45.236387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.350611+0000","last_change":"2024-09-10T04:53:37.350530+0000","last_active":"2024-09-10T04:53:37.350611+0000","last_peered":"2024-09-10T04:53:37.350611+0000","last_clean":"2024-09-10T04:53:37.350611+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:53:37.350611+0000","last_undegraded":"2024-09-10T04:53:37.350611+0000","last_fullsized":"2024-09-10T04:53:37.350611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.350444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:41.145937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.343098+0000","last_change":"2024-09-10T04:53:52.343098+0000","last_active":"2024-09-10T04:53:52.343098+0000","last_peered":"2024-09-10T04:53:52.343098+0000","last_clean":"2024-09-10T04:53:52.343098+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:53:52.343098+0000","last_undegraded":"2024-09-10T04:53:52.343098+0000","last_fullsized":"2024-09-10T04:53:52.343098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.343002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:01.985121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.688036+0000","last_change":"2024-09-10T04:53:47.688036+0000","last_active":"2024-09-10T04:53:47.688036+0000","last_peered":"2024-09-10T04:53:47.688036+0000","last_clean":"2024-09-10T04:53:47.688036+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:53:47.688036+0000","last_undegraded":"2024-09-10T04:53:47.688036+0000","last_fullsized":"2024-09-10T04:53:47.688036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.687954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:11.907238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.988067+0000","last_change":"2024-09-10T04:53:59.988067+0000","last_active":"2024-09-10T04:53:59.988067+0000","last_peered":"2024-09-10T04:53:59.988067+0000","last_clean":"2024-09-10T04:53:59.988067+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:53:59.988067+0000","last_undegraded":"2024-09-10T04:53:59.988067+0000","last_fullsized":"2024-09-10T04:53:59.988067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.987987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:25.844429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.630867+0000","last_change":"2024-09-10T04:53:51.630867+0000","last_active":"2024-09-10T04:53:51.630867+0000","last_peered":"2024-09-10T04:53:51.630867+0000","last_clean":"2024-09-10T04:53:51.630867+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:53:51.630867+0000","last_undegraded":"2024-09-10T04:53:51.630867+0000","last_fullsized":"2024-09-10T04:53:51.630867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.630781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:09.098807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.652963+0000","last_change":"2024-09-10T04:54:05.652963+0000","last_active":"2024-09-10T04:54:05.652963+0000","last_peered":"2024-09-10T04:54:05.652963+0000","last_clean":"2024-09-10T04:54:05.652963+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:54:05.652963+0000","last_undegraded":"2024-09-10T04:54:05.652963+0000","last_fullsized":"2024-09-10T04:54:05.652963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.652884+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:11.501788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.274521+0000","last_change":"2024-09-10T04:53:49.274521+0000","last_active":"2024-09-10T04:53:49.274521+0000","last_peered":"2024-09-10T04:53:49.274521+0000","last_clean":"2024-09-10T04:53:49.274521+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:49.274521+0000","last_undegraded":"2024-09-10T04:53:49.274521+0000","last_fullsized":"2024-09-10T04:53:49.274521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.274457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:34.463042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.681516+0000","last_change":"2024-09-10T04:54:04.681516+0000","last_active":"2024-09-10T04:54:04.681516+0000","last_peered":"2024-09-10T04:54:04.681516+0000","last_clean":"2024-09-10T04:54:04.681516+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:54:04.681516+0000","last_undegraded":"2024-09-10T04:54:04.681516+0000","last_fullsized":"2024-09-10T04:54:04.681516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.681418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:36.857790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.321611+0000","last_change":"2024-09-10T04:53:48.321611+0000","last_active":"2024-09-10T04:53:48.321611+0000","last_peered":"2024-09-10T04:53:48.321611+0000","last_clean":"2024-09-10T04:53:48.321611+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:48.321611+0000","last_undegraded":"2024-09-10T04:53:48.321611+0000","last_fullsized":"2024-09-10T04:53:48.321611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.321527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:27.094894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'14","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.375914+0000","last_change":"2024-09-10T04:53:53.375914+0000","last_active":"2024-09-10T04:53:53.375914+0000","last_peered":"2024-09-10T04:53:53.375914+0000","last_clean":"2024-09-10T04:53:53.375914+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:53.375914+0000","last_undegraded":"2024-09-10T04:53:53.375914+0000","last_fullsized":"2024-09-10T04:53:53.375914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.375824+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:30.125628+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.739403+0000","last_change":"2024-09-10T04:53:59.739403+0000","last_active":"2024-09-10T04:53:59.739403+0000","last_peered":"2024-09-10T04:53:59.739403+0000","last_clean":"2024-09-10T04:53:59.739403+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:59.739403+0000","last_undegraded":"2024-09-10T04:53:59.739403+0000","last_fullsized":"2024-09-10T04:53:59.739403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.739317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:04.211884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.004475+0000","last_change":"2024-09-10T04:53:42.004475+0000","last_active":"2024-09-10T04:53:42.004475+0000","last_peered":"2024-09-10T04:53:42.004475+0000","last_clean":"2024-09-10T04:53:42.004475+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:53:42.004475+0000","last_undegraded":"2024-09-10T04:53:42.004475+0000","last_fullsized":"2024-09-10T04:53:42.004475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.004361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.759496+0000","last_change":"2024-09-10T04:54:00.759496+0000","last_active":"2024-09-10T04:54:00.759496+0000","last_peered":"2024-09-10T04:54:00.759496+0000","last_clean":"2024-09-10T04:54:00.759496+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:54:00.759496+0000","last_undegraded":"2024-09-10T04:54:00.759496+0000","last_fullsized":"2024-09-10T04:54:00.759496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.759398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:36.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.373882+0000","last_change":"2024-09-10T04:53:38.373882+0000","last_active":"2024-09-10T04:53:38.373882+0000","last_peered":"2024-09-10T04:53:38.373882+0000","last_clean":"2024-09-10T04:53:38.373882+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:53:38.373882+0000","last_undegraded":"2024-09-10T04:53:38.373882+0000","last_fullsized":"2024-09-10T04:53:38.373882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.373750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:37.943360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.980944+0000","last_change":"2024-09-10T04:50:10.824506+0000","last_active":"2024-09-10T04:53:17.980944+0000","last_peered":"2024-09-10T04:53:17.980944+0000","last_clean":"2024-09-10T04:53:17.980944+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:53:17.980944+0000","last_undegraded":"2024-09-10T04:53:17.980944+0000","last_fullsized":"2024-09-10T04:53:17.980944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:09.799296+0000","last_clean_scrub_stamp":"2024-09-10T04:50:09.799296+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:58:09.111358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.758491+0000","last_change":"2024-09-10T04:53:45.758491+0000","last_active":"2024-09-10T04:53:45.758491+0000","last_peered":"2024-09-10T04:53:45.758491+0000","last_clean":"2024-09-10T04:53:45.758491+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:53:45.758491+0000","last_undegraded":"2024-09-10T04:53:45.758491+0000","last_fullsized":"2024-09-10T04:53:45.758491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.758406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:20.305511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.316685+0000","last_change":"2024-09-10T04:53:51.316685+0000","last_active":"2024-09-10T04:53:51.316685+0000","last_peered":"2024-09-10T04:53:51.316685+0000","last_clean":"2024-09-10T04:53:51.316685+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:53:51.316685+0000","last_undegraded":"2024-09-10T04:53:51.316685+0000","last_fullsized":"2024-09-10T04:53:51.316685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.316587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:59.365417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.726404+0000","last_change":"2024-09-10T04:53:46.726404+0000","last_active":"2024-09-10T04:53:46.726404+0000","last_peered":"2024-09-10T04:53:46.726404+0000","last_clean":"2024-09-10T04:53:46.726404+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:53:46.726404+0000","last_undegraded":"2024-09-10T04:53:46.726404+0000","last_fullsized":"2024-09-10T04:53:46.726404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.726317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:16.025123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.294652+0000","last_change":"2024-09-10T04:53:47.294652+0000","last_active":"2024-09-10T04:53:47.294652+0000","last_peered":"2024-09-10T04:53:47.294652+0000","last_clean":"2024-09-10T04:53:47.294652+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:53:47.294652+0000","last_undegraded":"2024-09-10T04:53:47.294652+0000","last_fullsized":"2024-09-10T04:53:47.294652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.294557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:04:50.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.324104+0000","last_change":"2024-09-10T04:53:47.324104+0000","last_active":"2024-09-10T04:53:47.324104+0000","last_peered":"2024-09-10T04:53:47.324104+0000","last_clean":"2024-09-10T04:53:47.324104+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:47.324104+0000","last_undegraded":"2024-09-10T04:53:47.324104+0000","last_fullsized":"2024-09-10T04:53:47.324104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.324019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:42.318106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.980213+0000","last_change":"2024-09-10T04:53:58.980213+0000","last_active":"2024-09-10T04:53:58.980213+0000","last_peered":"2024-09-10T04:53:58.980213+0000","last_clean":"2024-09-10T04:53:58.980213+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:58.980213+0000","last_undegraded":"2024-09-10T04:53:58.980213+0000","last_fullsized":"2024-09-10T04:53:58.980213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.980132+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:12.434041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.313891+0000","last_change":"2024-09-10T04:53:46.313891+0000","last_active":"2024-09-10T04:53:46.313891+0000","last_peered":"2024-09-10T04:53:46.313891+0000","last_clean":"2024-09-10T04:53:46.313891+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:53:46.313891+0000","last_undegraded":"2024-09-10T04:53:46.313891+0000","last_fullsized":"2024-09-10T04:53:46.313891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.313767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:23.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.210504+0000","last_change":"2024-09-10T04:53:55.210504+0000","last_active":"2024-09-10T04:53:55.210504+0000","last_peered":"2024-09-10T04:53:55.210504+0000","last_clean":"2024-09-10T04:53:55.210504+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:55.210504+0000","last_undegraded":"2024-09-10T04:53:55.210504+0000","last_fullsized":"2024-09-10T04:53:55.210504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.210414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:21:26.821090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.335583+0000","last_change":"2024-09-10T04:53:35.335583+0000","last_active":"2024-09-10T04:53:35.335583+0000","last_peered":"2024-09-10T04:53:35.335583+0000","last_clean":"2024-09-10T04:53:35.335583+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:53:35.335583+0000","last_undegraded":"2024-09-10T04:53:35.335583+0000","last_fullsized":"2024-09-10T04:53:35.335583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.335499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:57.235909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881870+0000","last_change":"2024-09-10T04:50:12.832705+0000","last_active":"2024-09-10T04:50:48.881870+0000","last_peered":"2024-09-10T04:50:48.881870+0000","last_clean":"2024-09-10T04:50:48.881870+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:50:48.881870+0000","last_undegraded":"2024-09-10T04:50:48.881870+0000","last_fullsized":"2024-09-10T04:50:48.881870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:08.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.612641+0000","last_change":"2024-09-10T04:50:14.836927+0000","last_active":"2024-09-10T04:53:24.612641+0000","last_peered":"2024-09-10T04:53:24.612641+0000","last_clean":"2024-09-10T04:53:24.612641+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:53:24.612641+0000","last_undegraded":"2024-09-10T04:53:24.612641+0000","last_fullsized":"2024-09-10T04:53:24.612641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:05.053256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.232292+0000","last_change":"2024-09-10T04:53:56.232292+0000","last_active":"2024-09-10T04:53:56.232292+0000","last_peered":"2024-09-10T04:53:56.232292+0000","last_clean":"2024-09-10T04:53:56.232292+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:53:56.232292+0000","last_undegraded":"2024-09-10T04:53:56.232292+0000","last_fullsized":"2024-09-10T04:53:56.232292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.232172+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:38.675568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.477349+0000","last_change":"2024-09-10T04:53:30.477349+0000","last_active":"2024-09-10T04:53:30.477349+0000","last_peered":"2024-09-10T04:53:30.477349+0000","last_clean":"2024-09-10T04:53:30.477349+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:30.477349+0000","last_undegraded":"2024-09-10T04:53:30.477349+0000","last_fullsized":"2024-09-10T04:53:30.477349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.477261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:40.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883610+0000","last_change":"2024-09-10T04:50:12.829927+0000","last_active":"2024-09-10T04:50:48.883610+0000","last_peered":"2024-09-10T04:50:48.883610+0000","last_clean":"2024-09-10T04:50:48.883610+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:50:48.883610+0000","last_undegraded":"2024-09-10T04:50:48.883610+0000","last_fullsized":"2024-09-10T04:50:48.883610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:58.300730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879153+0000","last_change":"2024-09-10T04:50:14.842542+0000","last_active":"2024-09-10T04:50:48.879153+0000","last_peered":"2024-09-10T04:50:48.879153+0000","last_clean":"2024-09-10T04:50:48.879153+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:50:48.879153+0000","last_undegraded":"2024-09-10T04:50:48.879153+0000","last_fullsized":"2024-09-10T04:50:48.879153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:04.538498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.243155+0000","last_change":"2024-09-10T04:53:57.243155+0000","last_active":"2024-09-10T04:53:57.243155+0000","last_peered":"2024-09-10T04:53:57.243155+0000","last_clean":"2024-09-10T04:53:57.243155+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:53:57.243155+0000","last_undegraded":"2024-09-10T04:53:57.243155+0000","last_fullsized":"2024-09-10T04:53:57.243155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.243066+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:14.528708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.682127+0000","last_change":"2024-09-10T04:53:39.682127+0000","last_active":"2024-09-10T04:53:39.682127+0000","last_peered":"2024-09-10T04:53:39.682127+0000","last_clean":"2024-09-10T04:53:39.682127+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:53:39.682127+0000","last_undegraded":"2024-09-10T04:53:39.682127+0000","last_fullsized":"2024-09-10T04:53:39.682127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.682042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:15.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881528+0000","last_change":"2024-09-10T04:50:12.833562+0000","last_active":"2024-09-10T04:50:48.881528+0000","last_peered":"2024-09-10T04:50:48.881528+0000","last_clean":"2024-09-10T04:50:48.881528+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:50:48.881528+0000","last_undegraded":"2024-09-10T04:50:48.881528+0000","last_fullsized":"2024-09-10T04:50:48.881528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:58.386797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.165507+0000","last_change":"2024-09-10T04:54:03.165507+0000","last_active":"2024-09-10T04:54:03.165507+0000","last_peered":"2024-09-10T04:54:03.165507+0000","last_clean":"2024-09-10T04:54:03.165507+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:54:03.165507+0000","last_undegraded":"2024-09-10T04:54:03.165507+0000","last_fullsized":"2024-09-10T04:54:03.165507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.165411+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:24.743039+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.499186+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:24.499186+0000","last_peered":"2024-09-10T04:53:24.499186+0000","last_clean":"2024-09-10T04:53:24.499186+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:24.499186+0000","last_undegraded":"2024-09-10T04:53:24.499186+0000","last_fullsized":"2024-09-10T04:53:24.499186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870665+0000","last_change":"2024-09-10T04:50:18.855654+0000","last_active":"2024-09-10T04:50:48.870665+0000","last_peered":"2024-09-10T04:50:48.870665+0000","last_clean":"2024-09-10T04:50:48.870665+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:50:48.870665+0000","last_undegraded":"2024-09-10T04:50:48.870665+0000","last_fullsized":"2024-09-10T04:50:48.870665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:37.190514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.278049+0000","last_change":"2024-09-10T04:53:58.278049+0000","last_active":"2024-09-10T04:53:58.278049+0000","last_peered":"2024-09-10T04:53:58.278049+0000","last_clean":"2024-09-10T04:53:58.278049+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:58.278049+0000","last_undegraded":"2024-09-10T04:53:58.278049+0000","last_fullsized":"2024-09-10T04:53:58.278049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.277963+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:29.914920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.654294+0000","last_change":"2024-09-10T04:53:38.654294+0000","last_active":"2024-09-10T04:53:38.654294+0000","last_peered":"2024-09-10T04:53:38.654294+0000","last_clean":"2024-09-10T04:53:38.654294+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:53:38.654294+0000","last_undegraded":"2024-09-10T04:53:38.654294+0000","last_fullsized":"2024-09-10T04:53:38.654294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.654187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:34.763819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878279+0000","last_change":"2024-09-10T04:50:12.825645+0000","last_active":"2024-09-10T04:50:48.878279+0000","last_peered":"2024-09-10T04:50:48.878279+0000","last_clean":"2024-09-10T04:50:48.878279+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:50:48.878279+0000","last_undegraded":"2024-09-10T04:50:48.878279+0000","last_fullsized":"2024-09-10T04:50:48.878279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:43.253528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'42","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.597877+0000","last_change":"2024-09-10T04:50:14.834094+0000","last_active":"2024-09-10T04:53:24.597877+0000","last_peered":"2024-09-10T04:53:24.597877+0000","last_clean":"2024-09-10T04:53:24.597877+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:53:24.597877+0000","last_undegraded":"2024-09-10T04:53:24.597877+0000","last_fullsized":"2024-09-10T04:53:24.597877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:08.314321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.503620+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:24.503620+0000","last_peered":"2024-09-10T04:53:24.503620+0000","last_clean":"2024-09-10T04:53:24.503620+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:24.503620+0000","last_undegraded":"2024-09-10T04:53:24.503620+0000","last_fullsized":"2024-09-10T04:53:24.503620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.322241+0000","last_change":"2024-09-10T04:53:40.322241+0000","last_active":"2024-09-10T04:53:40.322241+0000","last_peered":"2024-09-10T04:53:40.322241+0000","last_clean":"2024-09-10T04:53:40.322241+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:40.322241+0000","last_undegraded":"2024-09-10T04:53:40.322241+0000","last_fullsized":"2024-09-10T04:53:40.322241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.322153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:47.658822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.659561+0000","last_change":"2024-09-10T04:53:41.659561+0000","last_active":"2024-09-10T04:53:41.659561+0000","last_peered":"2024-09-10T04:53:41.659561+0000","last_clean":"2024-09-10T04:53:41.659561+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:53:41.659561+0000","last_undegraded":"2024-09-10T04:53:41.659561+0000","last_fullsized":"2024-09-10T04:53:41.659561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.659470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:46.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.991571+0000","last_change":"2024-09-10T04:54:03.991571+0000","last_active":"2024-09-10T04:54:03.991571+0000","last_peered":"2024-09-10T04:54:03.991571+0000","last_clean":"2024-09-10T04:54:03.991571+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:54:03.991571+0000","last_undegraded":"2024-09-10T04:54:03.991571+0000","last_fullsized":"2024-09-10T04:54:03.991571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.991486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:01.756702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'50","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.640112+0000","last_change":"2024-09-10T04:50:14.837571+0000","last_active":"2024-09-10T04:53:24.640112+0000","last_peered":"2024-09-10T04:53:24.640112+0000","last_clean":"2024-09-10T04:53:24.640112+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:53:24.640112+0000","last_undegraded":"2024-09-10T04:53:24.640112+0000","last_fullsized":"2024-09-10T04:53:24.640112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874985+0000","last_change":"2024-09-10T04:50:16.845690+0000","last_active":"2024-09-10T04:50:48.874985+0000","last_peered":"2024-09-10T04:50:48.874985+0000","last_clean":"2024-09-10T04:50:48.874985+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:50:48.874985+0000","last_undegraded":"2024-09-10T04:50:48.874985+0000","last_fullsized":"2024-09-10T04:50:48.874985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:28.672769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.538359+0000","last_change":"2024-09-10T04:50:18.858060+0000","last_active":"2024-09-10T04:51:33.538359+0000","last_peered":"2024-09-10T04:51:33.538359+0000","last_clean":"2024-09-10T04:51:33.538359+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:51:33.538359+0000","last_undegraded":"2024-09-10T04:51:33.538359+0000","last_fullsized":"2024-09-10T04:51:33.538359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:22.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.968650+0000","last_change":"2024-09-10T04:53:46.968650+0000","last_active":"2024-09-10T04:53:46.968650+0000","last_peered":"2024-09-10T04:53:46.968650+0000","last_clean":"2024-09-10T04:53:46.968650+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:53:46.968650+0000","last_undegraded":"2024-09-10T04:53:46.968650+0000","last_fullsized":"2024-09-10T04:53:46.968650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.968570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:17.768222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.646386+0000","last_change":"2024-09-10T04:53:37.646386+0000","last_active":"2024-09-10T04:53:37.646386+0000","last_peered":"2024-09-10T04:53:37.646386+0000","last_clean":"2024-09-10T04:53:37.646386+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:53:37.646386+0000","last_undegraded":"2024-09-10T04:53:37.646386+0000","last_fullsized":"2024-09-10T04:53:37.646386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.646297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"34'2","reported_seq":240,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.301224+0000","last_change":"2024-09-10T04:53:56.301224+0000","last_active":"2024-09-10T04:53:56.301224+0000","last_peered":"2024-09-10T04:53:56.301224+0000","last_clean":"2024-09-10T04:53:56.301224+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:53:56.301224+0000","last_undegraded":"2024-09-10T04:53:56.301224+0000","last_fullsized":"2024-09-10T04:53:56.301224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.301141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:29.983059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.568237+0000","last_change":"2024-09-10T04:50:14.838105+0000","last_active":"2024-09-10T04:53:24.568237+0000","last_peered":"2024-09-10T04:53:24.568237+0000","last_clean":"2024-09-10T04:53:24.568237+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:53:24.568237+0000","last_undegraded":"2024-09-10T04:53:24.568237+0000","last_fullsized":"2024-09-10T04:53:24.568237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:21.175743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:27.989993+0000","last_change":"2024-09-10T04:50:18.854211+0000","last_active":"2024-09-10T04:51:27.989993+0000","last_peered":"2024-09-10T04:51:27.989993+0000","last_clean":"2024-09-10T04:51:27.989993+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:51:27.989993+0000","last_undegraded":"2024-09-10T04:51:27.989993+0000","last_fullsized":"2024-09-10T04:51:27.989993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:56.365659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.706531+0000","last_change":"2024-09-10T04:53:53.706531+0000","last_active":"2024-09-10T04:53:53.706531+0000","last_peered":"2024-09-10T04:53:53.706531+0000","last_clean":"2024-09-10T04:53:53.706531+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:53.706531+0000","last_undegraded":"2024-09-10T04:53:53.706531+0000","last_fullsized":"2024-09-10T04:53:53.706531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.706430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:01.447306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.674057+0000","last_change":"2024-09-10T04:53:36.674057+0000","last_active":"2024-09-10T04:53:36.674057+0000","last_peered":"2024-09-10T04:53:36.674057+0000","last_clean":"2024-09-10T04:53:36.674057+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:53:36.674057+0000","last_undegraded":"2024-09-10T04:53:36.674057+0000","last_fullsized":"2024-09-10T04:53:36.674057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.673934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:50.127843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.290654+0000","last_change":"2024-09-10T04:53:58.290654+0000","last_active":"2024-09-10T04:53:58.290654+0000","last_peered":"2024-09-10T04:53:58.290654+0000","last_clean":"2024-09-10T04:53:58.290654+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:53:58.290654+0000","last_undegraded":"2024-09-10T04:53:58.290654+0000","last_fullsized":"2024-09-10T04:53:58.290654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.290557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:05.934767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'51","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.645961+0000","last_change":"2024-09-10T04:50:14.834275+0000","last_active":"2024-09-10T04:53:24.645961+0000","last_peered":"2024-09-10T04:53:24.645961+0000","last_clean":"2024-09-10T04:53:24.645961+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:53:24.645961+0000","last_undegraded":"2024-09-10T04:53:24.645961+0000","last_fullsized":"2024-09-10T04:53:24.645961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:56.168532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.239662+0000","last_change":"2024-09-10T04:54:08.239662+0000","last_active":"2024-09-10T04:54:08.239662+0000","last_peered":"2024-09-10T04:54:08.239662+0000","last_clean":"2024-09-10T04:54:08.239662+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:54:08.239662+0000","last_undegraded":"2024-09-10T04:54:08.239662+0000","last_fullsized":"2024-09-10T04:54:08.239662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.239567+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.192002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.765944+0000","last_change":"2024-09-10T04:50:18.858300+0000","last_active":"2024-09-10T04:53:17.765944+0000","last_peered":"2024-09-10T04:53:17.765944+0000","last_clean":"2024-09-10T04:53:17.765944+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:53:17.765944+0000","last_undegraded":"2024-09-10T04:53:17.765944+0000","last_fullsized":"2024-09-10T04:53:17.765944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:00.791617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.315791+0000","last_change":"2024-09-10T04:53:42.315791+0000","last_active":"2024-09-10T04:53:42.315791+0000","last_peered":"2024-09-10T04:53:42.315791+0000","last_clean":"2024-09-10T04:53:42.315791+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:42.315791+0000","last_undegraded":"2024-09-10T04:53:42.315791+0000","last_fullsized":"2024-09-10T04:53:42.315791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.315680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:17.255872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.698115+0000","last_change":"2024-09-10T04:53:34.698115+0000","last_active":"2024-09-10T04:53:34.698115+0000","last_peered":"2024-09-10T04:53:34.698115+0000","last_clean":"2024-09-10T04:53:34.698115+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:53:34.698115+0000","last_undegraded":"2024-09-10T04:53:34.698115+0000","last_fullsized":"2024-09-10T04:53:34.698115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.698035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:37.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.329124+0000","last_change":"2024-09-10T04:53:57.329124+0000","last_active":"2024-09-10T04:53:57.329124+0000","last_peered":"2024-09-10T04:53:57.329124+0000","last_clean":"2024-09-10T04:53:57.329124+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:53:57.329124+0000","last_undegraded":"2024-09-10T04:53:57.329124+0000","last_fullsized":"2024-09-10T04:53:57.329124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.329039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:50.320602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.651808+0000","last_change":"2024-09-10T04:50:14.846391+0000","last_active":"2024-09-10T04:53:24.651808+0000","last_peered":"2024-09-10T04:53:24.651808+0000","last_clean":"2024-09-10T04:53:24.651808+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:53:24.651808+0000","last_undegraded":"2024-09-10T04:53:24.651808+0000","last_fullsized":"2024-09-10T04:53:24.651808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.919512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.235429+0000","last_change":"2024-09-10T04:54:05.235429+0000","last_active":"2024-09-10T04:54:05.235429+0000","last_peered":"2024-09-10T04:54:05.235429+0000","last_clean":"2024-09-10T04:54:05.235429+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:54:05.235429+0000","last_undegraded":"2024-09-10T04:54:05.235429+0000","last_fullsized":"2024-09-10T04:54:05.235429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.235334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.026590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.060657+0000","last_change":"2024-09-10T04:50:18.862329+0000","last_active":"2024-09-10T04:53:18.060657+0000","last_peered":"2024-09-10T04:53:18.060657+0000","last_clean":"2024-09-10T04:53:18.060657+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:53:18.060657+0000","last_undegraded":"2024-09-10T04:53:18.060657+0000","last_fullsized":"2024-09-10T04:53:18.060657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:27.589457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.926197+0000","last_change":"2024-09-10T04:53:47.926197+0000","last_active":"2024-09-10T04:53:47.926197+0000","last_peered":"2024-09-10T04:53:47.926197+0000","last_clean":"2024-09-10T04:53:47.926197+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:53:47.926197+0000","last_undegraded":"2024-09-10T04:53:47.926197+0000","last_fullsized":"2024-09-10T04:53:47.926197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.926107+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.345795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.316210+0000","last_change":"2024-09-10T04:53:34.316210+0000","last_active":"2024-09-10T04:53:34.316210+0000","last_peered":"2024-09-10T04:53:34.316210+0000","last_clean":"2024-09-10T04:53:34.316210+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:53:34.316210+0000","last_undegraded":"2024-09-10T04:53:34.316210+0000","last_fullsized":"2024-09-10T04:53:34.316210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.316125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:51.933570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.218139+0000","last_change":"2024-09-10T04:54:00.218139+0000","last_active":"2024-09-10T04:54:00.218139+0000","last_peered":"2024-09-10T04:54:00.218139+0000","last_clean":"2024-09-10T04:54:00.218139+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:54:00.218139+0000","last_undegraded":"2024-09-10T04:54:00.218139+0000","last_fullsized":"2024-09-10T04:54:00.218139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.218033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:17.651257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.580315+0000","last_change":"2024-09-10T04:50:14.841965+0000","last_active":"2024-09-10T04:53:24.580315+0000","last_peered":"2024-09-10T04:53:24.580315+0000","last_clean":"2024-09-10T04:53:24.580315+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:53:24.580315+0000","last_undegraded":"2024-09-10T04:53:24.580315+0000","last_fullsized":"2024-09-10T04:53:24.580315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:29.205016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.224997+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:52:18.224997+0000","last_peered":"2024-09-10T04:52:18.224997+0000","last_clean":"2024-09-10T04:52:18.224997+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:52:18.224997+0000","last_undegraded":"2024-09-10T04:52:18.224997+0000","last_fullsized":"2024-09-10T04:52:18.224997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:50.836886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.741624+0000","last_change":"2024-09-10T04:54:01.741624+0000","last_active":"2024-09-10T04:54:01.741624+0000","last_peered":"2024-09-10T04:54:01.741624+0000","last_clean":"2024-09-10T04:54:01.741624+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:54:01.741624+0000","last_undegraded":"2024-09-10T04:54:01.741624+0000","last_fullsized":"2024-09-10T04:54:01.741624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.741510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.143399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.705492+0000","last_change":"2024-09-10T04:53:33.705492+0000","last_active":"2024-09-10T04:53:33.705492+0000","last_peered":"2024-09-10T04:53:33.705492+0000","last_clean":"2024-09-10T04:53:33.705492+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:53:33.705492+0000","last_undegraded":"2024-09-10T04:53:33.705492+0000","last_fullsized":"2024-09-10T04:53:33.705492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.705362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:44.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.966021+0000","last_change":"2024-09-10T04:54:04.966021+0000","last_active":"2024-09-10T04:54:04.966021+0000","last_peered":"2024-09-10T04:54:04.966021+0000","last_clean":"2024-09-10T04:54:04.966021+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:54:04.966021+0000","last_undegraded":"2024-09-10T04:54:04.966021+0000","last_fullsized":"2024-09-10T04:54:04.966021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.965940+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.903141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'47","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.188475+0000","last_change":"2024-09-10T04:54:02.188475+0000","last_active":"2024-09-10T04:54:02.188475+0000","last_peered":"2024-09-10T04:54:02.188475+0000","last_clean":"2024-09-10T04:54:02.188475+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:54:02.188475+0000","last_undegraded":"2024-09-10T04:54:02.188475+0000","last_fullsized":"2024-09-10T04:54:02.188475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.188348+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:09.968600+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.241799+0000","last_change":"2024-09-10T04:54:06.241799+0000","last_active":"2024-09-10T04:54:06.241799+0000","last_peered":"2024-09-10T04:54:06.241799+0000","last_clean":"2024-09-10T04:54:06.241799+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:54:06.241799+0000","last_undegraded":"2024-09-10T04:54:06.241799+0000","last_fullsized":"2024-09-10T04:54:06.241799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.241706+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:36.748454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225745+0000","last_change":"2024-09-10T04:50:18.856687+0000","last_active":"2024-09-10T04:52:23.225745+0000","last_peered":"2024-09-10T04:52:23.225745+0000","last_clean":"2024-09-10T04:52:23.225745+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:52:23.225745+0000","last_undegraded":"2024-09-10T04:52:23.225745+0000","last_fullsized":"2024-09-10T04:52:23.225745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:44.346361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.303154+0000","last_change":"2024-09-10T04:53:41.303154+0000","last_active":"2024-09-10T04:53:41.303154+0000","last_peered":"2024-09-10T04:53:41.303154+0000","last_clean":"2024-09-10T04:53:41.303154+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:41.303154+0000","last_undegraded":"2024-09-10T04:53:41.303154+0000","last_fullsized":"2024-09-10T04:53:41.303154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.303062+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:36.191501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.277832+0000","last_change":"2024-09-10T04:53:32.277832+0000","last_active":"2024-09-10T04:53:32.277832+0000","last_peered":"2024-09-10T04:53:32.277832+0000","last_clean":"2024-09-10T04:53:32.277832+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:53:32.277832+0000","last_undegraded":"2024-09-10T04:53:32.277832+0000","last_fullsized":"2024-09-10T04:53:32.277832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.277745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:40.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.482581+0000","last_change":"2024-09-10T04:50:12.828893+0000","last_active":"2024-09-10T04:53:24.482581+0000","last_peered":"2024-09-10T04:53:24.482581+0000","last_clean":"2024-09-10T04:53:24.482581+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:53:24.482581+0000","last_undegraded":"2024-09-10T04:53:24.482581+0000","last_fullsized":"2024-09-10T04:53:24.482581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.367450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882883+0000","last_change":"2024-09-10T04:50:14.836880+0000","last_active":"2024-09-10T04:50:48.882883+0000","last_peered":"2024-09-10T04:50:48.882883+0000","last_clean":"2024-09-10T04:50:48.882883+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:50:48.882883+0000","last_undegraded":"2024-09-10T04:50:48.882883+0000","last_fullsized":"2024-09-10T04:50:48.882883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.182023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.501181+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:24.501181+0000","last_peered":"2024-09-10T04:53:24.501181+0000","last_clean":"2024-09-10T04:53:24.501181+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:24.501181+0000","last_undegraded":"2024-09-10T04:53:24.501181+0000","last_fullsized":"2024-09-10T04:53:24.501181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.072824+0000","last_change":"2024-09-10T04:50:18.856762+0000","last_active":"2024-09-10T04:52:17.072824+0000","last_peered":"2024-09-10T04:52:17.072824+0000","last_clean":"2024-09-10T04:52:17.072824+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:52:17.072824+0000","last_undegraded":"2024-09-10T04:52:17.072824+0000","last_fullsized":"2024-09-10T04:52:17.072824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:50.179256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.970935+0000","last_change":"2024-09-10T04:53:48.970935+0000","last_active":"2024-09-10T04:53:48.970935+0000","last_peered":"2024-09-10T04:53:48.970935+0000","last_clean":"2024-09-10T04:53:48.970935+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:48.970935+0000","last_undegraded":"2024-09-10T04:53:48.970935+0000","last_fullsized":"2024-09-10T04:53:48.970935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.970841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.945727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.328609+0000","last_change":"2024-09-10T04:53:30.328609+0000","last_active":"2024-09-10T04:53:30.328609+0000","last_peered":"2024-09-10T04:53:30.328609+0000","last_clean":"2024-09-10T04:53:30.328609+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:53:30.328609+0000","last_undegraded":"2024-09-10T04:53:30.328609+0000","last_fullsized":"2024-09-10T04:53:30.328609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.328488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:00.918192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.286074+0000","last_change":"2024-09-10T04:54:07.286074+0000","last_active":"2024-09-10T04:54:07.286074+0000","last_peered":"2024-09-10T04:54:07.286074+0000","last_clean":"2024-09-10T04:54:07.286074+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:54:07.286074+0000","last_undegraded":"2024-09-10T04:54:07.286074+0000","last_fullsized":"2024-09-10T04:54:07.286074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.285980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:17.562378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'43","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.629080+0000","last_change":"2024-09-10T04:50:14.841866+0000","last_active":"2024-09-10T04:53:24.629080+0000","last_peered":"2024-09-10T04:53:24.629080+0000","last_clean":"2024-09-10T04:53:24.629080+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:53:24.629080+0000","last_undegraded":"2024-09-10T04:53:24.629080+0000","last_fullsized":"2024-09-10T04:53:24.629080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876380+0000","last_change":"2024-09-10T04:50:16.844792+0000","last_active":"2024-09-10T04:50:48.876380+0000","last_peered":"2024-09-10T04:50:48.876380+0000","last_clean":"2024-09-10T04:50:48.876380+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:50:48.876380+0000","last_undegraded":"2024-09-10T04:50:48.876380+0000","last_fullsized":"2024-09-10T04:50:48.876380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:49.046571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.004051+0000","last_change":"2024-09-10T04:50:18.853001+0000","last_active":"2024-09-10T04:53:18.004051+0000","last_peered":"2024-09-10T04:53:18.004051+0000","last_clean":"2024-09-10T04:53:18.004051+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:53:18.004051+0000","last_undegraded":"2024-09-10T04:53:18.004051+0000","last_fullsized":"2024-09-10T04:53:18.004051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:12.332996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.671711+0000","last_change":"2024-09-10T04:53:50.671711+0000","last_active":"2024-09-10T04:53:50.671711+0000","last_peered":"2024-09-10T04:53:50.671711+0000","last_clean":"2024-09-10T04:53:50.671711+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:50.671711+0000","last_undegraded":"2024-09-10T04:53:50.671711+0000","last_fullsized":"2024-09-10T04:53:50.671711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.671613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:06.215300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.032500+0000","last_change":"2024-09-10T04:53:29.032422+0000","last_active":"2024-09-10T04:53:29.032500+0000","last_peered":"2024-09-10T04:53:29.032500+0000","last_clean":"2024-09-10T04:53:29.032500+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:53:29.032500+0000","last_undegraded":"2024-09-10T04:53:29.032500+0000","last_fullsized":"2024-09-10T04:53:29.032500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.032316+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:21.648097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.757540+0000","last_change":"2024-09-10T04:53:28.757540+0000","last_active":"2024-09-10T04:53:28.757540+0000","last_peered":"2024-09-10T04:53:28.757540+0000","last_clean":"2024-09-10T04:53:28.757540+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:53:28.757540+0000","last_undegraded":"2024-09-10T04:53:28.757540+0000","last_fullsized":"2024-09-10T04:53:28.757540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.757471+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:58.706956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.317328+0000","last_change":"2024-09-10T04:53:29.317328+0000","last_active":"2024-09-10T04:53:29.317328+0000","last_peered":"2024-09-10T04:53:29.317328+0000","last_clean":"2024-09-10T04:53:29.317328+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:53:29.317328+0000","last_undegraded":"2024-09-10T04:53:29.317328+0000","last_fullsized":"2024-09-10T04:53:29.317328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.317231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:37.108405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.996930+0000","last_change":"2024-09-10T04:54:01.996930+0000","last_active":"2024-09-10T04:54:01.996930+0000","last_peered":"2024-09-10T04:54:01.996930+0000","last_clean":"2024-09-10T04:54:01.996930+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:54:01.996930+0000","last_undegraded":"2024-09-10T04:54:01.996930+0000","last_fullsized":"2024-09-10T04:54:01.996930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.996835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:25.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'92","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.637003+0000","last_change":"2024-09-10T04:50:14.838218+0000","last_active":"2024-09-10T04:53:24.637003+0000","last_peered":"2024-09-10T04:53:24.637003+0000","last_clean":"2024-09-10T04:53:24.637003+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:53:24.637003+0000","last_undegraded":"2024-09-10T04:53:24.637003+0000","last_fullsized":"2024-09-10T04:53:24.637003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:33.740083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881868+0000","last_change":"2024-09-10T04:50:16.844860+0000","last_active":"2024-09-10T04:50:48.881868+0000","last_peered":"2024-09-10T04:50:48.881868+0000","last_clean":"2024-09-10T04:50:48.881868+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:50:48.881868+0000","last_undegraded":"2024-09-10T04:50:48.881868+0000","last_fullsized":"2024-09-10T04:50:48.881868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.073950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.983201+0000","last_change":"2024-09-10T04:50:18.861278+0000","last_active":"2024-09-10T04:53:17.983201+0000","last_peered":"2024-09-10T04:53:17.983201+0000","last_clean":"2024-09-10T04:53:17.983201+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:53:17.983201+0000","last_undegraded":"2024-09-10T04:53:17.983201+0000","last_fullsized":"2024-09-10T04:53:17.983201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:07.078771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.221557+0000","last_change":"2024-09-10T04:53:52.221557+0000","last_active":"2024-09-10T04:53:52.221557+0000","last_peered":"2024-09-10T04:53:52.221557+0000","last_clean":"2024-09-10T04:53:52.221557+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:53:52.221557+0000","last_undegraded":"2024-09-10T04:53:52.221557+0000","last_fullsized":"2024-09-10T04:53:52.221557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.221463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:15.853804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:27.781682+0000","last_change":"2024-09-10T04:53:27.781601+0000","last_active":"2024-09-10T04:53:27.781682+0000","last_peered":"2024-09-10T04:53:27.781682+0000","last_clean":"2024-09-10T04:53:27.781682+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:53:27.781682+0000","last_undegraded":"2024-09-10T04:53:27.781682+0000","last_fullsized":"2024-09-10T04:53:27.781682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_clean_scrub_stamp":"2024-09-10T04:53:27.781512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:07.001654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.064620+0000","last_change":"2024-09-10T04:53:31.064620+0000","last_active":"2024-09-10T04:53:31.064620+0000","last_peered":"2024-09-10T04:53:31.064620+0000","last_clean":"2024-09-10T04:53:31.064620+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:31.064620+0000","last_undegraded":"2024-09-10T04:53:31.064620+0000","last_fullsized":"2024-09-10T04:53:31.064620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.064527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:59.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.636690+0000","last_change":"2024-09-10T04:54:07.636690+0000","last_active":"2024-09-10T04:54:07.636690+0000","last_peered":"2024-09-10T04:54:07.636690+0000","last_clean":"2024-09-10T04:54:07.636690+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:54:07.636690+0000","last_undegraded":"2024-09-10T04:54:07.636690+0000","last_fullsized":"2024-09-10T04:54:07.636690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.636608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:01.188346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":513,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.634960+0000","last_change":"2024-09-10T04:50:14.842692+0000","last_active":"2024-09-10T04:53:24.634960+0000","last_peered":"2024-09-10T04:53:24.634960+0000","last_clean":"2024-09-10T04:53:24.634960+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:53:24.634960+0000","last_undegraded":"2024-09-10T04:53:24.634960+0000","last_fullsized":"2024-09-10T04:53:24.634960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:21.759860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881314+0000","last_change":"2024-09-10T04:50:16.857466+0000","last_active":"2024-09-10T04:50:48.881314+0000","last_peered":"2024-09-10T04:50:48.881314+0000","last_clean":"2024-09-10T04:50:48.881314+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:50:48.881314+0000","last_undegraded":"2024-09-10T04:50:48.881314+0000","last_fullsized":"2024-09-10T04:50:48.881314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:04.506517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.694956+0000","last_change":"2024-09-10T04:50:18.856885+0000","last_active":"2024-09-10T04:53:17.694956+0000","last_peered":"2024-09-10T04:53:17.694956+0000","last_clean":"2024-09-10T04:53:17.694956+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:53:17.694956+0000","last_undegraded":"2024-09-10T04:53:17.694956+0000","last_fullsized":"2024-09-10T04:53:17.694956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:33.223690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.984615+0000","last_change":"2024-09-10T04:53:45.984615+0000","last_active":"2024-09-10T04:53:45.984615+0000","last_peered":"2024-09-10T04:53:45.984615+0000","last_clean":"2024-09-10T04:53:45.984615+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:45.984615+0000","last_undegraded":"2024-09-10T04:53:45.984615+0000","last_fullsized":"2024-09-10T04:53:45.984615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.984537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:29.250023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.495317+0000","last_change":"2024-09-10T04:53:28.495317+0000","last_active":"2024-09-10T04:53:28.495317+0000","last_peered":"2024-09-10T04:53:28.495317+0000","last_clean":"2024-09-10T04:53:28.495317+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:53:28.495317+0000","last_undegraded":"2024-09-10T04:53:28.495317+0000","last_fullsized":"2024-09-10T04:53:28.495317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.495201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:10.015044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.088894+0000","last_change":"2024-09-10T04:53:32.088819+0000","last_active":"2024-09-10T04:53:32.088894+0000","last_peered":"2024-09-10T04:53:32.088894+0000","last_clean":"2024-09-10T04:53:32.088894+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:53:32.088894+0000","last_undegraded":"2024-09-10T04:53:32.088894+0000","last_fullsized":"2024-09-10T04:53:32.088894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.088738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:21.007330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.323181+0000","last_change":"2024-09-10T04:53:55.323181+0000","last_active":"2024-09-10T04:53:55.323181+0000","last_peered":"2024-09-10T04:53:55.323181+0000","last_clean":"2024-09-10T04:53:55.323181+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:53:55.323181+0000","last_undegraded":"2024-09-10T04:53:55.323181+0000","last_fullsized":"2024-09-10T04:53:55.323181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.323104+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.158382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.221369+0000","last_change":"2024-09-10T04:54:01.221369+0000","last_active":"2024-09-10T04:54:01.221369+0000","last_peered":"2024-09-10T04:54:01.221369+0000","last_clean":"2024-09-10T04:54:01.221369+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:54:01.221369+0000","last_undegraded":"2024-09-10T04:54:01.221369+0000","last_fullsized":"2024-09-10T04:54:01.221369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.221267+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:02.683817+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877309+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:50:48.877309+0000","last_peered":"2024-09-10T04:50:48.877309+0000","last_clean":"2024-09-10T04:50:48.877309+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:50:48.877309+0000","last_undegraded":"2024-09-10T04:50:48.877309+0000","last_fullsized":"2024-09-10T04:50:48.877309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:44.854891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.992890+0000","last_change":"2024-09-10T04:53:44.992890+0000","last_active":"2024-09-10T04:53:44.992890+0000","last_peered":"2024-09-10T04:53:44.992890+0000","last_clean":"2024-09-10T04:53:44.992890+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:44.992890+0000","last_undegraded":"2024-09-10T04:53:44.992890+0000","last_fullsized":"2024-09-10T04:53:44.992890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.992795+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:39.339709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.729827+0000","last_change":"2024-09-10T04:53:31.729827+0000","last_active":"2024-09-10T04:53:31.729827+0000","last_peered":"2024-09-10T04:53:31.729827+0000","last_clean":"2024-09-10T04:53:31.729827+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:53:31.729827+0000","last_undegraded":"2024-09-10T04:53:31.729827+0000","last_fullsized":"2024-09-10T04:53:31.729827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.729700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:08.937521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.700634+0000","last_change":"2024-09-10T04:53:32.700634+0000","last_active":"2024-09-10T04:53:32.700634+0000","last_peered":"2024-09-10T04:53:32.700634+0000","last_clean":"2024-09-10T04:53:32.700634+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:53:32.700634+0000","last_undegraded":"2024-09-10T04:53:32.700634+0000","last_fullsized":"2024-09-10T04:53:32.700634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.700535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:14.164930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.966484+0000","last_change":"2024-09-10T04:54:02.966484+0000","last_active":"2024-09-10T04:54:02.966484+0000","last_peered":"2024-09-10T04:54:02.966484+0000","last_clean":"2024-09-10T04:54:02.966484+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:54:02.966484+0000","last_undegraded":"2024-09-10T04:54:02.966484+0000","last_fullsized":"2024-09-10T04:54:02.966484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.966403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:09:41.433049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.311101+0000","last_change":"2024-09-10T04:50:14.837995+0000","last_active":"2024-09-10T04:53:17.311101+0000","last_peered":"2024-09-10T04:53:17.311101+0000","last_clean":"2024-09-10T04:53:17.311101+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:53:17.311101+0000","last_undegraded":"2024-09-10T04:53:17.311101+0000","last_fullsized":"2024-09-10T04:53:17.311101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:29.222495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.882677+0000","last_change":"2024-09-10T04:50:16.856810+0000","last_active":"2024-09-10T04:50:48.882677+0000","last_peered":"2024-09-10T04:50:48.882677+0000","last_clean":"2024-09-10T04:50:48.882677+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:50:48.882677+0000","last_undegraded":"2024-09-10T04:50:48.882677+0000","last_fullsized":"2024-09-10T04:50:48.882677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:15.514143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.950445+0000","last_change":"2024-09-10T04:50:18.863401+0000","last_active":"2024-09-10T04:53:17.950445+0000","last_peered":"2024-09-10T04:53:17.950445+0000","last_clean":"2024-09-10T04:53:17.950445+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:53:17.950445+0000","last_undegraded":"2024-09-10T04:53:17.950445+0000","last_fullsized":"2024-09-10T04:53:17.950445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:37.758757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.983700+0000","last_change":"2024-09-10T04:53:43.983700+0000","last_active":"2024-09-10T04:53:43.983700+0000","last_peered":"2024-09-10T04:53:43.983700+0000","last_clean":"2024-09-10T04:53:43.983700+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:53:43.983700+0000","last_undegraded":"2024-09-10T04:53:43.983700+0000","last_fullsized":"2024-09-10T04:53:43.983700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.983610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:36.479094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.659260+0000","last_change":"2024-09-10T04:53:35.659260+0000","last_active":"2024-09-10T04:53:35.659260+0000","last_peered":"2024-09-10T04:53:35.659260+0000","last_clean":"2024-09-10T04:53:35.659260+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:53:35.659260+0000","last_undegraded":"2024-09-10T04:53:35.659260+0000","last_fullsized":"2024-09-10T04:53:35.659260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.659161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:32.447113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.041761+0000","last_change":"2024-09-10T04:53:30.041761+0000","last_active":"2024-09-10T04:53:30.041761+0000","last_peered":"2024-09-10T04:53:30.041761+0000","last_clean":"2024-09-10T04:53:30.041761+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:53:30.041761+0000","last_undegraded":"2024-09-10T04:53:30.041761+0000","last_fullsized":"2024-09-10T04:53:30.041761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.041666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:16.050227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.325503+0000","last_change":"2024-09-10T04:53:54.325503+0000","last_active":"2024-09-10T04:53:54.325503+0000","last_peered":"2024-09-10T04:53:54.325503+0000","last_clean":"2024-09-10T04:53:54.325503+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:53:54.325503+0000","last_undegraded":"2024-09-10T04:53:54.325503+0000","last_fullsized":"2024-09-10T04:53:54.325503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.325397+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:39.140425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'80","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.601128+0000","last_change":"2024-09-10T04:50:14.845298+0000","last_active":"2024-09-10T04:53:24.601128+0000","last_peered":"2024-09-10T04:53:24.601128+0000","last_clean":"2024-09-10T04:53:24.601128+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:53:24.601128+0000","last_undegraded":"2024-09-10T04:53:24.601128+0000","last_fullsized":"2024-09-10T04:53:24.601128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:45.261183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874414+0000","last_change":"2024-09-10T04:50:16.843360+0000","last_active":"2024-09-10T04:50:48.874414+0000","last_peered":"2024-09-10T04:50:48.874414+0000","last_clean":"2024-09-10T04:50:48.874414+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:50:48.874414+0000","last_undegraded":"2024-09-10T04:50:48.874414+0000","last_fullsized":"2024-09-10T04:50:48.874414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:51.695467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.235893+0000","last_change":"2024-09-10T04:50:18.852581+0000","last_active":"2024-09-10T04:52:17.235893+0000","last_peered":"2024-09-10T04:52:17.235893+0000","last_clean":"2024-09-10T04:52:17.235893+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:52:17.235893+0000","last_undegraded":"2024-09-10T04:52:17.235893+0000","last_fullsized":"2024-09-10T04:52:17.235893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:04.327060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.346585+0000","last_change":"2024-09-10T04:53:39.346585+0000","last_active":"2024-09-10T04:53:39.346585+0000","last_peered":"2024-09-10T04:53:39.346585+0000","last_clean":"2024-09-10T04:53:39.346585+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:53:39.346585+0000","last_undegraded":"2024-09-10T04:53:39.346585+0000","last_fullsized":"2024-09-10T04:53:39.346585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.346475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:40.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.040101+0000","last_change":"2024-09-10T04:53:33.040101+0000","last_active":"2024-09-10T04:53:33.040101+0000","last_peered":"2024-09-10T04:53:33.040101+0000","last_clean":"2024-09-10T04:53:33.040101+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:53:33.040101+0000","last_undegraded":"2024-09-10T04:53:33.040101+0000","last_fullsized":"2024-09-10T04:53:33.040101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.040007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:13.761147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.707464+0000","last_change":"2024-09-10T04:53:29.707464+0000","last_active":"2024-09-10T04:53:29.707464+0000","last_peered":"2024-09-10T04:53:29.707464+0000","last_clean":"2024-09-10T04:53:29.707464+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:53:29.707464+0000","last_undegraded":"2024-09-10T04:53:29.707464+0000","last_fullsized":"2024-09-10T04:53:29.707464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.707394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:41.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874882+0000","last_change":"2024-09-10T04:50:12.829418+0000","last_active":"2024-09-10T04:50:48.874882+0000","last_peered":"2024-09-10T04:50:48.874882+0000","last_clean":"2024-09-10T04:50:48.874882+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:50:48.874882+0000","last_undegraded":"2024-09-10T04:50:48.874882+0000","last_fullsized":"2024-09-10T04:50:48.874882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:12.698380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873774+0000","last_change":"2024-09-10T04:50:14.844321+0000","last_active":"2024-09-10T04:50:48.873774+0000","last_peered":"2024-09-10T04:50:48.873774+0000","last_clean":"2024-09-10T04:50:48.873774+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:50:48.873774+0000","last_undegraded":"2024-09-10T04:50:48.873774+0000","last_fullsized":"2024-09-10T04:50:48.873774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:19.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":390,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.497726+0000","last_change":"2024-09-10T04:50:16.856093+0000","last_active":"2024-09-10T04:53:24.497726+0000","last_peered":"2024-09-10T04:53:24.497726+0000","last_clean":"2024-09-10T04:53:24.497726+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:53:24.497726+0000","last_undegraded":"2024-09-10T04:53:24.497726+0000","last_fullsized":"2024-09-10T04:53:24.497726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:27.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.239391+0000","last_change":"2024-09-10T04:53:51.239391+0000","last_active":"2024-09-10T04:53:51.239391+0000","last_peered":"2024-09-10T04:53:51.239391+0000","last_clean":"2024-09-10T04:53:51.239391+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:51.239391+0000","last_undegraded":"2024-09-10T04:53:51.239391+0000","last_fullsized":"2024-09-10T04:53:51.239391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.239300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.849486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.288641+0000","last_change":"2024-09-10T04:53:31.288641+0000","last_active":"2024-09-10T04:53:31.288641+0000","last_peered":"2024-09-10T04:53:31.288641+0000","last_clean":"2024-09-10T04:53:31.288641+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:53:31.288641+0000","last_undegraded":"2024-09-10T04:53:31.288641+0000","last_fullsized":"2024-09-10T04:53:31.288641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.288558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:03.075476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.028196+0000","last_change":"2024-09-10T04:53:28.028196+0000","last_active":"2024-09-10T04:53:28.028196+0000","last_peered":"2024-09-10T04:53:28.028196+0000","last_clean":"2024-09-10T04:53:28.028196+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:53:28.028196+0000","last_undegraded":"2024-09-10T04:53:28.028196+0000","last_fullsized":"2024-09-10T04:53:28.028196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.028080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:07.938226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.676385+0000","last_change":"2024-09-10T04:54:06.676385+0000","last_active":"2024-09-10T04:54:06.676385+0000","last_peered":"2024-09-10T04:54:06.676385+0000","last_clean":"2024-09-10T04:54:06.676385+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:54:06.676385+0000","last_undegraded":"2024-09-10T04:54:06.676385+0000","last_fullsized":"2024-09-10T04:54:06.676385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.676303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:14.695269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879928+0000","last_change":"2024-09-10T04:50:14.835819+0000","last_active":"2024-09-10T04:50:48.879928+0000","last_peered":"2024-09-10T04:50:48.879928+0000","last_clean":"2024-09-10T04:50:48.879928+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:50:48.879928+0000","last_undegraded":"2024-09-10T04:50:48.879928+0000","last_fullsized":"2024-09-10T04:50:48.879928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:32.568077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":402,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.502251+0000","last_change":"2024-09-10T04:50:16.857438+0000","last_active":"2024-09-10T04:53:24.502251+0000","last_peered":"2024-09-10T04:53:24.502251+0000","last_clean":"2024-09-10T04:53:24.502251+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:53:24.502251+0000","last_undegraded":"2024-09-10T04:53:24.502251+0000","last_fullsized":"2024-09-10T04:53:24.502251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:03.828081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.367879+0000","last_change":"2024-09-10T04:53:36.367879+0000","last_active":"2024-09-10T04:53:36.367879+0000","last_peered":"2024-09-10T04:53:36.367879+0000","last_clean":"2024-09-10T04:53:36.367879+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:53:36.367879+0000","last_undegraded":"2024-09-10T04:53:36.367879+0000","last_fullsized":"2024-09-10T04:53:36.367879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.367750+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:06.024488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.090383+0000","last_change":"2024-09-10T04:53:34.090383+0000","last_active":"2024-09-10T04:53:34.090383+0000","last_peered":"2024-09-10T04:53:34.090383+0000","last_clean":"2024-09-10T04:53:34.090383+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:53:34.090383+0000","last_undegraded":"2024-09-10T04:53:34.090383+0000","last_fullsized":"2024-09-10T04:53:34.090383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.090296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:53.934110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.721726+0000","last_change":"2024-09-10T04:53:30.721726+0000","last_active":"2024-09-10T04:53:30.721726+0000","last_peered":"2024-09-10T04:53:30.721726+0000","last_clean":"2024-09-10T04:53:30.721726+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:53:30.721726+0000","last_undegraded":"2024-09-10T04:53:30.721726+0000","last_fullsized":"2024-09-10T04:53:30.721726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.721635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:26.199513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.319734+0000","last_change":"2024-09-10T04:54:04.319734+0000","last_active":"2024-09-10T04:54:04.319734+0000","last_peered":"2024-09-10T04:54:04.319734+0000","last_clean":"2024-09-10T04:54:04.319734+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:54:04.319734+0000","last_undegraded":"2024-09-10T04:54:04.319734+0000","last_fullsized":"2024-09-10T04:54:04.319734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.319651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:00.049390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'97","reported_seq":188,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.609690+0000","last_change":"2024-09-10T04:50:14.835603+0000","last_active":"2024-09-10T04:53:24.609690+0000","last_peered":"2024-09-10T04:53:24.609690+0000","last_clean":"2024-09-10T04:53:24.609690+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:53:24.609690+0000","last_undegraded":"2024-09-10T04:53:24.609690+0000","last_fullsized":"2024-09-10T04:53:24.609690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:35.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.879624+0000","last_change":"2024-09-10T04:50:16.856770+0000","last_active":"2024-09-10T04:50:48.879624+0000","last_peered":"2024-09-10T04:50:48.879624+0000","last_clean":"2024-09-10T04:50:48.879624+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:50:48.879624+0000","last_undegraded":"2024-09-10T04:50:48.879624+0000","last_fullsized":"2024-09-10T04:50:48.879624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:00.560809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:51.228978+0000","last_change":"2024-09-10T04:50:18.858327+0000","last_active":"2024-09-10T04:50:51.228978+0000","last_peered":"2024-09-10T04:50:51.228978+0000","last_clean":"2024-09-10T04:50:51.228978+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:50:51.228978+0000","last_undegraded":"2024-09-10T04:50:51.228978+0000","last_fullsized":"2024-09-10T04:50:51.228978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:00.566974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.935773+0000","last_change":"2024-09-10T04:50:18.858790+0000","last_active":"2024-09-10T04:53:17.935773+0000","last_peered":"2024-09-10T04:53:17.935773+0000","last_clean":"2024-09-10T04:53:17.935773+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:53:17.935773+0000","last_undegraded":"2024-09-10T04:53:17.935773+0000","last_fullsized":"2024-09-10T04:53:17.935773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.081049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.327819+0000","last_change":"2024-09-10T04:53:44.327819+0000","last_active":"2024-09-10T04:53:44.327819+0000","last_peered":"2024-09-10T04:53:44.327819+0000","last_clean":"2024-09-10T04:53:44.327819+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:53:44.327819+0000","last_undegraded":"2024-09-10T04:53:44.327819+0000","last_fullsized":"2024-09-10T04:53:44.327819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.327731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:17.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.678937+0000","last_change":"2024-09-10T04:53:40.678937+0000","last_active":"2024-09-10T04:53:40.678937+0000","last_peered":"2024-09-10T04:53:40.678937+0000","last_clean":"2024-09-10T04:53:40.678937+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:53:40.678937+0000","last_undegraded":"2024-09-10T04:53:40.678937+0000","last_fullsized":"2024-09-10T04:53:40.678937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.678849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:37.929824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.973068+0000","last_change":"2024-09-10T04:54:05.973068+0000","last_active":"2024-09-10T04:54:05.973068+0000","last_peered":"2024-09-10T04:54:05.973068+0000","last_clean":"2024-09-10T04:54:05.973068+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:54:05.973068+0000","last_undegraded":"2024-09-10T04:54:05.973068+0000","last_fullsized":"2024-09-10T04:54:05.973068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.972984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:15.350827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.642995+0000","last_change":"2024-09-10T04:50:14.845987+0000","last_active":"2024-09-10T04:53:24.642995+0000","last_peered":"2024-09-10T04:53:24.642995+0000","last_clean":"2024-09-10T04:53:24.642995+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:53:24.642995+0000","last_undegraded":"2024-09-10T04:53:24.642995+0000","last_fullsized":"2024-09-10T04:53:24.642995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:46.465496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.539537+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:15.539537+0000","last_peered":"2024-09-10T04:52:15.539537+0000","last_clean":"2024-09-10T04:52:15.539537+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:15.539537+0000","last_undegraded":"2024-09-10T04:52:15.539537+0000","last_fullsized":"2024-09-10T04:52:15.539537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:12.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.931532+0000","last_change":"2024-09-10T04:53:49.931532+0000","last_active":"2024-09-10T04:53:49.931532+0000","last_peered":"2024-09-10T04:53:49.931532+0000","last_clean":"2024-09-10T04:53:49.931532+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:53:49.931532+0000","last_undegraded":"2024-09-10T04:53:49.931532+0000","last_fullsized":"2024-09-10T04:53:49.931532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.931431+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:29.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.418743+0000","last_change":"2024-09-10T04:53:32.418743+0000","last_active":"2024-09-10T04:53:32.418743+0000","last_peered":"2024-09-10T04:53:32.418743+0000","last_clean":"2024-09-10T04:53:32.418743+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:53:32.418743+0000","last_undegraded":"2024-09-10T04:53:32.418743+0000","last_fullsized":"2024-09-10T04:53:32.418743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.418643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:14.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880553+0000","last_change":"2024-09-10T04:50:12.832674+0000","last_active":"2024-09-10T04:50:48.880553+0000","last_peered":"2024-09-10T04:50:48.880553+0000","last_clean":"2024-09-10T04:50:48.880553+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:50:48.880553+0000","last_undegraded":"2024-09-10T04:50:48.880553+0000","last_fullsized":"2024-09-10T04:50:48.880553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:41.054720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.314978+0000","last_change":"2024-09-10T04:50:14.846310+0000","last_active":"2024-09-10T04:53:17.314978+0000","last_peered":"2024-09-10T04:53:17.314978+0000","last_clean":"2024-09-10T04:53:17.314978+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:53:17.314978+0000","last_undegraded":"2024-09-10T04:53:17.314978+0000","last_fullsized":"2024-09-10T04:53:17.314978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:21.864995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.281435+0000","last_change":"2024-09-10T04:54:07.281435+0000","last_active":"2024-09-10T04:54:07.281435+0000","last_peered":"2024-09-10T04:54:07.281435+0000","last_clean":"2024-09-10T04:54:07.281435+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:54:07.281435+0000","last_undegraded":"2024-09-10T04:54:07.281435+0000","last_fullsized":"2024-09-10T04:54:07.281435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.281348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:08.478561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.259529+0000","last_change":"2024-09-10T04:53:54.259529+0000","last_active":"2024-09-10T04:53:54.259529+0000","last_peered":"2024-09-10T04:53:54.259529+0000","last_clean":"2024-09-10T04:53:54.259529+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:53:54.259529+0000","last_undegraded":"2024-09-10T04:53:54.259529+0000","last_fullsized":"2024-09-10T04:53:54.259529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.259447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:58:47.873888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.663976+0000","last_change":"2024-09-10T04:53:42.663976+0000","last_active":"2024-09-10T04:53:42.663976+0000","last_peered":"2024-09-10T04:53:42.663976+0000","last_clean":"2024-09-10T04:53:42.663976+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:53:42.663976+0000","last_undegraded":"2024-09-10T04:53:42.663976+0000","last_fullsized":"2024-09-10T04:53:42.663976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.663888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.429104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874339+0000","last_change":"2024-09-10T04:50:12.828880+0000","last_active":"2024-09-10T04:50:48.874339+0000","last_peered":"2024-09-10T04:50:48.874339+0000","last_clean":"2024-09-10T04:50:48.874339+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:50:48.874339+0000","last_undegraded":"2024-09-10T04:50:48.874339+0000","last_fullsized":"2024-09-10T04:50:48.874339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:06.998057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.595003+0000","last_change":"2024-09-10T04:50:14.843837+0000","last_active":"2024-09-10T04:53:24.595003+0000","last_peered":"2024-09-10T04:53:24.595003+0000","last_clean":"2024-09-10T04:53:24.595003+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:53:24.595003+0000","last_undegraded":"2024-09-10T04:53:24.595003+0000","last_fullsized":"2024-09-10T04:53:24.595003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:45.419570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.873739+0000","last_change":"2024-09-10T04:50:16.849467+0000","last_active":"2024-09-10T04:50:48.873739+0000","last_peered":"2024-09-10T04:50:48.873739+0000","last_clean":"2024-09-10T04:50:48.873739+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:50:48.873739+0000","last_undegraded":"2024-09-10T04:50:48.873739+0000","last_fullsized":"2024-09-10T04:50:48.873739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:45.137961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.253060+0000","last_change":"2024-09-10T04:53:53.253060+0000","last_active":"2024-09-10T04:53:53.253060+0000","last_peered":"2024-09-10T04:53:53.253060+0000","last_clean":"2024-09-10T04:53:53.253060+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:53.253060+0000","last_undegraded":"2024-09-10T04:53:53.253060+0000","last_fullsized":"2024-09-10T04:53:53.253060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.252977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:43.553993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.053335+0000","last_change":"2024-09-10T04:53:35.053335+0000","last_active":"2024-09-10T04:53:35.053335+0000","last_peered":"2024-09-10T04:53:35.053335+0000","last_clean":"2024-09-10T04:53:35.053335+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:35.053335+0000","last_undegraded":"2024-09-10T04:53:35.053335+0000","last_fullsized":"2024-09-10T04:53:35.053335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.053227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:06:46.229845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878292+0000","last_change":"2024-09-10T04:50:12.831113+0000","last_active":"2024-09-10T04:50:48.878292+0000","last_peered":"2024-09-10T04:50:48.878292+0000","last_clean":"2024-09-10T04:50:48.878292+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:50:48.878292+0000","last_undegraded":"2024-09-10T04:50:48.878292+0000","last_fullsized":"2024-09-10T04:50:48.878292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:54.540644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.586161+0000","last_change":"2024-09-10T04:50:14.833429+0000","last_active":"2024-09-10T04:53:24.586161+0000","last_peered":"2024-09-10T04:53:24.586161+0000","last_clean":"2024-09-10T04:53:24.586161+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:53:24.586161+0000","last_undegraded":"2024-09-10T04:53:24.586161+0000","last_fullsized":"2024-09-10T04:53:24.586161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:59.442463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870844+0000","last_change":"2024-09-10T04:50:16.849932+0000","last_active":"2024-09-10T04:50:48.870844+0000","last_peered":"2024-09-10T04:50:48.870844+0000","last_clean":"2024-09-10T04:50:48.870844+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:50:48.870844+0000","last_undegraded":"2024-09-10T04:50:48.870844+0000","last_fullsized":"2024-09-10T04:50:48.870844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:52.361622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.682910+0000","last_change":"2024-09-10T04:53:54.682910+0000","last_active":"2024-09-10T04:53:54.682910+0000","last_peered":"2024-09-10T04:53:54.682910+0000","last_clean":"2024-09-10T04:53:54.682910+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:53:54.682910+0000","last_undegraded":"2024-09-10T04:53:54.682910+0000","last_fullsized":"2024-09-10T04:53:54.682910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.682823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.194837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.318043+0000","last_change":"2024-09-10T04:53:33.318043+0000","last_active":"2024-09-10T04:53:33.318043+0000","last_peered":"2024-09-10T04:53:33.318043+0000","last_clean":"2024-09-10T04:53:33.318043+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:53:33.318043+0000","last_undegraded":"2024-09-10T04:53:33.318043+0000","last_fullsized":"2024-09-10T04:53:33.318043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.317954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:35.852351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876127+0000","last_change":"2024-09-10T04:50:12.832974+0000","last_active":"2024-09-10T04:50:48.876127+0000","last_peered":"2024-09-10T04:50:48.876127+0000","last_clean":"2024-09-10T04:50:48.876127+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:50:48.876127+0000","last_undegraded":"2024-09-10T04:50:48.876127+0000","last_fullsized":"2024-09-10T04:50:48.876127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:37.908811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'68","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.583389+0000","last_change":"2024-09-10T04:50:14.842585+0000","last_active":"2024-09-10T04:53:24.583389+0000","last_peered":"2024-09-10T04:53:24.583389+0000","last_clean":"2024-09-10T04:53:24.583389+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:53:24.583389+0000","last_undegraded":"2024-09-10T04:53:24.583389+0000","last_fullsized":"2024-09-10T04:53:24.583389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.706035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":84,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.871290+0000","last_change":"2024-09-10T04:50:16.851450+0000","last_active":"2024-09-10T04:50:48.871290+0000","last_peered":"2024-09-10T04:50:48.871290+0000","last_clean":"2024-09-10T04:50:48.871290+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:50:48.871290+0000","last_undegraded":"2024-09-10T04:50:48.871290+0000","last_fullsized":"2024-09-10T04:50:48.871290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:58.819548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.940056+0000","last_change":"2024-09-10T04:53:50.940056+0000","last_active":"2024-09-10T04:53:50.940056+0000","last_peered":"2024-09-10T04:53:50.940056+0000","last_clean":"2024-09-10T04:53:50.940056+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:50.940056+0000","last_undegraded":"2024-09-10T04:53:50.940056+0000","last_fullsized":"2024-09-10T04:53:50.940056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.939961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:20.889446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.010426+0000","last_change":"2024-09-10T04:53:36.010426+0000","last_active":"2024-09-10T04:53:36.010426+0000","last_peered":"2024-09-10T04:53:36.010426+0000","last_clean":"2024-09-10T04:53:36.010426+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:53:36.010426+0000","last_undegraded":"2024-09-10T04:53:36.010426+0000","last_fullsized":"2024-09-10T04:53:36.010426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.010317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:47.997647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877444+0000","last_change":"2024-09-10T04:50:12.826523+0000","last_active":"2024-09-10T04:50:48.877444+0000","last_peered":"2024-09-10T04:50:48.877444+0000","last_clean":"2024-09-10T04:50:48.877444+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:50:48.877444+0000","last_undegraded":"2024-09-10T04:50:48.877444+0000","last_fullsized":"2024-09-10T04:50:48.877444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:19.752204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.589047+0000","last_change":"2024-09-10T04:50:14.833726+0000","last_active":"2024-09-10T04:53:24.589047+0000","last_peered":"2024-09-10T04:53:24.589047+0000","last_clean":"2024-09-10T04:53:24.589047+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:53:24.589047+0000","last_undegraded":"2024-09-10T04:53:24.589047+0000","last_fullsized":"2024-09-10T04:53:24.589047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:22:52.892722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876419+0000","last_change":"2024-09-10T04:50:16.856094+0000","last_active":"2024-09-10T04:50:48.876419+0000","last_peered":"2024-09-10T04:50:48.876419+0000","last_clean":"2024-09-10T04:50:48.876419+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:50:48.876419+0000","last_undegraded":"2024-09-10T04:50:48.876419+0000","last_fullsized":"2024-09-10T04:50:48.876419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:23.757466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.241125+0000","last_change":"2024-09-10T04:53:59.241125+0000","last_active":"2024-09-10T04:53:59.241125+0000","last_peered":"2024-09-10T04:53:59.241125+0000","last_clean":"2024-09-10T04:53:59.241125+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:53:59.241125+0000","last_undegraded":"2024-09-10T04:53:59.241125+0000","last_fullsized":"2024-09-10T04:53:59.241125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.241037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:07.535256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.710481+0000","last_change":"2024-09-10T04:53:48.710481+0000","last_active":"2024-09-10T04:53:48.710481+0000","last_peered":"2024-09-10T04:53:48.710481+0000","last_clean":"2024-09-10T04:53:48.710481+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:53:48.710481+0000","last_undegraded":"2024-09-10T04:53:48.710481+0000","last_fullsized":"2024-09-10T04:53:48.710481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.710387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:16.041423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876245+0000","last_change":"2024-09-10T04:50:12.825611+0000","last_active":"2024-09-10T04:50:48.876245+0000","last_peered":"2024-09-10T04:50:48.876245+0000","last_clean":"2024-09-10T04:50:48.876245+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:50:48.876245+0000","last_undegraded":"2024-09-10T04:50:48.876245+0000","last_fullsized":"2024-09-10T04:50:48.876245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:17.471349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.655072+0000","last_change":"2024-09-10T04:50:14.837042+0000","last_active":"2024-09-10T04:53:24.655072+0000","last_peered":"2024-09-10T04:53:24.655072+0000","last_clean":"2024-09-10T04:53:24.655072+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:53:24.655072+0000","last_undegraded":"2024-09-10T04:53:24.655072+0000","last_fullsized":"2024-09-10T04:53:24.655072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:10.688524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875976+0000","last_change":"2024-09-10T04:50:16.855082+0000","last_active":"2024-09-10T04:50:48.875976+0000","last_peered":"2024-09-10T04:50:48.875976+0000","last_clean":"2024-09-10T04:50:48.875976+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:50:48.875976+0000","last_undegraded":"2024-09-10T04:50:48.875976+0000","last_fullsized":"2024-09-10T04:50:48.875976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:28.657588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.340290+0000","last_change":"2024-09-10T04:53:46.340290+0000","last_active":"2024-09-10T04:53:46.340290+0000","last_peered":"2024-09-10T04:53:46.340290+0000","last_clean":"2024-09-10T04:53:46.340290+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:46.340290+0000","last_undegraded":"2024-09-10T04:53:46.340290+0000","last_fullsized":"2024-09-10T04:53:46.340290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.340190+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:49.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.375559+0000","last_change":"2024-09-10T04:53:37.375559+0000","last_active":"2024-09-10T04:53:37.375559+0000","last_peered":"2024-09-10T04:53:37.375559+0000","last_clean":"2024-09-10T04:53:37.375559+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:53:37.375559+0000","last_undegraded":"2024-09-10T04:53:37.375559+0000","last_fullsized":"2024-09-10T04:53:37.375559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.375475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:54.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877452+0000","last_change":"2024-09-10T04:50:12.830148+0000","last_active":"2024-09-10T04:50:48.877452+0000","last_peered":"2024-09-10T04:50:48.877452+0000","last_clean":"2024-09-10T04:50:48.877452+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:50:48.877452+0000","last_undegraded":"2024-09-10T04:50:48.877452+0000","last_fullsized":"2024-09-10T04:50:48.877452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:25.232608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881057+0000","last_change":"2024-09-10T04:50:14.838109+0000","last_active":"2024-09-10T04:50:48.881057+0000","last_peered":"2024-09-10T04:50:48.881057+0000","last_clean":"2024-09-10T04:50:48.881057+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:50:48.881057+0000","last_undegraded":"2024-09-10T04:50:48.881057+0000","last_fullsized":"2024-09-10T04:50:48.881057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:49.594075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":376,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.496406+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:24.496406+0000","last_peered":"2024-09-10T04:53:24.496406+0000","last_clean":"2024-09-10T04:53:24.496406+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:24.496406+0000","last_undegraded":"2024-09-10T04:53:24.496406+0000","last_fullsized":"2024-09-10T04:53:24.496406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:33:38.667884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.310068+0000","last_change":"2024-09-10T04:53:45.310068+0000","last_active":"2024-09-10T04:53:45.310068+0000","last_peered":"2024-09-10T04:53:45.310068+0000","last_clean":"2024-09-10T04:53:45.310068+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:53:45.310068+0000","last_undegraded":"2024-09-10T04:53:45.310068+0000","last_fullsized":"2024-09-10T04:53:45.310068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.309974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.962640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.966331+0000","last_change":"2024-09-10T04:53:36.966331+0000","last_active":"2024-09-10T04:53:36.966331+0000","last_peered":"2024-09-10T04:53:36.966331+0000","last_clean":"2024-09-10T04:53:36.966331+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:53:36.966331+0000","last_undegraded":"2024-09-10T04:53:36.966331+0000","last_fullsized":"2024-09-10T04:53:36.966331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.966245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.697203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.975729+0000","last_change":"2024-09-10T04:54:07.975729+0000","last_active":"2024-09-10T04:54:07.975729+0000","last_peered":"2024-09-10T04:54:07.975729+0000","last_clean":"2024-09-10T04:54:07.975729+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:54:07.975729+0000","last_undegraded":"2024-09-10T04:54:07.975729+0000","last_fullsized":"2024-09-10T04:54:07.975729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.975638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:37.274445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.562035+0000","last_change":"2024-09-10T04:50:14.844486+0000","last_active":"2024-09-10T04:53:24.562035+0000","last_peered":"2024-09-10T04:53:24.562035+0000","last_clean":"2024-09-10T04:53:24.562035+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:53:24.562035+0000","last_undegraded":"2024-09-10T04:53:24.562035+0000","last_fullsized":"2024-09-10T04:53:24.562035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:52.621118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.695353+0000","last_change":"2024-09-10T04:53:55.695353+0000","last_active":"2024-09-10T04:53:55.695353+0000","last_peered":"2024-09-10T04:53:55.695353+0000","last_clean":"2024-09-10T04:53:55.695353+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:55.695353+0000","last_undegraded":"2024-09-10T04:53:55.695353+0000","last_fullsized":"2024-09-10T04:53:55.695353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.695256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:02.342950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.701876+0000","last_change":"2024-09-10T04:53:43.701876+0000","last_active":"2024-09-10T04:53:43.701876+0000","last_peered":"2024-09-10T04:53:43.701876+0000","last_clean":"2024-09-10T04:53:43.701876+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:53:43.701876+0000","last_undegraded":"2024-09-10T04:53:43.701876+0000","last_fullsized":"2024-09-10T04:53:43.701876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.701760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:03.638962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875277+0000","last_change":"2024-09-10T04:50:12.826453+0000","last_active":"2024-09-10T04:50:48.875277+0000","last_peered":"2024-09-10T04:50:48.875277+0000","last_clean":"2024-09-10T04:50:48.875277+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:50:48.875277+0000","last_undegraded":"2024-09-10T04:50:48.875277+0000","last_fullsized":"2024-09-10T04:50:48.875277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:11.809935+0000","last_clean_scrub_stamp":"2024-09-10T04:50:11.809935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:02.530843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.202766+0000","last_change":"2024-09-10T04:54:04.202766+0000","last_active":"2024-09-10T04:54:04.202766+0000","last_peered":"2024-09-10T04:54:04.202766+0000","last_clean":"2024-09-10T04:54:04.202766+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:54:04.202766+0000","last_undegraded":"2024-09-10T04:54:04.202766+0000","last_fullsized":"2024-09-10T04:54:04.202766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.202664+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:51.889203+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.284384+0000","last_change":"2024-09-10T04:54:00.284384+0000","last_active":"2024-09-10T04:54:00.284384+0000","last_peered":"2024-09-10T04:54:00.284384+0000","last_clean":"2024-09-10T04:54:00.284384+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:54:00.284384+0000","last_undegraded":"2024-09-10T04:54:00.284384+0000","last_fullsized":"2024-09-10T04:54:00.284384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.284291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.338885+0000","last_change":"2024-09-10T04:53:36.338818+0000","last_active":"2024-09-10T04:53:36.338885+0000","last_peered":"2024-09-10T04:53:36.338885+0000","last_clean":"2024-09-10T04:53:36.338885+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:53:36.338885+0000","last_undegraded":"2024-09-10T04:53:36.338885+0000","last_fullsized":"2024-09-10T04:53:36.338885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.338731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:42.753949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.956604+0000","last_change":"2024-09-10T04:54:06.956604+0000","last_active":"2024-09-10T04:54:06.956604+0000","last_peered":"2024-09-10T04:54:06.956604+0000","last_clean":"2024-09-10T04:54:06.956604+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:54:06.956604+0000","last_undegraded":"2024-09-10T04:54:06.956604+0000","last_fullsized":"2024-09-10T04:54:06.956604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.956506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:54.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'36","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.649016+0000","last_change":"2024-09-10T04:50:14.838449+0000","last_active":"2024-09-10T04:53:24.649016+0000","last_peered":"2024-09-10T04:53:24.649016+0000","last_clean":"2024-09-10T04:53:24.649016+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:53:24.649016+0000","last_undegraded":"2024-09-10T04:53:24.649016+0000","last_fullsized":"2024-09-10T04:53:24.649016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:12.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.326879+0000","last_change":"2024-09-10T04:53:43.326879+0000","last_active":"2024-09-10T04:53:43.326879+0000","last_peered":"2024-09-10T04:53:43.326879+0000","last_clean":"2024-09-10T04:53:43.326879+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:43.326879+0000","last_undegraded":"2024-09-10T04:53:43.326879+0000","last_fullsized":"2024-09-10T04:53:43.326879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.326755+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:11.173395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.936400+0000","last_change":"2024-09-10T04:53:37.936400+0000","last_active":"2024-09-10T04:53:37.936400+0000","last_peered":"2024-09-10T04:53:37.936400+0000","last_clean":"2024-09-10T04:53:37.936400+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:53:37.936400+0000","last_undegraded":"2024-09-10T04:53:37.936400+0000","last_fullsized":"2024-09-10T04:53:37.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.936312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:39.782085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.264435+0000","last_change":"2024-09-10T04:53:59.264435+0000","last_active":"2024-09-10T04:53:59.264435+0000","last_peered":"2024-09-10T04:53:59.264435+0000","last_clean":"2024-09-10T04:53:59.264435+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:53:59.264435+0000","last_undegraded":"2024-09-10T04:53:59.264435+0000","last_fullsized":"2024-09-10T04:53:59.264435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.264356+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:40.322391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.547057+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:24.547057+0000","last_peered":"2024-09-10T04:53:24.547057+0000","last_clean":"2024-09-10T04:53:24.547057+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:24.547057+0000","last_undegraded":"2024-09-10T04:53:24.547057+0000","last_fullsized":"2024-09-10T04:53:24.547057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.870764+0000","last_change":"2024-09-10T04:50:16.854555+0000","last_active":"2024-09-10T04:50:48.870764+0000","last_peered":"2024-09-10T04:50:48.870764+0000","last_clean":"2024-09-10T04:50:48.870764+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:50:48.870764+0000","last_undegraded":"2024-09-10T04:50:48.870764+0000","last_fullsized":"2024-09-10T04:50:48.870764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:55.949957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.999128+0000","last_change":"2024-09-10T04:53:54.999128+0000","last_active":"2024-09-10T04:53:54.999128+0000","last_peered":"2024-09-10T04:53:54.999128+0000","last_clean":"2024-09-10T04:53:54.999128+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:53:54.999128+0000","last_undegraded":"2024-09-10T04:53:54.999128+0000","last_fullsized":"2024-09-10T04:53:54.999128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.999005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.463400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.409733+0000","last_change":"2024-09-10T04:53:33.409733+0000","last_active":"2024-09-10T04:53:33.409733+0000","last_peered":"2024-09-10T04:53:33.409733+0000","last_clean":"2024-09-10T04:53:33.409733+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:53:33.409733+0000","last_undegraded":"2024-09-10T04:53:33.409733+0000","last_fullsized":"2024-09-10T04:53:33.409733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.409644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:22.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.013389+0000","last_change":"2024-09-10T04:53:54.013389+0000","last_active":"2024-09-10T04:53:54.013389+0000","last_peered":"2024-09-10T04:53:54.013389+0000","last_clean":"2024-09-10T04:53:54.013389+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:53:54.013389+0000","last_undegraded":"2024-09-10T04:53:54.013389+0000","last_fullsized":"2024-09-10T04:53:54.013389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.013284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:19.182546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.459612+0000","last_change":"2024-09-10T04:53:29.459612+0000","last_active":"2024-09-10T04:53:29.459612+0000","last_peered":"2024-09-10T04:53:29.459612+0000","last_clean":"2024-09-10T04:53:29.459612+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:53:29.459612+0000","last_undegraded":"2024-09-10T04:53:29.459612+0000","last_fullsized":"2024-09-10T04:53:29.459612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.459526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.879419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.658574+0000","last_change":"2024-09-10T04:54:03.658574+0000","last_active":"2024-09-10T04:54:03.658574+0000","last_peered":"2024-09-10T04:54:03.658574+0000","last_clean":"2024-09-10T04:54:03.658574+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:54:03.658574+0000","last_undegraded":"2024-09-10T04:54:03.658574+0000","last_fullsized":"2024-09-10T04:54:03.658574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.658476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:36.820167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.374381+0000","last_change":"2024-09-10T04:53:40.374381+0000","last_active":"2024-09-10T04:53:40.374381+0000","last_peered":"2024-09-10T04:53:40.374381+0000","last_clean":"2024-09-10T04:53:40.374381+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:53:40.374381+0000","last_undegraded":"2024-09-10T04:53:40.374381+0000","last_fullsized":"2024-09-10T04:53:40.374381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.374287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:13:03.190933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.019068+0000","last_change":"2024-09-10T04:53:53.019068+0000","last_active":"2024-09-10T04:53:53.019068+0000","last_peered":"2024-09-10T04:53:53.019068+0000","last_clean":"2024-09-10T04:53:53.019068+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:53:53.019068+0000","last_undegraded":"2024-09-10T04:53:53.019068+0000","last_fullsized":"2024-09-10T04:53:53.019068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.018985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:48.496863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.460543+0000","last_change":"2024-09-10T04:53:31.460543+0000","last_active":"2024-09-10T04:53:31.460543+0000","last_peered":"2024-09-10T04:53:31.460543+0000","last_clean":"2024-09-10T04:53:31.460543+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:31.460543+0000","last_undegraded":"2024-09-10T04:53:31.460543+0000","last_fullsized":"2024-09-10T04:53:31.460543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.460459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.855491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.356550+0000","last_change":"2024-09-10T04:54:02.356550+0000","last_active":"2024-09-10T04:54:02.356550+0000","last_peered":"2024-09-10T04:54:02.356550+0000","last_clean":"2024-09-10T04:54:02.356550+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:54:02.356550+0000","last_undegraded":"2024-09-10T04:54:02.356550+0000","last_fullsized":"2024-09-10T04:54:02.356550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.356435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:14.828280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.374822+0000","last_change":"2024-09-10T04:53:38.374822+0000","last_active":"2024-09-10T04:53:38.374822+0000","last_peered":"2024-09-10T04:53:38.374822+0000","last_clean":"2024-09-10T04:53:38.374822+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:53:38.374822+0000","last_undegraded":"2024-09-10T04:53:38.374822+0000","last_fullsized":"2024-09-10T04:53:38.374822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.374741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:27.594977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.971940+0000","last_change":"2024-09-10T04:53:51.971940+0000","last_active":"2024-09-10T04:53:51.971940+0000","last_peered":"2024-09-10T04:53:51.971940+0000","last_clean":"2024-09-10T04:53:51.971940+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:53:51.971940+0000","last_undegraded":"2024-09-10T04:53:51.971940+0000","last_fullsized":"2024-09-10T04:53:51.971940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.971848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:03.492899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.929329+0000","last_change":"2024-09-10T04:53:38.929329+0000","last_active":"2024-09-10T04:53:38.929329+0000","last_peered":"2024-09-10T04:53:38.929329+0000","last_clean":"2024-09-10T04:53:38.929329+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:38.929329+0000","last_undegraded":"2024-09-10T04:53:38.929329+0000","last_fullsized":"2024-09-10T04:53:38.929329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.929243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.588007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.313283+0000","last_change":"2024-09-10T04:54:01.313283+0000","last_active":"2024-09-10T04:54:01.313283+0000","last_peered":"2024-09-10T04:54:01.313283+0000","last_clean":"2024-09-10T04:54:01.313283+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:54:01.313283+0000","last_undegraded":"2024-09-10T04:54:01.313283+0000","last_fullsized":"2024-09-10T04:54:01.313283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.313200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:26.308298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.391611+0000","last_change":"2024-09-10T04:53:34.391611+0000","last_active":"2024-09-10T04:53:34.391611+0000","last_peered":"2024-09-10T04:53:34.391611+0000","last_clean":"2024-09-10T04:53:34.391611+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:53:34.391611+0000","last_undegraded":"2024-09-10T04:53:34.391611+0000","last_fullsized":"2024-09-10T04:53:34.391611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.391516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:34.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.647991+0000","last_change":"2024-09-10T04:53:56.647991+0000","last_active":"2024-09-10T04:53:56.647991+0000","last_peered":"2024-09-10T04:53:56.647991+0000","last_clean":"2024-09-10T04:53:56.647991+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:56.647991+0000","last_undegraded":"2024-09-10T04:53:56.647991+0000","last_fullsized":"2024-09-10T04:53:56.647991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.647894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.716571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.361951+0000","last_change":"2024-09-10T04:53:39.361951+0000","last_active":"2024-09-10T04:53:39.361951+0000","last_peered":"2024-09-10T04:53:39.361951+0000","last_clean":"2024-09-10T04:53:39.361951+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:39.361951+0000","last_undegraded":"2024-09-10T04:53:39.361951+0000","last_fullsized":"2024-09-10T04:53:39.361951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.361846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:31.211856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.967302+0000","last_change":"2024-09-10T04:53:55.967302+0000","last_active":"2024-09-10T04:53:55.967302+0000","last_peered":"2024-09-10T04:53:55.967302+0000","last_clean":"2024-09-10T04:53:55.967302+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:55.967302+0000","last_undegraded":"2024-09-10T04:53:55.967302+0000","last_fullsized":"2024-09-10T04:53:55.967302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.967182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:05.382797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.328369+0000","last_change":"2024-09-10T04:53:41.328369+0000","last_active":"2024-09-10T04:53:41.328369+0000","last_peered":"2024-09-10T04:53:41.328369+0000","last_clean":"2024-09-10T04:53:41.328369+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:53:41.328369+0000","last_undegraded":"2024-09-10T04:53:41.328369+0000","last_fullsized":"2024-09-10T04:53:41.328369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.328263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:49.638518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.293127+0000","last_change":"2024-09-10T04:54:05.293127+0000","last_active":"2024-09-10T04:54:05.293127+0000","last_peered":"2024-09-10T04:54:05.293127+0000","last_clean":"2024-09-10T04:54:05.293127+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:54:05.293127+0000","last_undegraded":"2024-09-10T04:54:05.293127+0000","last_fullsized":"2024-09-10T04:54:05.293127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.293042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:59.483409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.299822+0000","last_change":"2024-09-10T04:53:44.299822+0000","last_active":"2024-09-10T04:53:44.299822+0000","last_peered":"2024-09-10T04:53:44.299822+0000","last_clean":"2024-09-10T04:53:44.299822+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:53:44.299822+0000","last_undegraded":"2024-09-10T04:53:44.299822+0000","last_fullsized":"2024-09-10T04:53:44.299822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.299714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:38.816159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.276352+0000","last_change":"2024-09-10T04:53:48.276352+0000","last_active":"2024-09-10T04:53:48.276352+0000","last_peered":"2024-09-10T04:53:48.276352+0000","last_clean":"2024-09-10T04:53:48.276352+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:53:48.276352+0000","last_undegraded":"2024-09-10T04:53:48.276352+0000","last_fullsized":"2024-09-10T04:53:48.276352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.276257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:28.621401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.671909+0000","last_change":"2024-09-10T04:53:52.671909+0000","last_active":"2024-09-10T04:53:52.671909+0000","last_peered":"2024-09-10T04:53:52.671909+0000","last_clean":"2024-09-10T04:53:52.671909+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:53:52.671909+0000","last_undegraded":"2024-09-10T04:53:52.671909+0000","last_fullsized":"2024-09-10T04:53:52.671909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.671762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:37.070175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.954629+0000","last_change":"2024-09-10T04:53:56.954629+0000","last_active":"2024-09-10T04:53:56.954629+0000","last_peered":"2024-09-10T04:53:56.954629+0000","last_clean":"2024-09-10T04:53:56.954629+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:56.954629+0000","last_undegraded":"2024-09-10T04:53:56.954629+0000","last_fullsized":"2024-09-10T04:53:56.954629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.954538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:00.066290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.927198+0000","last_change":"2024-09-10T04:53:39.927198+0000","last_active":"2024-09-10T04:53:39.927198+0000","last_peered":"2024-09-10T04:53:39.927198+0000","last_clean":"2024-09-10T04:53:39.927198+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:53:39.927198+0000","last_undegraded":"2024-09-10T04:53:39.927198+0000","last_fullsized":"2024-09-10T04:53:39.927198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.927110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:58.183080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.702457+0000","last_change":"2024-09-10T04:53:58.702457+0000","last_active":"2024-09-10T04:53:58.702457+0000","last_peered":"2024-09-10T04:53:58.702457+0000","last_clean":"2024-09-10T04:53:58.702457+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:58.702457+0000","last_undegraded":"2024-09-10T04:53:58.702457+0000","last_fullsized":"2024-09-10T04:53:58.702457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.702328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:28.627810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.285400+0000","last_change":"2024-09-10T04:53:43.285400+0000","last_active":"2024-09-10T04:53:43.285400+0000","last_peered":"2024-09-10T04:53:43.285400+0000","last_clean":"2024-09-10T04:53:43.285400+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:53:43.285400+0000","last_undegraded":"2024-09-10T04:53:43.285400+0000","last_fullsized":"2024-09-10T04:53:43.285400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.285314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:24.124746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.937043+0000","last_change":"2024-09-10T04:53:57.937043+0000","last_active":"2024-09-10T04:53:57.937043+0000","last_peered":"2024-09-10T04:53:57.937043+0000","last_clean":"2024-09-10T04:53:57.937043+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:57.937043+0000","last_undegraded":"2024-09-10T04:53:57.937043+0000","last_fullsized":"2024-09-10T04:53:57.937043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.936960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:54.724913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.323633+0000","last_change":"2024-09-10T04:53:45.323633+0000","last_active":"2024-09-10T04:53:45.323633+0000","last_peered":"2024-09-10T04:53:45.323633+0000","last_clean":"2024-09-10T04:53:45.323633+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:53:45.323633+0000","last_undegraded":"2024-09-10T04:53:45.323633+0000","last_fullsized":"2024-09-10T04:53:45.323633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.323515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:03:20.165760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.312983+0000","last_change":"2024-09-10T04:54:03.312983+0000","last_active":"2024-09-10T04:54:03.312983+0000","last_peered":"2024-09-10T04:54:03.312983+0000","last_clean":"2024-09-10T04:54:03.312983+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:54:03.312983+0000","last_undegraded":"2024-09-10T04:54:03.312983+0000","last_fullsized":"2024-09-10T04:54:03.312983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.312896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:29.686339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.402809+0000","last_change":"2024-09-10T04:53:35.402809+0000","last_active":"2024-09-10T04:53:35.402809+0000","last_peered":"2024-09-10T04:53:35.402809+0000","last_clean":"2024-09-10T04:53:35.402809+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:53:35.402809+0000","last_undegraded":"2024-09-10T04:53:35.402809+0000","last_fullsized":"2024-09-10T04:53:35.402809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.402723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:03.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.682334+0000","last_change":"2024-09-10T04:53:57.682334+0000","last_active":"2024-09-10T04:53:57.682334+0000","last_peered":"2024-09-10T04:53:57.682334+0000","last_clean":"2024-09-10T04:53:57.682334+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:57.682334+0000","last_undegraded":"2024-09-10T04:53:57.682334+0000","last_fullsized":"2024-09-10T04:53:57.682334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.682253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:40.547619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.311732+0000","last_change":"2024-09-10T04:53:42.311732+0000","last_active":"2024-09-10T04:53:42.311732+0000","last_peered":"2024-09-10T04:53:42.311732+0000","last_clean":"2024-09-10T04:53:42.311732+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:53:42.311732+0000","last_undegraded":"2024-09-10T04:53:42.311732+0000","last_fullsized":"2024-09-10T04:53:42.311732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.311649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:45.625094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.725409+0000","last_change":"2024-09-10T04:53:44.725409+0000","last_active":"2024-09-10T04:53:44.725409+0000","last_peered":"2024-09-10T04:53:44.725409+0000","last_clean":"2024-09-10T04:53:44.725409+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:53:44.725409+0000","last_undegraded":"2024-09-10T04:53:44.725409+0000","last_fullsized":"2024-09-10T04:53:44.725409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.725321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:54.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.267391+0000","last_change":"2024-09-10T04:53:49.267391+0000","last_active":"2024-09-10T04:53:49.267391+0000","last_peered":"2024-09-10T04:53:49.267391+0000","last_clean":"2024-09-10T04:53:49.267391+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:49.267391+0000","last_undegraded":"2024-09-10T04:53:49.267391+0000","last_fullsized":"2024-09-10T04:53:49.267391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.267304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:59.269187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.954477+0000","last_change":"2024-09-10T04:53:40.954477+0000","last_active":"2024-09-10T04:53:40.954477+0000","last_peered":"2024-09-10T04:53:40.954477+0000","last_clean":"2024-09-10T04:53:40.954477+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:53:40.954477+0000","last_undegraded":"2024-09-10T04:53:40.954477+0000","last_fullsized":"2024-09-10T04:53:40.954477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.954395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:35.066147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.960016+0000","last_change":"2024-09-10T04:54:00.960016+0000","last_active":"2024-09-10T04:54:00.960016+0000","last_peered":"2024-09-10T04:54:00.960016+0000","last_clean":"2024-09-10T04:54:00.960016+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:54:00.960016+0000","last_undegraded":"2024-09-10T04:54:00.960016+0000","last_fullsized":"2024-09-10T04:54:00.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.959935+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:48.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1595,"ondisk_log_size":1595,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673015,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":740670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673014,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":742288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T04:50:09.799296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.841 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.842 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.843 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.843 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.843 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.843 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.843 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.844 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.845 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.846 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.847 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.848 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.849 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.850 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.851 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.852 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T04:50:11.809935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.853 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.854 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:09.855 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T04:54:29.855 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:54:29.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.965+0000 7fb1b78e4640 1 Processor -- start 2024-09-10T04:54:29.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b78e4640 1 -- start start 2024-09-10T04:54:29.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b78e4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1b012c070 0x7fb1b012c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:29.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b78e4640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b0116ab0 con 0x7fb1b0116320 2024-09-10T04:54:29.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b78e4640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b0073710 con 0x7fb1b012c070 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b5680640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb1b012c070 0x7fb1b012c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b4e7f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fb1b0116320 0x7fb1b012f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:34840/0 (socket says 172.21.15.98:34840) 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b4e7f640 1 -- 172.21.15.98:0/1860038897 learned_addr learned my addr 172.21.15.98:0/1860038897 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.966+0000 7fb1b5680640 1 -- 172.21.15.98:0/1860038897 >> v1:172.21.15.98:6789/0 conn(0x7fb1b0116320 legacy=0x7fb1b012f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1a3fff640 1 -- 172.21.15.98:0/1860038897 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277407032 0 0) 0x7fb1a4001110 con 0x7fb1b0116320 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1b5680640 1 -- 172.21.15.98:0/1860038897 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b0115d50 con 0x7fb1b012c070 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1b5680640 1 --2- 172.21.15.98:0/1860038897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b012c070 0x7fb1b012c450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009720 tx=0x7fb1ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6401468a8f78f25c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1a3fff640 1 -- 172.21.15.98:0/1860038897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac037070 con 0x7fb1b012c070 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1a3fff640 1 -- 172.21.15.98:0/1860038897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac02ad90 con 0x7fb1b012c070 2024-09-10T04:54:29.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.967+0000 7fb1a3fff640 1 -- 172.21.15.98:0/1860038897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac032590 con 0x7fb1b012c070 2024-09-10T04:54:29.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1860038897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b012c070 msgr2=0x7fb1b012c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1860038897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b012c070 0x7fb1b012c450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009720 tx=0x7fb1ac02a110 comp rx=0 tx=0).stop 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1860038897 shutdown_connections 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1860038897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b012c070 0x7fb1b012c450 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1860038897 >> 172.21.15.98:0/1860038897 conn(0x7fb1b006f300 msgr2=0x7fb1b0071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1860038897 shutdown_connections 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.968+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1860038897 wait complete. 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b78e4640 1 Processor -- start 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b78e4640 1 -- start start 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b78e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b78e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b012f8f0 con 0x7fb1b0116320 2024-09-10T04:54:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b5680640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b5680640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50798/0 (socket says 172.21.15.98:50798) 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.969+0000 7fb1b5680640 1 -- 172.21.15.98:0/1136764650 learned_addr learned my addr 172.21.15.98:0/1136764650 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1b5680640 1 -- 172.21.15.98:0/1136764650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b011d460 con 0x7fb1b0116320 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1b5680640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009840 tx=0x7fb1ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac041070 con 0x7fb1b0116320 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac03c460 con 0x7fb1b0116320 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac037040 con 0x7fb1b0116320 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b011be60 con 0x7fb1b0116320 2024-09-10T04:54:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.970+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b01c4a10 con 0x7fb1b0116320 2024-09-10T04:54:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.971+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb1ac044070 con 0x7fb1b0116320 2024-09-10T04:54:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.971+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b012fee0 con 0x7fb1b0116320 2024-09-10T04:54:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.971+0000 7fb1a1ffb640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 0x7fb194040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.971+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fb1ac0738a0 con 0x7fb1b0116320 2024-09-10T04:54:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.972+0000 7fb1b4e7f640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 0x7fb194040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:29.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.972+0000 7fb1b4e7f640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 0x7fb194040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4000c00 tx=0x7fb1a4001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:29.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:29.976+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb1ac03d3f0 con 0x7fb1b0116320 2024-09-10T04:54:30.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.151+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1b0129930 con 0x7fb19403de90 2024-09-10T04:54:30.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.162+0000 7fb1a1ffb640 1 -- 172.21.15.98:0/1136764650 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666275 (secure 0 0 0) 0x7fb1a40070d0 con 0x7fb19403de90 2024-09-10T04:54:30.170 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:54:30.175 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:54:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 msgr2=0x7fb194040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 0x7fb194040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4000c00 tx=0x7fb1a4001310 comp rx=0 tx=0).stop 2024-09-10T04:54:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 msgr2=0x7fb1b01c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009840 tx=0x7fb1ac0046c0 comp rx=0 tx=0).stop 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 shutdown_connections 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fb19403de90 0x7fb194040350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 --2- 172.21.15.98:0/1136764650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1b0116320 0x7fb1b01c42f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 >> 172.21.15.98:0/1136764650 conn(0x7fb1b006f300 msgr2=0x7fb1b01284c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 shutdown_connections 2024-09-10T04:54:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:30.167+0000 7fb1b78e4640 1 -- 172.21.15.98:0/1136764650 wait complete. 2024-09-10T04:54:30.179 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-10T04:54:29.274419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4992,"ondisk_log_size":4992,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1786524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":161736472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1743,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003820"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.698748+0000","last_change":"2024-09-10T04:53:49.698685+0000","last_active":"2024-09-10T04:53:49.698748+0000","last_peered":"2024-09-10T04:53:49.698748+0000","last_clean":"2024-09-10T04:53:49.698748+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:53:49.698748+0000","last_undegraded":"2024-09-10T04:53:49.698748+0000","last_fullsized":"2024-09-10T04:53:49.698748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.698611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:57.933974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.700485+0000","last_change":"2024-09-10T04:54:02.700485+0000","last_active":"2024-09-10T04:54:02.700485+0000","last_peered":"2024-09-10T04:54:02.700485+0000","last_clean":"2024-09-10T04:54:02.700485+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:54:02.700485+0000","last_undegraded":"2024-09-10T04:54:02.700485+0000","last_fullsized":"2024-09-10T04:54:02.700485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.700385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.433289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.001417+0000","last_change":"2024-09-10T04:53:43.001358+0000","last_active":"2024-09-10T04:53:43.001417+0000","last_peered":"2024-09-10T04:53:43.001417+0000","last_clean":"2024-09-10T04:53:43.001417+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:53:43.001417+0000","last_undegraded":"2024-09-10T04:53:43.001417+0000","last_fullsized":"2024-09-10T04:53:43.001417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.001271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:10.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.327201+0000","last_change":"2024-09-10T04:54:06.327201+0000","last_active":"2024-09-10T04:54:06.327201+0000","last_peered":"2024-09-10T04:54:06.327201+0000","last_clean":"2024-09-10T04:54:06.327201+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:54:06.327201+0000","last_undegraded":"2024-09-10T04:54:06.327201+0000","last_fullsized":"2024-09-10T04:54:06.327201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.327112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:25.832246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.279335+0000","last_change":"2024-09-10T04:53:50.279273+0000","last_active":"2024-09-10T04:53:50.279335+0000","last_peered":"2024-09-10T04:53:50.279335+0000","last_clean":"2024-09-10T04:53:50.279335+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:53:50.279335+0000","last_undegraded":"2024-09-10T04:53:50.279335+0000","last_fullsized":"2024-09-10T04:53:50.279335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.279186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:17.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.275840+0000","last_change":"2024-09-10T04:53:50.275840+0000","last_active":"2024-09-10T04:53:50.275840+0000","last_peered":"2024-09-10T04:53:50.275840+0000","last_clean":"2024-09-10T04:53:50.275840+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:53:50.275840+0000","last_undegraded":"2024-09-10T04:53:50.275840+0000","last_fullsized":"2024-09-10T04:53:50.275840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.275751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:45.236387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.350611+0000","last_change":"2024-09-10T04:53:37.350530+0000","last_active":"2024-09-10T04:53:37.350611+0000","last_peered":"2024-09-10T04:53:37.350611+0000","last_clean":"2024-09-10T04:53:37.350611+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:53:37.350611+0000","last_undegraded":"2024-09-10T04:53:37.350611+0000","last_fullsized":"2024-09-10T04:53:37.350611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.350444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:41.145937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.343098+0000","last_change":"2024-09-10T04:53:52.343098+0000","last_active":"2024-09-10T04:53:52.343098+0000","last_peered":"2024-09-10T04:53:52.343098+0000","last_clean":"2024-09-10T04:53:52.343098+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:53:52.343098+0000","last_undegraded":"2024-09-10T04:53:52.343098+0000","last_fullsized":"2024-09-10T04:53:52.343098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.343002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:01.985121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.688036+0000","last_change":"2024-09-10T04:53:47.688036+0000","last_active":"2024-09-10T04:53:47.688036+0000","last_peered":"2024-09-10T04:53:47.688036+0000","last_clean":"2024-09-10T04:53:47.688036+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:53:47.688036+0000","last_undegraded":"2024-09-10T04:53:47.688036+0000","last_fullsized":"2024-09-10T04:53:47.688036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.687954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:11.907238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.988139+0000","last_change":"2024-09-10T04:53:59.988067+0000","last_active":"2024-09-10T04:53:59.988139+0000","last_peered":"2024-09-10T04:53:59.988139+0000","last_clean":"2024-09-10T04:53:59.988139+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:53:59.988139+0000","last_undegraded":"2024-09-10T04:53:59.988139+0000","last_fullsized":"2024-09-10T04:53:59.988139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.987987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:25.844429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.630867+0000","last_change":"2024-09-10T04:53:51.630867+0000","last_active":"2024-09-10T04:53:51.630867+0000","last_peered":"2024-09-10T04:53:51.630867+0000","last_clean":"2024-09-10T04:53:51.630867+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:53:51.630867+0000","last_undegraded":"2024-09-10T04:53:51.630867+0000","last_fullsized":"2024-09-10T04:53:51.630867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.630781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:09.098807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.653032+0000","last_change":"2024-09-10T04:54:05.652963+0000","last_active":"2024-09-10T04:54:05.653032+0000","last_peered":"2024-09-10T04:54:05.653032+0000","last_clean":"2024-09-10T04:54:05.653032+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:54:05.653032+0000","last_undegraded":"2024-09-10T04:54:05.653032+0000","last_fullsized":"2024-09-10T04:54:05.653032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.652884+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:11.501788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.274521+0000","last_change":"2024-09-10T04:53:49.274521+0000","last_active":"2024-09-10T04:53:49.274521+0000","last_peered":"2024-09-10T04:53:49.274521+0000","last_clean":"2024-09-10T04:53:49.274521+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:49.274521+0000","last_undegraded":"2024-09-10T04:53:49.274521+0000","last_fullsized":"2024-09-10T04:53:49.274521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.274457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:34.463042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.681596+0000","last_change":"2024-09-10T04:54:04.681516+0000","last_active":"2024-09-10T04:54:04.681596+0000","last_peered":"2024-09-10T04:54:04.681596+0000","last_clean":"2024-09-10T04:54:04.681596+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:54:04.681596+0000","last_undegraded":"2024-09-10T04:54:04.681596+0000","last_fullsized":"2024-09-10T04:54:04.681596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.681418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:36.857790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.321611+0000","last_change":"2024-09-10T04:53:48.321611+0000","last_active":"2024-09-10T04:53:48.321611+0000","last_peered":"2024-09-10T04:53:48.321611+0000","last_clean":"2024-09-10T04:53:48.321611+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:48.321611+0000","last_undegraded":"2024-09-10T04:53:48.321611+0000","last_fullsized":"2024-09-10T04:53:48.321611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.321527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:27.094894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.375969+0000","last_change":"2024-09-10T04:53:53.375914+0000","last_active":"2024-09-10T04:53:53.375969+0000","last_peered":"2024-09-10T04:53:53.375969+0000","last_clean":"2024-09-10T04:53:53.375969+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:53.375969+0000","last_undegraded":"2024-09-10T04:53:53.375969+0000","last_fullsized":"2024-09-10T04:53:53.375969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.375824+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:30.125628+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.739403+0000","last_change":"2024-09-10T04:53:59.739403+0000","last_active":"2024-09-10T04:53:59.739403+0000","last_peered":"2024-09-10T04:53:59.739403+0000","last_clean":"2024-09-10T04:53:59.739403+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:59.739403+0000","last_undegraded":"2024-09-10T04:53:59.739403+0000","last_fullsized":"2024-09-10T04:53:59.739403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.739317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:04.211884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.004475+0000","last_change":"2024-09-10T04:53:42.004475+0000","last_active":"2024-09-10T04:53:42.004475+0000","last_peered":"2024-09-10T04:53:42.004475+0000","last_clean":"2024-09-10T04:53:42.004475+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:53:42.004475+0000","last_undegraded":"2024-09-10T04:53:42.004475+0000","last_fullsized":"2024-09-10T04:53:42.004475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.004361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.759496+0000","last_change":"2024-09-10T04:54:00.759496+0000","last_active":"2024-09-10T04:54:00.759496+0000","last_peered":"2024-09-10T04:54:00.759496+0000","last_clean":"2024-09-10T04:54:00.759496+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:54:00.759496+0000","last_undegraded":"2024-09-10T04:54:00.759496+0000","last_fullsized":"2024-09-10T04:54:00.759496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.759398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:36.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.373882+0000","last_change":"2024-09-10T04:53:38.373882+0000","last_active":"2024-09-10T04:53:38.373882+0000","last_peered":"2024-09-10T04:53:38.373882+0000","last_clean":"2024-09-10T04:53:38.373882+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:53:38.373882+0000","last_undegraded":"2024-09-10T04:53:38.373882+0000","last_fullsized":"2024-09-10T04:53:38.373882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.373750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:37.943360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.632488+0000","last_change":"2024-09-10T04:54:08.632488+0000","last_active":"2024-09-10T04:54:08.632488+0000","last_peered":"2024-09-10T04:54:08.632488+0000","last_clean":"2024-09-10T04:54:08.632488+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:54:08.632488+0000","last_undegraded":"2024-09-10T04:54:08.632488+0000","last_fullsized":"2024-09-10T04:54:08.632488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:08.632381+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:08.632381+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.632381+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:32.525602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.758491+0000","last_change":"2024-09-10T04:53:45.758491+0000","last_active":"2024-09-10T04:53:45.758491+0000","last_peered":"2024-09-10T04:53:45.758491+0000","last_clean":"2024-09-10T04:53:45.758491+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:53:45.758491+0000","last_undegraded":"2024-09-10T04:53:45.758491+0000","last_fullsized":"2024-09-10T04:53:45.758491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.758406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:20.305511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.316685+0000","last_change":"2024-09-10T04:53:51.316685+0000","last_active":"2024-09-10T04:53:51.316685+0000","last_peered":"2024-09-10T04:53:51.316685+0000","last_clean":"2024-09-10T04:53:51.316685+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:53:51.316685+0000","last_undegraded":"2024-09-10T04:53:51.316685+0000","last_fullsized":"2024-09-10T04:53:51.316685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.316587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:59.365417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.726404+0000","last_change":"2024-09-10T04:53:46.726404+0000","last_active":"2024-09-10T04:53:46.726404+0000","last_peered":"2024-09-10T04:53:46.726404+0000","last_clean":"2024-09-10T04:53:46.726404+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:53:46.726404+0000","last_undegraded":"2024-09-10T04:53:46.726404+0000","last_fullsized":"2024-09-10T04:53:46.726404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.726317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:16.025123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.294652+0000","last_change":"2024-09-10T04:53:47.294652+0000","last_active":"2024-09-10T04:53:47.294652+0000","last_peered":"2024-09-10T04:53:47.294652+0000","last_clean":"2024-09-10T04:53:47.294652+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:53:47.294652+0000","last_undegraded":"2024-09-10T04:53:47.294652+0000","last_fullsized":"2024-09-10T04:53:47.294652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.294557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:04:50.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.324104+0000","last_change":"2024-09-10T04:53:47.324104+0000","last_active":"2024-09-10T04:53:47.324104+0000","last_peered":"2024-09-10T04:53:47.324104+0000","last_clean":"2024-09-10T04:53:47.324104+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:47.324104+0000","last_undegraded":"2024-09-10T04:53:47.324104+0000","last_fullsized":"2024-09-10T04:53:47.324104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.324019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:42.318106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.980213+0000","last_change":"2024-09-10T04:53:58.980213+0000","last_active":"2024-09-10T04:53:58.980213+0000","last_peered":"2024-09-10T04:53:58.980213+0000","last_clean":"2024-09-10T04:53:58.980213+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:58.980213+0000","last_undegraded":"2024-09-10T04:53:58.980213+0000","last_fullsized":"2024-09-10T04:53:58.980213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.980132+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:12.434041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.313891+0000","last_change":"2024-09-10T04:53:46.313891+0000","last_active":"2024-09-10T04:53:46.313891+0000","last_peered":"2024-09-10T04:53:46.313891+0000","last_clean":"2024-09-10T04:53:46.313891+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:53:46.313891+0000","last_undegraded":"2024-09-10T04:53:46.313891+0000","last_fullsized":"2024-09-10T04:53:46.313891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.313767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:23.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:17.923190+0000","last_change":"2024-09-10T04:50:18.863293+0000","last_active":"2024-09-10T04:53:17.923190+0000","last_peered":"2024-09-10T04:53:17.923190+0000","last_clean":"2024-09-10T04:53:17.923190+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:53:17.923190+0000","last_undegraded":"2024-09-10T04:53:17.923190+0000","last_fullsized":"2024-09-10T04:53:17.923190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:36.946630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.210504+0000","last_change":"2024-09-10T04:53:55.210504+0000","last_active":"2024-09-10T04:53:55.210504+0000","last_peered":"2024-09-10T04:53:55.210504+0000","last_clean":"2024-09-10T04:53:55.210504+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:55.210504+0000","last_undegraded":"2024-09-10T04:53:55.210504+0000","last_fullsized":"2024-09-10T04:53:55.210504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.210414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:21:26.821090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.335583+0000","last_change":"2024-09-10T04:53:35.335583+0000","last_active":"2024-09-10T04:53:35.335583+0000","last_peered":"2024-09-10T04:53:35.335583+0000","last_clean":"2024-09-10T04:53:35.335583+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:53:35.335583+0000","last_undegraded":"2024-09-10T04:53:35.335583+0000","last_fullsized":"2024-09-10T04:53:35.335583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.335499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:57.235909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.263834+0000","last_change":"2024-09-10T04:54:11.263834+0000","last_active":"2024-09-10T04:54:11.263834+0000","last_peered":"2024-09-10T04:54:11.263834+0000","last_clean":"2024-09-10T04:54:11.263834+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:54:11.263834+0000","last_undegraded":"2024-09-10T04:54:11.263834+0000","last_fullsized":"2024-09-10T04:54:11.263834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.263716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.263716+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.263716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:48.203815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'51","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.152503+0000","last_change":"2024-09-10T04:54:20.152503+0000","last_active":"2024-09-10T04:54:20.152503+0000","last_peered":"2024-09-10T04:54:20.152503+0000","last_clean":"2024-09-10T04:54:20.152503+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:54:20.152503+0000","last_undegraded":"2024-09-10T04:54:20.152503+0000","last_fullsized":"2024-09-10T04:54:20.152503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T04:54:20.152419+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T04:54:20.152419+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.152419+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:35.700821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.877126+0000","last_change":"2024-09-10T04:50:16.848091+0000","last_active":"2024-09-10T04:50:48.877126+0000","last_peered":"2024-09-10T04:50:48.877126+0000","last_clean":"2024-09-10T04:50:48.877126+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:50:48.877126+0000","last_undegraded":"2024-09-10T04:50:48.877126+0000","last_fullsized":"2024-09-10T04:50:48.877126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:11.371634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.294029+0000","last_change":"2024-09-10T04:50:18.854645+0000","last_active":"2024-09-10T04:52:17.294029+0000","last_peered":"2024-09-10T04:52:17.294029+0000","last_clean":"2024-09-10T04:52:17.294029+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:52:17.294029+0000","last_undegraded":"2024-09-10T04:52:17.294029+0000","last_fullsized":"2024-09-10T04:52:17.294029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:06.865386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.232292+0000","last_change":"2024-09-10T04:53:56.232292+0000","last_active":"2024-09-10T04:53:56.232292+0000","last_peered":"2024-09-10T04:53:56.232292+0000","last_clean":"2024-09-10T04:53:56.232292+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:53:56.232292+0000","last_undegraded":"2024-09-10T04:53:56.232292+0000","last_fullsized":"2024-09-10T04:53:56.232292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.232172+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:38.675568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.477349+0000","last_change":"2024-09-10T04:53:30.477349+0000","last_active":"2024-09-10T04:53:30.477349+0000","last_peered":"2024-09-10T04:53:30.477349+0000","last_clean":"2024-09-10T04:53:30.477349+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:30.477349+0000","last_undegraded":"2024-09-10T04:53:30.477349+0000","last_fullsized":"2024-09-10T04:53:30.477349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.477261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:40.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.284890+0000","last_change":"2024-09-10T04:54:10.284890+0000","last_active":"2024-09-10T04:54:10.284890+0000","last_peered":"2024-09-10T04:54:10.284890+0000","last_clean":"2024-09-10T04:54:10.284890+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:54:10.284890+0000","last_undegraded":"2024-09-10T04:54:10.284890+0000","last_fullsized":"2024-09-10T04:54:10.284890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.284799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.284799+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.284799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:49.115810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.853147+0000","last_change":"2024-09-10T04:54:14.853147+0000","last_active":"2024-09-10T04:54:14.853147+0000","last_peered":"2024-09-10T04:54:14.853147+0000","last_clean":"2024-09-10T04:54:14.853147+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:54:14.853147+0000","last_undegraded":"2024-09-10T04:54:14.853147+0000","last_fullsized":"2024-09-10T04:54:14.853147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:54:14.853017+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:54:14.853017+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.853017+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:50.898384+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876951+0000","last_change":"2024-09-10T04:50:16.847179+0000","last_active":"2024-09-10T04:50:48.876951+0000","last_peered":"2024-09-10T04:50:48.876951+0000","last_clean":"2024-09-10T04:50:48.876951+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:50:48.876951+0000","last_undegraded":"2024-09-10T04:50:48.876951+0000","last_fullsized":"2024-09-10T04:50:48.876951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:13.505285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:14.199424+0000","last_change":"2024-09-10T04:50:18.860419+0000","last_active":"2024-09-10T04:52:14.199424+0000","last_peered":"2024-09-10T04:52:14.199424+0000","last_clean":"2024-09-10T04:52:14.199424+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:52:14.199424+0000","last_undegraded":"2024-09-10T04:52:14.199424+0000","last_fullsized":"2024-09-10T04:52:14.199424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:27.166684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.243155+0000","last_change":"2024-09-10T04:53:57.243155+0000","last_active":"2024-09-10T04:53:57.243155+0000","last_peered":"2024-09-10T04:53:57.243155+0000","last_clean":"2024-09-10T04:53:57.243155+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:53:57.243155+0000","last_undegraded":"2024-09-10T04:53:57.243155+0000","last_fullsized":"2024-09-10T04:53:57.243155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.243066+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:14.528708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.682127+0000","last_change":"2024-09-10T04:53:39.682127+0000","last_active":"2024-09-10T04:53:39.682127+0000","last_peered":"2024-09-10T04:53:39.682127+0000","last_clean":"2024-09-10T04:53:39.682127+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:53:39.682127+0000","last_undegraded":"2024-09-10T04:53:39.682127+0000","last_fullsized":"2024-09-10T04:53:39.682127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.682042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:15.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.229135+0000","last_change":"2024-09-10T04:54:12.229135+0000","last_active":"2024-09-10T04:54:12.229135+0000","last_peered":"2024-09-10T04:54:12.229135+0000","last_clean":"2024-09-10T04:54:12.229135+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:54:12.229135+0000","last_undegraded":"2024-09-10T04:54:12.229135+0000","last_fullsized":"2024-09-10T04:54:12.229135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:12.229050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:12.229050+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.229050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:45.969072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.165507+0000","last_change":"2024-09-10T04:54:03.165507+0000","last_active":"2024-09-10T04:54:03.165507+0000","last_peered":"2024-09-10T04:54:03.165507+0000","last_clean":"2024-09-10T04:54:03.165507+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:54:03.165507+0000","last_undegraded":"2024-09-10T04:54:03.165507+0000","last_fullsized":"2024-09-10T04:54:03.165507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.165411+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:24.743039+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.499186+0000","last_change":"2024-09-10T04:50:16.854032+0000","last_active":"2024-09-10T04:53:24.499186+0000","last_peered":"2024-09-10T04:53:24.499186+0000","last_clean":"2024-09-10T04:53:24.499186+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:53:24.499186+0000","last_undegraded":"2024-09-10T04:53:24.499186+0000","last_fullsized":"2024-09-10T04:53:24.499186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:44.301956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.228227+0000","last_change":"2024-09-10T04:54:17.228227+0000","last_active":"2024-09-10T04:54:17.228227+0000","last_peered":"2024-09-10T04:54:17.228227+0000","last_clean":"2024-09-10T04:54:17.228227+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:54:17.228227+0000","last_undegraded":"2024-09-10T04:54:17.228227+0000","last_fullsized":"2024-09-10T04:54:17.228227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:17.228134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:17.228134+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.228134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:10.343908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.278049+0000","last_change":"2024-09-10T04:53:58.278049+0000","last_active":"2024-09-10T04:53:58.278049+0000","last_peered":"2024-09-10T04:53:58.278049+0000","last_clean":"2024-09-10T04:53:58.278049+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:58.278049+0000","last_undegraded":"2024-09-10T04:53:58.278049+0000","last_fullsized":"2024-09-10T04:53:58.278049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.277963+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:29.914920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.654294+0000","last_change":"2024-09-10T04:53:38.654294+0000","last_active":"2024-09-10T04:53:38.654294+0000","last_peered":"2024-09-10T04:53:38.654294+0000","last_clean":"2024-09-10T04:53:38.654294+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:53:38.654294+0000","last_undegraded":"2024-09-10T04:53:38.654294+0000","last_fullsized":"2024-09-10T04:53:38.654294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.654187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:34.763819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.714291+0000","last_change":"2024-09-10T04:54:10.714291+0000","last_active":"2024-09-10T04:54:10.714291+0000","last_peered":"2024-09-10T04:54:10.714291+0000","last_clean":"2024-09-10T04:54:10.714291+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:54:10.714291+0000","last_undegraded":"2024-09-10T04:54:10.714291+0000","last_fullsized":"2024-09-10T04:54:10.714291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.714211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.714211+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.714211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:39.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.782436+0000","last_change":"2024-09-10T04:54:21.782436+0000","last_active":"2024-09-10T04:54:21.782436+0000","last_peered":"2024-09-10T04:54:21.782436+0000","last_clean":"2024-09-10T04:54:21.782436+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:54:21.782436+0000","last_undegraded":"2024-09-10T04:54:21.782436+0000","last_fullsized":"2024-09-10T04:54:21.782436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:21.782342+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:21.782342+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.782342+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:33.276740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":409,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.503620+0000","last_change":"2024-09-10T04:50:16.856938+0000","last_active":"2024-09-10T04:53:24.503620+0000","last_peered":"2024-09-10T04:53:24.503620+0000","last_clean":"2024-09-10T04:53:24.503620+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:53:24.503620+0000","last_undegraded":"2024-09-10T04:53:24.503620+0000","last_fullsized":"2024-09-10T04:53:24.503620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.912875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.322241+0000","last_change":"2024-09-10T04:53:40.322241+0000","last_active":"2024-09-10T04:53:40.322241+0000","last_peered":"2024-09-10T04:53:40.322241+0000","last_clean":"2024-09-10T04:53:40.322241+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:40.322241+0000","last_undegraded":"2024-09-10T04:53:40.322241+0000","last_fullsized":"2024-09-10T04:53:40.322241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.322153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:47.658822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.659561+0000","last_change":"2024-09-10T04:53:41.659561+0000","last_active":"2024-09-10T04:53:41.659561+0000","last_peered":"2024-09-10T04:53:41.659561+0000","last_clean":"2024-09-10T04:53:41.659561+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:53:41.659561+0000","last_undegraded":"2024-09-10T04:53:41.659561+0000","last_fullsized":"2024-09-10T04:53:41.659561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.659470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:46.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.991571+0000","last_change":"2024-09-10T04:54:03.991571+0000","last_active":"2024-09-10T04:54:03.991571+0000","last_peered":"2024-09-10T04:54:03.991571+0000","last_clean":"2024-09-10T04:54:03.991571+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:54:03.991571+0000","last_undegraded":"2024-09-10T04:54:03.991571+0000","last_fullsized":"2024-09-10T04:54:03.991571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.991486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:01.756702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'60","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.833253+0000","last_change":"2024-09-10T04:54:19.833253+0000","last_active":"2024-09-10T04:54:19.833253+0000","last_peered":"2024-09-10T04:54:19.833253+0000","last_clean":"2024-09-10T04:54:19.833253+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:54:19.833253+0000","last_undegraded":"2024-09-10T04:54:19.833253+0000","last_fullsized":"2024-09-10T04:54:19.833253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T04:54:19.833149+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T04:54:19.833149+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.833149+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:36.192946+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.908760+0000","last_change":"2024-09-10T04:54:17.908760+0000","last_active":"2024-09-10T04:54:17.908760+0000","last_peered":"2024-09-10T04:54:17.908760+0000","last_clean":"2024-09-10T04:54:17.908760+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:54:17.908760+0000","last_undegraded":"2024-09-10T04:54:17.908760+0000","last_fullsized":"2024-09-10T04:54:17.908760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:17.908646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:17.908646+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.908646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:25.977323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.210520+0000","last_change":"2024-09-10T04:54:13.210464+0000","last_active":"2024-09-10T04:54:13.210520+0000","last_peered":"2024-09-10T04:54:13.210520+0000","last_clean":"2024-09-10T04:54:13.210520+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:54:13.210520+0000","last_undegraded":"2024-09-10T04:54:13.210520+0000","last_fullsized":"2024-09-10T04:54:13.210520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:54:13.210386+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:54:13.210386+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.210386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.968650+0000","last_change":"2024-09-10T04:53:46.968650+0000","last_active":"2024-09-10T04:53:46.968650+0000","last_peered":"2024-09-10T04:53:46.968650+0000","last_clean":"2024-09-10T04:53:46.968650+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:53:46.968650+0000","last_undegraded":"2024-09-10T04:53:46.968650+0000","last_fullsized":"2024-09-10T04:53:46.968650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.968570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:17.768222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.646386+0000","last_change":"2024-09-10T04:53:37.646386+0000","last_active":"2024-09-10T04:53:37.646386+0000","last_peered":"2024-09-10T04:53:37.646386+0000","last_clean":"2024-09-10T04:53:37.646386+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:53:37.646386+0000","last_undegraded":"2024-09-10T04:53:37.646386+0000","last_fullsized":"2024-09-10T04:53:37.646386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.646297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"34'2","reported_seq":240,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.301224+0000","last_change":"2024-09-10T04:53:56.301224+0000","last_active":"2024-09-10T04:53:56.301224+0000","last_peered":"2024-09-10T04:53:56.301224+0000","last_clean":"2024-09-10T04:53:56.301224+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:53:56.301224+0000","last_undegraded":"2024-09-10T04:53:56.301224+0000","last_fullsized":"2024-09-10T04:53:56.301224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.301141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:29.983059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.173821+0000","last_change":"2024-09-10T04:54:16.173821+0000","last_active":"2024-09-10T04:54:16.173821+0000","last_peered":"2024-09-10T04:54:16.173821+0000","last_clean":"2024-09-10T04:54:16.173821+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:54:16.173821+0000","last_undegraded":"2024-09-10T04:54:16.173821+0000","last_fullsized":"2024-09-10T04:54:16.173821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T04:54:16.173715+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T04:54:16.173715+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.173715+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.950235+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878899+0000","last_change":"2024-09-10T04:50:16.857665+0000","last_active":"2024-09-10T04:50:48.878899+0000","last_peered":"2024-09-10T04:50:48.878899+0000","last_clean":"2024-09-10T04:50:48.878899+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:50:48.878899+0000","last_undegraded":"2024-09-10T04:50:48.878899+0000","last_fullsized":"2024-09-10T04:50:48.878899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.814236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.924766+0000","last_change":"2024-09-10T04:54:22.924709+0000","last_active":"2024-09-10T04:54:22.924766+0000","last_peered":"2024-09-10T04:54:22.924766+0000","last_clean":"2024-09-10T04:54:22.924766+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:54:22.924766+0000","last_undegraded":"2024-09-10T04:54:22.924766+0000","last_fullsized":"2024-09-10T04:54:22.924766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:22.924630+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:22.924630+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.924630+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:37.467517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.706531+0000","last_change":"2024-09-10T04:53:53.706531+0000","last_active":"2024-09-10T04:53:53.706531+0000","last_peered":"2024-09-10T04:53:53.706531+0000","last_clean":"2024-09-10T04:53:53.706531+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:53.706531+0000","last_undegraded":"2024-09-10T04:53:53.706531+0000","last_fullsized":"2024-09-10T04:53:53.706531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.706430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:01.447306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.674057+0000","last_change":"2024-09-10T04:53:36.674057+0000","last_active":"2024-09-10T04:53:36.674057+0000","last_peered":"2024-09-10T04:53:36.674057+0000","last_clean":"2024-09-10T04:53:36.674057+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:53:36.674057+0000","last_undegraded":"2024-09-10T04:53:36.674057+0000","last_fullsized":"2024-09-10T04:53:36.674057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.673934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:50.127843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.290654+0000","last_change":"2024-09-10T04:53:58.290654+0000","last_active":"2024-09-10T04:53:58.290654+0000","last_peered":"2024-09-10T04:53:58.290654+0000","last_clean":"2024-09-10T04:53:58.290654+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:53:58.290654+0000","last_undegraded":"2024-09-10T04:53:58.290654+0000","last_fullsized":"2024-09-10T04:53:58.290654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.290557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:05.934767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.777213+0000","last_change":"2024-09-10T04:54:17.777213+0000","last_active":"2024-09-10T04:54:17.777213+0000","last_peered":"2024-09-10T04:54:17.777213+0000","last_clean":"2024-09-10T04:54:17.777213+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:54:17.777213+0000","last_undegraded":"2024-09-10T04:54:17.777213+0000","last_fullsized":"2024-09-10T04:54:17.777213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T04:54:17.777117+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T04:54:17.777117+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.777117+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:54.144349+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.239662+0000","last_change":"2024-09-10T04:54:08.239662+0000","last_active":"2024-09-10T04:54:08.239662+0000","last_peered":"2024-09-10T04:54:08.239662+0000","last_clean":"2024-09-10T04:54:08.239662+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:54:08.239662+0000","last_undegraded":"2024-09-10T04:54:08.239662+0000","last_fullsized":"2024-09-10T04:54:08.239662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.239567+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.192002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.876100+0000","last_change":"2024-09-10T04:54:26.876100+0000","last_active":"2024-09-10T04:54:26.876100+0000","last_peered":"2024-09-10T04:54:26.876100+0000","last_clean":"2024-09-10T04:54:26.876100+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:54:26.876100+0000","last_undegraded":"2024-09-10T04:54:26.876100+0000","last_fullsized":"2024-09-10T04:54:26.876100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:26.876020+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:26.876020+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.876020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:58.849639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.315791+0000","last_change":"2024-09-10T04:53:42.315791+0000","last_active":"2024-09-10T04:53:42.315791+0000","last_peered":"2024-09-10T04:53:42.315791+0000","last_clean":"2024-09-10T04:53:42.315791+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:42.315791+0000","last_undegraded":"2024-09-10T04:53:42.315791+0000","last_fullsized":"2024-09-10T04:53:42.315791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.315680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:17.255872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.698115+0000","last_change":"2024-09-10T04:53:34.698115+0000","last_active":"2024-09-10T04:53:34.698115+0000","last_peered":"2024-09-10T04:53:34.698115+0000","last_clean":"2024-09-10T04:53:34.698115+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:53:34.698115+0000","last_undegraded":"2024-09-10T04:53:34.698115+0000","last_fullsized":"2024-09-10T04:53:34.698115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.698035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:37.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.329124+0000","last_change":"2024-09-10T04:53:57.329124+0000","last_active":"2024-09-10T04:53:57.329124+0000","last_peered":"2024-09-10T04:53:57.329124+0000","last_clean":"2024-09-10T04:53:57.329124+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:53:57.329124+0000","last_undegraded":"2024-09-10T04:53:57.329124+0000","last_fullsized":"2024-09-10T04:53:57.329124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.329039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:50.320602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'80","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.183770+0000","last_change":"2024-09-10T04:54:14.183770+0000","last_active":"2024-09-10T04:54:14.183770+0000","last_peered":"2024-09-10T04:54:14.183770+0000","last_clean":"2024-09-10T04:54:14.183770+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:54:14.183770+0000","last_undegraded":"2024-09-10T04:54:14.183770+0000","last_fullsized":"2024-09-10T04:54:14.183770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'80","last_scrub_stamp":"2024-09-10T04:54:14.183676+0000","last_deep_scrub":"34'80","last_deep_scrub_stamp":"2024-09-10T04:54:14.183676+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.183676+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:47.860877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.235429+0000","last_change":"2024-09-10T04:54:05.235429+0000","last_active":"2024-09-10T04:54:05.235429+0000","last_peered":"2024-09-10T04:54:05.235429+0000","last_clean":"2024-09-10T04:54:05.235429+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:54:05.235429+0000","last_undegraded":"2024-09-10T04:54:05.235429+0000","last_fullsized":"2024-09-10T04:54:05.235429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.235334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.026590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.915691+0000","last_change":"2024-09-10T04:54:24.915691+0000","last_active":"2024-09-10T04:54:24.915691+0000","last_peered":"2024-09-10T04:54:24.915691+0000","last_clean":"2024-09-10T04:54:24.915691+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:54:24.915691+0000","last_undegraded":"2024-09-10T04:54:24.915691+0000","last_fullsized":"2024-09-10T04:54:24.915691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-10T04:54:24.915577+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-10T04:54:24.915577+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.915577+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:58.077268+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.926197+0000","last_change":"2024-09-10T04:53:47.926197+0000","last_active":"2024-09-10T04:53:47.926197+0000","last_peered":"2024-09-10T04:53:47.926197+0000","last_clean":"2024-09-10T04:53:47.926197+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:53:47.926197+0000","last_undegraded":"2024-09-10T04:53:47.926197+0000","last_fullsized":"2024-09-10T04:53:47.926197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.926107+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.345795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.316210+0000","last_change":"2024-09-10T04:53:34.316210+0000","last_active":"2024-09-10T04:53:34.316210+0000","last_peered":"2024-09-10T04:53:34.316210+0000","last_clean":"2024-09-10T04:53:34.316210+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:53:34.316210+0000","last_undegraded":"2024-09-10T04:53:34.316210+0000","last_fullsized":"2024-09-10T04:53:34.316210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.316125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:51.933570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.218139+0000","last_change":"2024-09-10T04:54:00.218139+0000","last_active":"2024-09-10T04:54:00.218139+0000","last_peered":"2024-09-10T04:54:00.218139+0000","last_clean":"2024-09-10T04:54:00.218139+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:54:00.218139+0000","last_undegraded":"2024-09-10T04:54:00.218139+0000","last_fullsized":"2024-09-10T04:54:00.218139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.218033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:17.651257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.787213+0000","last_change":"2024-09-10T04:54:20.787213+0000","last_active":"2024-09-10T04:54:20.787213+0000","last_peered":"2024-09-10T04:54:20.787213+0000","last_clean":"2024-09-10T04:54:20.787213+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:54:20.787213+0000","last_undegraded":"2024-09-10T04:54:20.787213+0000","last_fullsized":"2024-09-10T04:54:20.787213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:20.787118+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:20.787118+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.787118+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.273943+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881965+0000","last_change":"2024-09-10T04:50:16.846611+0000","last_active":"2024-09-10T04:50:48.881965+0000","last_peered":"2024-09-10T04:50:48.881965+0000","last_clean":"2024-09-10T04:50:48.881965+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:50:48.881965+0000","last_undegraded":"2024-09-10T04:50:48.881965+0000","last_fullsized":"2024-09-10T04:50:48.881965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.990039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.025726+0000","last_change":"2024-09-10T04:50:18.862369+0000","last_active":"2024-09-10T04:53:18.025726+0000","last_peered":"2024-09-10T04:53:18.025726+0000","last_clean":"2024-09-10T04:53:18.025726+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:53:18.025726+0000","last_undegraded":"2024-09-10T04:53:18.025726+0000","last_fullsized":"2024-09-10T04:53:18.025726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.741624+0000","last_change":"2024-09-10T04:54:01.741624+0000","last_active":"2024-09-10T04:54:01.741624+0000","last_peered":"2024-09-10T04:54:01.741624+0000","last_clean":"2024-09-10T04:54:01.741624+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:54:01.741624+0000","last_undegraded":"2024-09-10T04:54:01.741624+0000","last_fullsized":"2024-09-10T04:54:01.741624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.741510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.143399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.705604+0000","last_change":"2024-09-10T04:53:33.705492+0000","last_active":"2024-09-10T04:53:33.705604+0000","last_peered":"2024-09-10T04:53:33.705604+0000","last_clean":"2024-09-10T04:53:33.705604+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:53:33.705604+0000","last_undegraded":"2024-09-10T04:53:33.705604+0000","last_fullsized":"2024-09-10T04:53:33.705604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.705362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:44.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.966021+0000","last_change":"2024-09-10T04:54:04.966021+0000","last_active":"2024-09-10T04:54:04.966021+0000","last_peered":"2024-09-10T04:54:04.966021+0000","last_clean":"2024-09-10T04:54:04.966021+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:54:04.966021+0000","last_undegraded":"2024-09-10T04:54:04.966021+0000","last_fullsized":"2024-09-10T04:54:04.966021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.965940+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.903141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'47","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.188475+0000","last_change":"2024-09-10T04:54:02.188475+0000","last_active":"2024-09-10T04:54:02.188475+0000","last_peered":"2024-09-10T04:54:02.188475+0000","last_clean":"2024-09-10T04:54:02.188475+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:54:02.188475+0000","last_undegraded":"2024-09-10T04:54:02.188475+0000","last_fullsized":"2024-09-10T04:54:02.188475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.188348+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:09.968600+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.241799+0000","last_change":"2024-09-10T04:54:06.241799+0000","last_active":"2024-09-10T04:54:06.241799+0000","last_peered":"2024-09-10T04:54:06.241799+0000","last_clean":"2024-09-10T04:54:06.241799+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:54:06.241799+0000","last_undegraded":"2024-09-10T04:54:06.241799+0000","last_fullsized":"2024-09-10T04:54:06.241799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.241706+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:36.748454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'17","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.894777+0000","last_change":"2024-09-10T04:54:21.894701+0000","last_active":"2024-09-10T04:54:21.894777+0000","last_peered":"2024-09-10T04:54:21.894777+0000","last_clean":"2024-09-10T04:54:21.894777+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:54:21.894777+0000","last_undegraded":"2024-09-10T04:54:21.894777+0000","last_fullsized":"2024-09-10T04:54:21.894777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-10T04:54:21.894606+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-10T04:54:21.894606+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.894606+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:35.373545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.303154+0000","last_change":"2024-09-10T04:53:41.303154+0000","last_active":"2024-09-10T04:53:41.303154+0000","last_peered":"2024-09-10T04:53:41.303154+0000","last_clean":"2024-09-10T04:53:41.303154+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:41.303154+0000","last_undegraded":"2024-09-10T04:53:41.303154+0000","last_fullsized":"2024-09-10T04:53:41.303154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.303062+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:36.191501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.277904+0000","last_change":"2024-09-10T04:53:32.277832+0000","last_active":"2024-09-10T04:53:32.277904+0000","last_peered":"2024-09-10T04:53:32.277904+0000","last_clean":"2024-09-10T04:53:32.277904+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:53:32.277904+0000","last_undegraded":"2024-09-10T04:53:32.277904+0000","last_fullsized":"2024-09-10T04:53:32.277904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.277745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:40.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.769879+0000","last_change":"2024-09-10T04:54:14.769879+0000","last_active":"2024-09-10T04:54:14.769879+0000","last_peered":"2024-09-10T04:54:14.769879+0000","last_clean":"2024-09-10T04:54:14.769879+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:54:14.769879+0000","last_undegraded":"2024-09-10T04:54:14.769879+0000","last_fullsized":"2024-09-10T04:54:14.769879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:14.769792+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:14.769792+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.769792+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:02.328008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.187560+0000","last_change":"2024-09-10T04:54:18.187560+0000","last_active":"2024-09-10T04:54:18.187560+0000","last_peered":"2024-09-10T04:54:18.187560+0000","last_clean":"2024-09-10T04:54:18.187560+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:54:18.187560+0000","last_undegraded":"2024-09-10T04:54:18.187560+0000","last_fullsized":"2024-09-10T04:54:18.187560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:54:18.187475+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:54:18.187475+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.187475+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:12.804445+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.501181+0000","last_change":"2024-09-10T04:50:16.854119+0000","last_active":"2024-09-10T04:53:24.501181+0000","last_peered":"2024-09-10T04:53:24.501181+0000","last_clean":"2024-09-10T04:53:24.501181+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:53:24.501181+0000","last_undegraded":"2024-09-10T04:53:24.501181+0000","last_fullsized":"2024-09-10T04:53:24.501181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:14.900189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.252373+0000","last_change":"2024-09-10T04:54:12.252286+0000","last_active":"2024-09-10T04:54:12.252373+0000","last_peered":"2024-09-10T04:54:12.252373+0000","last_clean":"2024-09-10T04:54:12.252373+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:54:12.252373+0000","last_undegraded":"2024-09-10T04:54:12.252373+0000","last_fullsized":"2024-09-10T04:54:12.252373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:12.252165+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:12.252165+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.252165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.766994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.970935+0000","last_change":"2024-09-10T04:53:48.970935+0000","last_active":"2024-09-10T04:53:48.970935+0000","last_peered":"2024-09-10T04:53:48.970935+0000","last_clean":"2024-09-10T04:53:48.970935+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:48.970935+0000","last_undegraded":"2024-09-10T04:53:48.970935+0000","last_fullsized":"2024-09-10T04:53:48.970935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.970841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.945727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.328682+0000","last_change":"2024-09-10T04:53:30.328609+0000","last_active":"2024-09-10T04:53:30.328682+0000","last_peered":"2024-09-10T04:53:30.328682+0000","last_clean":"2024-09-10T04:53:30.328682+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:53:30.328682+0000","last_undegraded":"2024-09-10T04:53:30.328682+0000","last_fullsized":"2024-09-10T04:53:30.328682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.328488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:00.918192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.286074+0000","last_change":"2024-09-10T04:54:07.286074+0000","last_active":"2024-09-10T04:54:07.286074+0000","last_peered":"2024-09-10T04:54:07.286074+0000","last_clean":"2024-09-10T04:54:07.286074+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:54:07.286074+0000","last_undegraded":"2024-09-10T04:54:07.286074+0000","last_fullsized":"2024-09-10T04:54:07.286074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.285980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:17.562378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'51","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.773150+0000","last_change":"2024-09-10T04:54:24.773150+0000","last_active":"2024-09-10T04:54:24.773150+0000","last_peered":"2024-09-10T04:54:24.773150+0000","last_clean":"2024-09-10T04:54:24.773150+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:54:24.773150+0000","last_undegraded":"2024-09-10T04:54:24.773150+0000","last_fullsized":"2024-09-10T04:54:24.773150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T04:54:24.773063+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T04:54:24.773063+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.773063+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:18.351493+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.699318+0000","last_change":"2024-09-10T04:54:27.699318+0000","last_active":"2024-09-10T04:54:27.699318+0000","last_peered":"2024-09-10T04:54:27.699318+0000","last_clean":"2024-09-10T04:54:27.699318+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:54:27.699318+0000","last_undegraded":"2024-09-10T04:54:27.699318+0000","last_fullsized":"2024-09-10T04:54:27.699318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:27.699234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:27.699234+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.699234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.931233+0000","last_change":"2024-09-10T04:54:23.931165+0000","last_active":"2024-09-10T04:54:23.931233+0000","last_peered":"2024-09-10T04:54:23.931233+0000","last_clean":"2024-09-10T04:54:23.931233+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:54:23.931233+0000","last_undegraded":"2024-09-10T04:54:23.931233+0000","last_fullsized":"2024-09-10T04:54:23.931233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-10T04:54:23.931081+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-10T04:54:23.931081+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.931081+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:01.663986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.671794+0000","last_change":"2024-09-10T04:53:50.671711+0000","last_active":"2024-09-10T04:53:50.671794+0000","last_peered":"2024-09-10T04:53:50.671794+0000","last_clean":"2024-09-10T04:53:50.671794+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:50.671794+0000","last_undegraded":"2024-09-10T04:53:50.671794+0000","last_fullsized":"2024-09-10T04:53:50.671794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.671613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:06.215300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.032500+0000","last_change":"2024-09-10T04:53:29.032422+0000","last_active":"2024-09-10T04:53:29.032500+0000","last_peered":"2024-09-10T04:53:29.032500+0000","last_clean":"2024-09-10T04:53:29.032500+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:53:29.032500+0000","last_undegraded":"2024-09-10T04:53:29.032500+0000","last_fullsized":"2024-09-10T04:53:29.032500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.032316+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:21.648097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.757605+0000","last_change":"2024-09-10T04:53:28.757540+0000","last_active":"2024-09-10T04:53:28.757605+0000","last_peered":"2024-09-10T04:53:28.757605+0000","last_clean":"2024-09-10T04:53:28.757605+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:53:28.757605+0000","last_undegraded":"2024-09-10T04:53:28.757605+0000","last_fullsized":"2024-09-10T04:53:28.757605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.757471+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:58.706956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.317397+0000","last_change":"2024-09-10T04:53:29.317328+0000","last_active":"2024-09-10T04:53:29.317397+0000","last_peered":"2024-09-10T04:53:29.317397+0000","last_clean":"2024-09-10T04:53:29.317397+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:53:29.317397+0000","last_undegraded":"2024-09-10T04:53:29.317397+0000","last_fullsized":"2024-09-10T04:53:29.317397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.317231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:37.108405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.996991+0000","last_change":"2024-09-10T04:54:01.996930+0000","last_active":"2024-09-10T04:54:01.996991+0000","last_peered":"2024-09-10T04:54:01.996991+0000","last_clean":"2024-09-10T04:54:01.996991+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:54:01.996991+0000","last_undegraded":"2024-09-10T04:54:01.996991+0000","last_fullsized":"2024-09-10T04:54:01.996991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.996835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:25.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'98","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.803172+0000","last_change":"2024-09-10T04:54:18.803172+0000","last_active":"2024-09-10T04:54:18.803172+0000","last_peered":"2024-09-10T04:54:18.803172+0000","last_clean":"2024-09-10T04:54:18.803172+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:54:18.803172+0000","last_undegraded":"2024-09-10T04:54:18.803172+0000","last_fullsized":"2024-09-10T04:54:18.803172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'98","last_scrub_stamp":"2024-09-10T04:54:18.803051+0000","last_deep_scrub":"34'98","last_deep_scrub_stamp":"2024-09-10T04:54:18.803051+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.803051+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:27.143882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.151465+0000","last_change":"2024-09-10T04:54:27.151465+0000","last_active":"2024-09-10T04:54:27.151465+0000","last_peered":"2024-09-10T04:54:27.151465+0000","last_clean":"2024-09-10T04:54:27.151465+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:54:27.151465+0000","last_undegraded":"2024-09-10T04:54:27.151465+0000","last_fullsized":"2024-09-10T04:54:27.151465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:27.151359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:27.151359+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.151359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:09.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.206574+0000","last_change":"2024-09-10T04:54:14.206574+0000","last_active":"2024-09-10T04:54:14.206574+0000","last_peered":"2024-09-10T04:54:14.206574+0000","last_clean":"2024-09-10T04:54:14.206574+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:54:14.206574+0000","last_undegraded":"2024-09-10T04:54:14.206574+0000","last_fullsized":"2024-09-10T04:54:14.206574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-09-10T04:54:14.206473+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-09-10T04:54:14.206473+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.206473+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:58.882825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.221557+0000","last_change":"2024-09-10T04:53:52.221557+0000","last_active":"2024-09-10T04:53:52.221557+0000","last_peered":"2024-09-10T04:53:52.221557+0000","last_clean":"2024-09-10T04:53:52.221557+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:53:52.221557+0000","last_undegraded":"2024-09-10T04:53:52.221557+0000","last_fullsized":"2024-09-10T04:53:52.221557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.221463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:15.853804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:27.781682+0000","last_change":"2024-09-10T04:53:27.781601+0000","last_active":"2024-09-10T04:53:27.781682+0000","last_peered":"2024-09-10T04:53:27.781682+0000","last_clean":"2024-09-10T04:53:27.781682+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:53:27.781682+0000","last_undegraded":"2024-09-10T04:53:27.781682+0000","last_fullsized":"2024-09-10T04:53:27.781682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_clean_scrub_stamp":"2024-09-10T04:53:27.781512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:07.001654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.064680+0000","last_change":"2024-09-10T04:53:31.064620+0000","last_active":"2024-09-10T04:53:31.064680+0000","last_peered":"2024-09-10T04:53:31.064680+0000","last_clean":"2024-09-10T04:53:31.064680+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:31.064680+0000","last_undegraded":"2024-09-10T04:53:31.064680+0000","last_fullsized":"2024-09-10T04:53:31.064680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.064527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:59.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.636690+0000","last_change":"2024-09-10T04:54:07.636690+0000","last_active":"2024-09-10T04:54:07.636690+0000","last_peered":"2024-09-10T04:54:07.636690+0000","last_clean":"2024-09-10T04:54:07.636690+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:54:07.636690+0000","last_undegraded":"2024-09-10T04:54:07.636690+0000","last_fullsized":"2024-09-10T04:54:07.636690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.636608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:01.188346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'301","reported_seq":533,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.872923+0000","last_change":"2024-09-10T04:54:12.872830+0000","last_active":"2024-09-10T04:54:12.872923+0000","last_peered":"2024-09-10T04:54:12.872923+0000","last_clean":"2024-09-10T04:54:12.872923+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:54:12.872923+0000","last_undegraded":"2024-09-10T04:54:12.872923+0000","last_fullsized":"2024-09-10T04:54:12.872923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'301","last_scrub_stamp":"2024-09-10T04:54:12.872695+0000","last_deep_scrub":"34'301","last_deep_scrub_stamp":"2024-09-10T04:54:12.872695+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.872695+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:30.340721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.164086+0000","last_change":"2024-09-10T04:54:26.164015+0000","last_active":"2024-09-10T04:54:26.164086+0000","last_peered":"2024-09-10T04:54:26.164086+0000","last_clean":"2024-09-10T04:54:26.164086+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:54:26.164086+0000","last_undegraded":"2024-09-10T04:54:26.164086+0000","last_fullsized":"2024-09-10T04:54:26.164086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:26.163930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:26.163930+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.163930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:04.064439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.924425+0000","last_change":"2024-09-10T04:54:27.924425+0000","last_active":"2024-09-10T04:54:27.924425+0000","last_peered":"2024-09-10T04:54:27.924425+0000","last_clean":"2024-09-10T04:54:27.924425+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:54:27.924425+0000","last_undegraded":"2024-09-10T04:54:27.924425+0000","last_fullsized":"2024-09-10T04:54:27.924425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:27.924340+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:27.924340+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.924340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:19.480988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.984615+0000","last_change":"2024-09-10T04:53:45.984615+0000","last_active":"2024-09-10T04:53:45.984615+0000","last_peered":"2024-09-10T04:53:45.984615+0000","last_clean":"2024-09-10T04:53:45.984615+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:45.984615+0000","last_undegraded":"2024-09-10T04:53:45.984615+0000","last_fullsized":"2024-09-10T04:53:45.984615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.984537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:29.250023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.495405+0000","last_change":"2024-09-10T04:53:28.495317+0000","last_active":"2024-09-10T04:53:28.495405+0000","last_peered":"2024-09-10T04:53:28.495405+0000","last_clean":"2024-09-10T04:53:28.495405+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:53:28.495405+0000","last_undegraded":"2024-09-10T04:53:28.495405+0000","last_fullsized":"2024-09-10T04:53:28.495405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.495201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:10.015044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.088894+0000","last_change":"2024-09-10T04:53:32.088819+0000","last_active":"2024-09-10T04:53:32.088894+0000","last_peered":"2024-09-10T04:53:32.088894+0000","last_clean":"2024-09-10T04:53:32.088894+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:53:32.088894+0000","last_undegraded":"2024-09-10T04:53:32.088894+0000","last_fullsized":"2024-09-10T04:53:32.088894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.088738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:21.007330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.323181+0000","last_change":"2024-09-10T04:53:55.323181+0000","last_active":"2024-09-10T04:53:55.323181+0000","last_peered":"2024-09-10T04:53:55.323181+0000","last_clean":"2024-09-10T04:53:55.323181+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:53:55.323181+0000","last_undegraded":"2024-09-10T04:53:55.323181+0000","last_fullsized":"2024-09-10T04:53:55.323181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.323104+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.158382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.221369+0000","last_change":"2024-09-10T04:54:01.221369+0000","last_active":"2024-09-10T04:54:01.221369+0000","last_peered":"2024-09-10T04:54:01.221369+0000","last_clean":"2024-09-10T04:54:01.221369+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:54:01.221369+0000","last_undegraded":"2024-09-10T04:54:01.221369+0000","last_fullsized":"2024-09-10T04:54:01.221369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.221267+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:02.683817+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:23.225866+0000","last_change":"2024-09-10T04:50:16.855308+0000","last_active":"2024-09-10T04:52:23.225866+0000","last_peered":"2024-09-10T04:52:23.225866+0000","last_clean":"2024-09-10T04:52:23.225866+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:52:23.225866+0000","last_undegraded":"2024-09-10T04:52:23.225866+0000","last_fullsized":"2024-09-10T04:52:23.225866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:50.612686+0000","last_change":"2024-09-10T04:50:18.861373+0000","last_active":"2024-09-10T04:50:50.612686+0000","last_peered":"2024-09-10T04:50:50.612686+0000","last_clean":"2024-09-10T04:50:50.612686+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:50:50.612686+0000","last_undegraded":"2024-09-10T04:50:50.612686+0000","last_fullsized":"2024-09-10T04:50:50.612686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:21.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.992949+0000","last_change":"2024-09-10T04:53:44.992890+0000","last_active":"2024-09-10T04:53:44.992949+0000","last_peered":"2024-09-10T04:53:44.992949+0000","last_clean":"2024-09-10T04:53:44.992949+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:44.992949+0000","last_undegraded":"2024-09-10T04:53:44.992949+0000","last_fullsized":"2024-09-10T04:53:44.992949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.992795+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:39.339709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.729917+0000","last_change":"2024-09-10T04:53:31.729827+0000","last_active":"2024-09-10T04:53:31.729917+0000","last_peered":"2024-09-10T04:53:31.729917+0000","last_clean":"2024-09-10T04:53:31.729917+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:53:31.729917+0000","last_undegraded":"2024-09-10T04:53:31.729917+0000","last_fullsized":"2024-09-10T04:53:31.729917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.729700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:08.937521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.700692+0000","last_change":"2024-09-10T04:53:32.700634+0000","last_active":"2024-09-10T04:53:32.700692+0000","last_peered":"2024-09-10T04:53:32.700692+0000","last_clean":"2024-09-10T04:53:32.700692+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:53:32.700692+0000","last_undegraded":"2024-09-10T04:53:32.700692+0000","last_fullsized":"2024-09-10T04:53:32.700692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.700535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:14.164930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.966557+0000","last_change":"2024-09-10T04:54:02.966484+0000","last_active":"2024-09-10T04:54:02.966557+0000","last_peered":"2024-09-10T04:54:02.966557+0000","last_clean":"2024-09-10T04:54:02.966557+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:54:02.966557+0000","last_undegraded":"2024-09-10T04:54:02.966557+0000","last_fullsized":"2024-09-10T04:54:02.966557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.966403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:09:41.433049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.203976+0000","last_change":"2024-09-10T04:54:15.203976+0000","last_active":"2024-09-10T04:54:15.203976+0000","last_peered":"2024-09-10T04:54:15.203976+0000","last_clean":"2024-09-10T04:54:15.203976+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:54:15.203976+0000","last_undegraded":"2024-09-10T04:54:15.203976+0000","last_fullsized":"2024-09-10T04:54:15.203976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:54:15.203892+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:54:15.203892+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.203892+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:47.717680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:28.146067+0000","last_change":"2024-09-10T04:54:28.146067+0000","last_active":"2024-09-10T04:54:28.146067+0000","last_peered":"2024-09-10T04:54:28.146067+0000","last_clean":"2024-09-10T04:54:28.146067+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:54:28.146067+0000","last_undegraded":"2024-09-10T04:54:28.146067+0000","last_fullsized":"2024-09-10T04:54:28.146067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:28.145983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:28.145983+0000","last_clean_scrub_stamp":"2024-09-10T04:54:28.145983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:00.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.865516+0000","last_change":"2024-09-10T04:54:25.865516+0000","last_active":"2024-09-10T04:54:25.865516+0000","last_peered":"2024-09-10T04:54:25.865516+0000","last_clean":"2024-09-10T04:54:25.865516+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:54:25.865516+0000","last_undegraded":"2024-09-10T04:54:25.865516+0000","last_fullsized":"2024-09-10T04:54:25.865516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:25.865409+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:25.865409+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.865409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:47.315881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.983754+0000","last_change":"2024-09-10T04:53:43.983700+0000","last_active":"2024-09-10T04:53:43.983754+0000","last_peered":"2024-09-10T04:53:43.983754+0000","last_clean":"2024-09-10T04:53:43.983754+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:53:43.983754+0000","last_undegraded":"2024-09-10T04:53:43.983754+0000","last_fullsized":"2024-09-10T04:53:43.983754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.983610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:36.479094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.659336+0000","last_change":"2024-09-10T04:53:35.659260+0000","last_active":"2024-09-10T04:53:35.659336+0000","last_peered":"2024-09-10T04:53:35.659336+0000","last_clean":"2024-09-10T04:53:35.659336+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:53:35.659336+0000","last_undegraded":"2024-09-10T04:53:35.659336+0000","last_fullsized":"2024-09-10T04:53:35.659336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.659161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:32.447113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.041864+0000","last_change":"2024-09-10T04:53:30.041761+0000","last_active":"2024-09-10T04:53:30.041864+0000","last_peered":"2024-09-10T04:53:30.041864+0000","last_clean":"2024-09-10T04:53:30.041864+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:53:30.041864+0000","last_undegraded":"2024-09-10T04:53:30.041864+0000","last_fullsized":"2024-09-10T04:53:30.041864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.041666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:16.050227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.325588+0000","last_change":"2024-09-10T04:53:54.325503+0000","last_active":"2024-09-10T04:53:54.325588+0000","last_peered":"2024-09-10T04:53:54.325588+0000","last_clean":"2024-09-10T04:53:54.325588+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:53:54.325588+0000","last_undegraded":"2024-09-10T04:53:54.325588+0000","last_fullsized":"2024-09-10T04:53:54.325588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.325397+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:39.140425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'91","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.913710+0000","last_change":"2024-09-10T04:54:11.913647+0000","last_active":"2024-09-10T04:54:11.913710+0000","last_peered":"2024-09-10T04:54:11.913710+0000","last_clean":"2024-09-10T04:54:11.913710+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:54:11.913710+0000","last_undegraded":"2024-09-10T04:54:11.913710+0000","last_fullsized":"2024-09-10T04:54:11.913710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-09-10T04:54:11.913542+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-09-10T04:54:11.913542+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.913542+0000","objects_scrubbed":11,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:03.525146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.746809+0000","last_change":"2024-09-10T04:54:26.746752+0000","last_active":"2024-09-10T04:54:26.746809+0000","last_peered":"2024-09-10T04:54:26.746809+0000","last_clean":"2024-09-10T04:54:26.746809+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:54:26.746809+0000","last_undegraded":"2024-09-10T04:54:26.746809+0000","last_fullsized":"2024-09-10T04:54:26.746809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:26.746660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:26.746660+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.746660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:18.621648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.179369+0000","last_change":"2024-09-10T04:54:16.179369+0000","last_active":"2024-09-10T04:54:16.179369+0000","last_peered":"2024-09-10T04:54:16.179369+0000","last_clean":"2024-09-10T04:54:16.179369+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:54:16.179369+0000","last_undegraded":"2024-09-10T04:54:16.179369+0000","last_fullsized":"2024-09-10T04:54:16.179369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-10T04:54:16.179261+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-10T04:54:16.179261+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.179261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:47.145918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.346585+0000","last_change":"2024-09-10T04:53:39.346585+0000","last_active":"2024-09-10T04:53:39.346585+0000","last_peered":"2024-09-10T04:53:39.346585+0000","last_clean":"2024-09-10T04:53:39.346585+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:53:39.346585+0000","last_undegraded":"2024-09-10T04:53:39.346585+0000","last_fullsized":"2024-09-10T04:53:39.346585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.346475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:40.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.040210+0000","last_change":"2024-09-10T04:53:33.040101+0000","last_active":"2024-09-10T04:53:33.040210+0000","last_peered":"2024-09-10T04:53:33.040210+0000","last_clean":"2024-09-10T04:53:33.040210+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:53:33.040210+0000","last_undegraded":"2024-09-10T04:53:33.040210+0000","last_fullsized":"2024-09-10T04:53:33.040210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.040007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:13.761147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.707521+0000","last_change":"2024-09-10T04:53:29.707464+0000","last_active":"2024-09-10T04:53:29.707521+0000","last_peered":"2024-09-10T04:53:29.707521+0000","last_clean":"2024-09-10T04:53:29.707521+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:53:29.707521+0000","last_undegraded":"2024-09-10T04:53:29.707521+0000","last_fullsized":"2024-09-10T04:53:29.707521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.707394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:41.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.733806+0000","last_change":"2024-09-10T04:54:13.733723+0000","last_active":"2024-09-10T04:54:13.733806+0000","last_peered":"2024-09-10T04:54:13.733806+0000","last_clean":"2024-09-10T04:54:13.733806+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:54:13.733806+0000","last_undegraded":"2024-09-10T04:54:13.733806+0000","last_fullsized":"2024-09-10T04:54:13.733806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:13.733604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:13.733604+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.733604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:46.748933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'28","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.942110+0000","last_change":"2024-09-10T04:54:10.942053+0000","last_active":"2024-09-10T04:54:10.942110+0000","last_peered":"2024-09-10T04:54:10.942110+0000","last_clean":"2024-09-10T04:54:10.942110+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:54:10.942110+0000","last_undegraded":"2024-09-10T04:54:10.942110+0000","last_fullsized":"2024-09-10T04:54:10.942110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-10T04:54:10.941945+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-10T04:54:10.941945+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.941945+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:37:13.031723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.814739+0000","last_change":"2024-09-10T04:54:15.814683+0000","last_active":"2024-09-10T04:54:15.814739+0000","last_peered":"2024-09-10T04:54:15.814739+0000","last_clean":"2024-09-10T04:54:15.814739+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:54:15.814739+0000","last_undegraded":"2024-09-10T04:54:15.814739+0000","last_fullsized":"2024-09-10T04:54:15.814739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:15.814598+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:15.814598+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.814598+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:30.326611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.881249+0000","last_change":"2024-09-10T04:50:18.861409+0000","last_active":"2024-09-10T04:50:48.881249+0000","last_peered":"2024-09-10T04:50:48.881249+0000","last_clean":"2024-09-10T04:50:48.881249+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:50:48.881249+0000","last_undegraded":"2024-09-10T04:50:48.881249+0000","last_fullsized":"2024-09-10T04:50:48.881249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:43.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.239462+0000","last_change":"2024-09-10T04:53:51.239391+0000","last_active":"2024-09-10T04:53:51.239462+0000","last_peered":"2024-09-10T04:53:51.239462+0000","last_clean":"2024-09-10T04:53:51.239462+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:51.239462+0000","last_undegraded":"2024-09-10T04:53:51.239462+0000","last_fullsized":"2024-09-10T04:53:51.239462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.239300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.849486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.288695+0000","last_change":"2024-09-10T04:53:31.288641+0000","last_active":"2024-09-10T04:53:31.288695+0000","last_peered":"2024-09-10T04:53:31.288695+0000","last_clean":"2024-09-10T04:53:31.288695+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:53:31.288695+0000","last_undegraded":"2024-09-10T04:53:31.288695+0000","last_fullsized":"2024-09-10T04:53:31.288695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.288558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:03.075476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.028283+0000","last_change":"2024-09-10T04:53:28.028196+0000","last_active":"2024-09-10T04:53:28.028283+0000","last_peered":"2024-09-10T04:53:28.028283+0000","last_clean":"2024-09-10T04:53:28.028283+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:53:28.028283+0000","last_undegraded":"2024-09-10T04:53:28.028283+0000","last_fullsized":"2024-09-10T04:53:28.028283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.028080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:07.938226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.676464+0000","last_change":"2024-09-10T04:54:06.676385+0000","last_active":"2024-09-10T04:54:06.676464+0000","last_peered":"2024-09-10T04:54:06.676464+0000","last_clean":"2024-09-10T04:54:06.676464+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:54:06.676464+0000","last_undegraded":"2024-09-10T04:54:06.676464+0000","last_fullsized":"2024-09-10T04:54:06.676464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.676303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:14.695269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.209343+0000","last_change":"2024-09-10T04:54:13.209257+0000","last_active":"2024-09-10T04:54:13.209343+0000","last_peered":"2024-09-10T04:54:13.209343+0000","last_clean":"2024-09-10T04:54:13.209343+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:54:13.209343+0000","last_undegraded":"2024-09-10T04:54:13.209343+0000","last_fullsized":"2024-09-10T04:54:13.209343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:54:13.209124+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:54:13.209124+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.209124+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:12.186966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.193848+0000","last_change":"2024-09-10T04:54:25.193788+0000","last_active":"2024-09-10T04:54:25.193848+0000","last_peered":"2024-09-10T04:54:25.193848+0000","last_clean":"2024-09-10T04:54:25.193848+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:54:25.193848+0000","last_undegraded":"2024-09-10T04:54:25.193848+0000","last_fullsized":"2024-09-10T04:54:25.193848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:25.193697+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:25.193697+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.193697+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:17.859887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876422+0000","last_change":"2024-09-10T04:50:18.861267+0000","last_active":"2024-09-10T04:50:48.876422+0000","last_peered":"2024-09-10T04:50:48.876422+0000","last_clean":"2024-09-10T04:50:48.876422+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:50:48.876422+0000","last_undegraded":"2024-09-10T04:50:48.876422+0000","last_fullsized":"2024-09-10T04:50:48.876422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.047359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.367966+0000","last_change":"2024-09-10T04:53:36.367879+0000","last_active":"2024-09-10T04:53:36.367966+0000","last_peered":"2024-09-10T04:53:36.367966+0000","last_clean":"2024-09-10T04:53:36.367966+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:53:36.367966+0000","last_undegraded":"2024-09-10T04:53:36.367966+0000","last_fullsized":"2024-09-10T04:53:36.367966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.367750+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:06.024488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.090445+0000","last_change":"2024-09-10T04:53:34.090383+0000","last_active":"2024-09-10T04:53:34.090445+0000","last_peered":"2024-09-10T04:53:34.090445+0000","last_clean":"2024-09-10T04:53:34.090445+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:53:34.090445+0000","last_undegraded":"2024-09-10T04:53:34.090445+0000","last_fullsized":"2024-09-10T04:53:34.090445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.090296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:53.934110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.721826+0000","last_change":"2024-09-10T04:53:30.721726+0000","last_active":"2024-09-10T04:53:30.721826+0000","last_peered":"2024-09-10T04:53:30.721826+0000","last_clean":"2024-09-10T04:53:30.721826+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:53:30.721826+0000","last_undegraded":"2024-09-10T04:53:30.721826+0000","last_fullsized":"2024-09-10T04:53:30.721826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.721635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:26.199513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.319796+0000","last_change":"2024-09-10T04:54:04.319734+0000","last_active":"2024-09-10T04:54:04.319796+0000","last_peered":"2024-09-10T04:54:04.319796+0000","last_clean":"2024-09-10T04:54:04.319796+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:54:04.319796+0000","last_undegraded":"2024-09-10T04:54:04.319796+0000","last_fullsized":"2024-09-10T04:54:04.319796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.319651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:00.049390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.733922+0000","last_change":"2024-09-10T04:54:16.733861+0000","last_active":"2024-09-10T04:54:16.733922+0000","last_peered":"2024-09-10T04:54:16.733922+0000","last_clean":"2024-09-10T04:54:16.733922+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:54:16.733922+0000","last_undegraded":"2024-09-10T04:54:16.733922+0000","last_fullsized":"2024-09-10T04:54:16.733922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-09-10T04:54:16.733765+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-09-10T04:54:16.733765+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.733765+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:23.445805+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.143909+0000","last_change":"2024-09-10T04:54:24.143839+0000","last_active":"2024-09-10T04:54:24.143909+0000","last_peered":"2024-09-10T04:54:24.143909+0000","last_clean":"2024-09-10T04:54:24.143909+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:54:24.143909+0000","last_undegraded":"2024-09-10T04:54:24.143909+0000","last_fullsized":"2024-09-10T04:54:24.143909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:24.143739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:24.143739+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.143739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.188999+0000","last_change":"2024-09-10T04:54:15.188999+0000","last_active":"2024-09-10T04:54:15.188999+0000","last_peered":"2024-09-10T04:54:15.188999+0000","last_clean":"2024-09-10T04:54:15.188999+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:54:15.188999+0000","last_undegraded":"2024-09-10T04:54:15.188999+0000","last_fullsized":"2024-09-10T04:54:15.188999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:15.188913+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:15.188913+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.188913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:48.553602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.199189+0000","last_change":"2024-09-10T04:54:18.199122+0000","last_active":"2024-09-10T04:54:18.199189+0000","last_peered":"2024-09-10T04:54:18.199189+0000","last_clean":"2024-09-10T04:54:18.199189+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:54:18.199189+0000","last_undegraded":"2024-09-10T04:54:18.199189+0000","last_fullsized":"2024-09-10T04:54:18.199189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:18.199041+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:18.199041+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.199041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:25.990215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.327819+0000","last_change":"2024-09-10T04:53:44.327819+0000","last_active":"2024-09-10T04:53:44.327819+0000","last_peered":"2024-09-10T04:53:44.327819+0000","last_clean":"2024-09-10T04:53:44.327819+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:53:44.327819+0000","last_undegraded":"2024-09-10T04:53:44.327819+0000","last_fullsized":"2024-09-10T04:53:44.327819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.327731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:17.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.678937+0000","last_change":"2024-09-10T04:53:40.678937+0000","last_active":"2024-09-10T04:53:40.678937+0000","last_peered":"2024-09-10T04:53:40.678937+0000","last_clean":"2024-09-10T04:53:40.678937+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:53:40.678937+0000","last_undegraded":"2024-09-10T04:53:40.678937+0000","last_fullsized":"2024-09-10T04:53:40.678937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.678849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:37.929824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.973068+0000","last_change":"2024-09-10T04:54:05.973068+0000","last_active":"2024-09-10T04:54:05.973068+0000","last_peered":"2024-09-10T04:54:05.973068+0000","last_clean":"2024-09-10T04:54:05.973068+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:54:05.973068+0000","last_undegraded":"2024-09-10T04:54:05.973068+0000","last_fullsized":"2024-09-10T04:54:05.973068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.972984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:15.350827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.157546+0000","last_change":"2024-09-10T04:54:17.157546+0000","last_active":"2024-09-10T04:54:17.157546+0000","last_peered":"2024-09-10T04:54:17.157546+0000","last_clean":"2024-09-10T04:54:17.157546+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:54:17.157546+0000","last_undegraded":"2024-09-10T04:54:17.157546+0000","last_fullsized":"2024-09-10T04:54:17.157546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:17.157442+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:17.157442+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.157442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:28.534441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878042+0000","last_change":"2024-09-10T04:50:16.858368+0000","last_active":"2024-09-10T04:50:48.878042+0000","last_peered":"2024-09-10T04:50:48.878042+0000","last_clean":"2024-09-10T04:50:48.878042+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:50:48.878042+0000","last_undegraded":"2024-09-10T04:50:48.878042+0000","last_fullsized":"2024-09-10T04:50:48.878042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.644938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:18.225235+0000","last_change":"2024-09-10T04:50:18.861683+0000","last_active":"2024-09-10T04:52:18.225235+0000","last_peered":"2024-09-10T04:52:18.225235+0000","last_clean":"2024-09-10T04:52:18.225235+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:52:18.225235+0000","last_undegraded":"2024-09-10T04:52:18.225235+0000","last_fullsized":"2024-09-10T04:52:18.225235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.931532+0000","last_change":"2024-09-10T04:53:49.931532+0000","last_active":"2024-09-10T04:53:49.931532+0000","last_peered":"2024-09-10T04:53:49.931532+0000","last_clean":"2024-09-10T04:53:49.931532+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:53:49.931532+0000","last_undegraded":"2024-09-10T04:53:49.931532+0000","last_fullsized":"2024-09-10T04:53:49.931532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.931431+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:29.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.418743+0000","last_change":"2024-09-10T04:53:32.418743+0000","last_active":"2024-09-10T04:53:32.418743+0000","last_peered":"2024-09-10T04:53:32.418743+0000","last_clean":"2024-09-10T04:53:32.418743+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:53:32.418743+0000","last_undegraded":"2024-09-10T04:53:32.418743+0000","last_fullsized":"2024-09-10T04:53:32.418743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.418643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:14.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.274686+0000","last_change":"2024-09-10T04:54:09.274686+0000","last_active":"2024-09-10T04:54:09.274686+0000","last_peered":"2024-09-10T04:54:09.274686+0000","last_clean":"2024-09-10T04:54:09.274686+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:54:09.274686+0000","last_undegraded":"2024-09-10T04:54:09.274686+0000","last_fullsized":"2024-09-10T04:54:09.274686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.274599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.274599+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.274599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:31.066695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.889775+0000","last_change":"2024-09-10T04:54:13.889775+0000","last_active":"2024-09-10T04:54:13.889775+0000","last_peered":"2024-09-10T04:54:13.889775+0000","last_clean":"2024-09-10T04:54:13.889775+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:54:13.889775+0000","last_undegraded":"2024-09-10T04:54:13.889775+0000","last_fullsized":"2024-09-10T04:54:13.889775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:54:13.889666+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:54:13.889666+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.889666+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:58.288079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.281435+0000","last_change":"2024-09-10T04:54:07.281435+0000","last_active":"2024-09-10T04:54:07.281435+0000","last_peered":"2024-09-10T04:54:07.281435+0000","last_clean":"2024-09-10T04:54:07.281435+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:54:07.281435+0000","last_undegraded":"2024-09-10T04:54:07.281435+0000","last_fullsized":"2024-09-10T04:54:07.281435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.281348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:08.478561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.876266+0000","last_change":"2024-09-10T04:50:18.860947+0000","last_active":"2024-09-10T04:50:48.876266+0000","last_peered":"2024-09-10T04:50:48.876266+0000","last_clean":"2024-09-10T04:50:48.876266+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:50:48.876266+0000","last_undegraded":"2024-09-10T04:50:48.876266+0000","last_fullsized":"2024-09-10T04:50:48.876266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:35.424926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.259529+0000","last_change":"2024-09-10T04:53:54.259529+0000","last_active":"2024-09-10T04:53:54.259529+0000","last_peered":"2024-09-10T04:53:54.259529+0000","last_clean":"2024-09-10T04:53:54.259529+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:53:54.259529+0000","last_undegraded":"2024-09-10T04:53:54.259529+0000","last_fullsized":"2024-09-10T04:53:54.259529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.259447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:58:47.873888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.663976+0000","last_change":"2024-09-10T04:53:42.663976+0000","last_active":"2024-09-10T04:53:42.663976+0000","last_peered":"2024-09-10T04:53:42.663976+0000","last_clean":"2024-09-10T04:53:42.663976+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:53:42.663976+0000","last_undegraded":"2024-09-10T04:53:42.663976+0000","last_fullsized":"2024-09-10T04:53:42.663976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.663888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.429104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.670824+0000","last_change":"2024-09-10T04:54:09.670824+0000","last_active":"2024-09-10T04:54:09.670824+0000","last_peered":"2024-09-10T04:54:09.670824+0000","last_clean":"2024-09-10T04:54:09.670824+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:54:09.670824+0000","last_undegraded":"2024-09-10T04:54:09.670824+0000","last_fullsized":"2024-09-10T04:54:09.670824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.670742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.670742+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.670742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.632640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.140792+0000","last_change":"2024-09-10T04:54:19.140792+0000","last_active":"2024-09-10T04:54:19.140792+0000","last_peered":"2024-09-10T04:54:19.140792+0000","last_clean":"2024-09-10T04:54:19.140792+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:54:19.140792+0000","last_undegraded":"2024-09-10T04:54:19.140792+0000","last_fullsized":"2024-09-10T04:54:19.140792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-10T04:54:19.140703+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-10T04:54:19.140703+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.140703+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:09.102846+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.890101+0000","last_change":"2024-09-10T04:54:18.890101+0000","last_active":"2024-09-10T04:54:18.890101+0000","last_peered":"2024-09-10T04:54:18.890101+0000","last_clean":"2024-09-10T04:54:18.890101+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:54:18.890101+0000","last_undegraded":"2024-09-10T04:54:18.890101+0000","last_fullsized":"2024-09-10T04:54:18.890101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:18.889996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:18.889996+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.889996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:37.585283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.883335+0000","last_change":"2024-09-10T04:50:18.851278+0000","last_active":"2024-09-10T04:50:48.883335+0000","last_peered":"2024-09-10T04:50:48.883335+0000","last_clean":"2024-09-10T04:50:48.883335+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:50:48.883335+0000","last_undegraded":"2024-09-10T04:50:48.883335+0000","last_fullsized":"2024-09-10T04:50:48.883335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:58.181409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.253060+0000","last_change":"2024-09-10T04:53:53.253060+0000","last_active":"2024-09-10T04:53:53.253060+0000","last_peered":"2024-09-10T04:53:53.253060+0000","last_clean":"2024-09-10T04:53:53.253060+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:53.253060+0000","last_undegraded":"2024-09-10T04:53:53.253060+0000","last_fullsized":"2024-09-10T04:53:53.253060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.252977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:43.553993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.053335+0000","last_change":"2024-09-10T04:53:35.053335+0000","last_active":"2024-09-10T04:53:35.053335+0000","last_peered":"2024-09-10T04:53:35.053335+0000","last_clean":"2024-09-10T04:53:35.053335+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:35.053335+0000","last_undegraded":"2024-09-10T04:53:35.053335+0000","last_fullsized":"2024-09-10T04:53:35.053335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.053227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:06:46.229845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.296474+0000","last_change":"2024-09-10T04:54:08.296474+0000","last_active":"2024-09-10T04:54:08.296474+0000","last_peered":"2024-09-10T04:54:08.296474+0000","last_clean":"2024-09-10T04:54:08.296474+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:54:08.296474+0000","last_undegraded":"2024-09-10T04:54:08.296474+0000","last_fullsized":"2024-09-10T04:54:08.296474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:08.296376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:08.296376+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.296376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:47.645096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.771738+0000","last_change":"2024-09-10T04:54:23.771738+0000","last_active":"2024-09-10T04:54:23.771738+0000","last_peered":"2024-09-10T04:54:23.771738+0000","last_clean":"2024-09-10T04:54:23.771738+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:54:23.771738+0000","last_undegraded":"2024-09-10T04:54:23.771738+0000","last_fullsized":"2024-09-10T04:54:23.771738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-10T04:54:23.771652+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-10T04:54:23.771652+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.771652+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.885094+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.254311+0000","last_change":"2024-09-10T04:54:09.254311+0000","last_active":"2024-09-10T04:54:09.254311+0000","last_peered":"2024-09-10T04:54:09.254311+0000","last_clean":"2024-09-10T04:54:09.254311+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:54:09.254311+0000","last_undegraded":"2024-09-10T04:54:09.254311+0000","last_fullsized":"2024-09-10T04:54:09.254311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.254218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.254218+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.254218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:34.958521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.682970+0000","last_change":"2024-09-10T04:53:54.682910+0000","last_active":"2024-09-10T04:53:54.682970+0000","last_peered":"2024-09-10T04:53:54.682970+0000","last_clean":"2024-09-10T04:53:54.682970+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:53:54.682970+0000","last_undegraded":"2024-09-10T04:53:54.682970+0000","last_fullsized":"2024-09-10T04:53:54.682970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.682823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.194837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.318043+0000","last_change":"2024-09-10T04:53:33.318043+0000","last_active":"2024-09-10T04:53:33.318043+0000","last_peered":"2024-09-10T04:53:33.318043+0000","last_clean":"2024-09-10T04:53:33.318043+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:53:33.318043+0000","last_undegraded":"2024-09-10T04:53:33.318043+0000","last_fullsized":"2024-09-10T04:53:33.318043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.317954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:35.852351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.935671+0000","last_change":"2024-09-10T04:54:09.935623+0000","last_active":"2024-09-10T04:54:09.935671+0000","last_peered":"2024-09-10T04:54:09.935671+0000","last_clean":"2024-09-10T04:54:09.935671+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:54:09.935671+0000","last_undegraded":"2024-09-10T04:54:09.935671+0000","last_fullsized":"2024-09-10T04:54:09.935671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.935535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.935535+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.935535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:21.382944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'74","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.864560+0000","last_change":"2024-09-10T04:54:16.864560+0000","last_active":"2024-09-10T04:54:16.864560+0000","last_peered":"2024-09-10T04:54:16.864560+0000","last_clean":"2024-09-10T04:54:16.864560+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:54:16.864560+0000","last_undegraded":"2024-09-10T04:54:16.864560+0000","last_fullsized":"2024-09-10T04:54:16.864560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:54:16.864480+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:54:16.864480+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.864480+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:23.512175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":84,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.225383+0000","last_change":"2024-09-10T04:54:11.225383+0000","last_active":"2024-09-10T04:54:11.225383+0000","last_peered":"2024-09-10T04:54:11.225383+0000","last_clean":"2024-09-10T04:54:11.225383+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:54:11.225383+0000","last_undegraded":"2024-09-10T04:54:11.225383+0000","last_fullsized":"2024-09-10T04:54:11.225383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.225284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.225284+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.225284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.952541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.232557+0000","last_change":"2024-09-10T04:50:18.861081+0000","last_active":"2024-09-10T04:52:17.232557+0000","last_peered":"2024-09-10T04:52:17.232557+0000","last_clean":"2024-09-10T04:52:17.232557+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:52:17.232557+0000","last_undegraded":"2024-09-10T04:52:17.232557+0000","last_fullsized":"2024-09-10T04:52:17.232557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:30.015478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.940166+0000","last_change":"2024-09-10T04:53:50.940056+0000","last_active":"2024-09-10T04:53:50.940166+0000","last_peered":"2024-09-10T04:53:50.940166+0000","last_clean":"2024-09-10T04:53:50.940166+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:50.940166+0000","last_undegraded":"2024-09-10T04:53:50.940166+0000","last_fullsized":"2024-09-10T04:53:50.940166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.939961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:20.889446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.010426+0000","last_change":"2024-09-10T04:53:36.010426+0000","last_active":"2024-09-10T04:53:36.010426+0000","last_peered":"2024-09-10T04:53:36.010426+0000","last_clean":"2024-09-10T04:53:36.010426+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:53:36.010426+0000","last_undegraded":"2024-09-10T04:53:36.010426+0000","last_fullsized":"2024-09-10T04:53:36.010426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.010317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:47.997647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.732097+0000","last_change":"2024-09-10T04:54:15.731997+0000","last_active":"2024-09-10T04:54:15.732097+0000","last_peered":"2024-09-10T04:54:15.732097+0000","last_clean":"2024-09-10T04:54:15.732097+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:54:15.732097+0000","last_undegraded":"2024-09-10T04:54:15.732097+0000","last_fullsized":"2024-09-10T04:54:15.732097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:15.731881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:15.731881+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.731881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:50.953318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'47","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.780646+0000","last_change":"2024-09-10T04:54:25.780646+0000","last_active":"2024-09-10T04:54:25.780646+0000","last_peered":"2024-09-10T04:54:25.780646+0000","last_clean":"2024-09-10T04:54:25.780646+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:54:25.780646+0000","last_undegraded":"2024-09-10T04:54:25.780646+0000","last_fullsized":"2024-09-10T04:54:25.780646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:25.780535+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:25.780535+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.780535+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:09.031462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.900902+0000","last_change":"2024-09-10T04:54:20.900902+0000","last_active":"2024-09-10T04:54:20.900902+0000","last_peered":"2024-09-10T04:54:20.900902+0000","last_clean":"2024-09-10T04:54:20.900902+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:54:20.900902+0000","last_undegraded":"2024-09-10T04:54:20.900902+0000","last_fullsized":"2024-09-10T04:54:20.900902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:20.900811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:20.900811+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.900811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:25.373378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874531+0000","last_change":"2024-09-10T04:50:18.853744+0000","last_active":"2024-09-10T04:50:48.874531+0000","last_peered":"2024-09-10T04:50:48.874531+0000","last_clean":"2024-09-10T04:50:48.874531+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:50:48.874531+0000","last_undegraded":"2024-09-10T04:50:48.874531+0000","last_fullsized":"2024-09-10T04:50:48.874531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:26.707789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.241125+0000","last_change":"2024-09-10T04:53:59.241125+0000","last_active":"2024-09-10T04:53:59.241125+0000","last_peered":"2024-09-10T04:53:59.241125+0000","last_clean":"2024-09-10T04:53:59.241125+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:53:59.241125+0000","last_undegraded":"2024-09-10T04:53:59.241125+0000","last_fullsized":"2024-09-10T04:53:59.241125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.241037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:07.535256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.710481+0000","last_change":"2024-09-10T04:53:48.710481+0000","last_active":"2024-09-10T04:53:48.710481+0000","last_peered":"2024-09-10T04:53:48.710481+0000","last_clean":"2024-09-10T04:53:48.710481+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:53:48.710481+0000","last_undegraded":"2024-09-10T04:53:48.710481+0000","last_fullsized":"2024-09-10T04:53:48.710481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.710387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:16.041423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.735814+0000","last_change":"2024-09-10T04:54:12.735814+0000","last_active":"2024-09-10T04:54:12.735814+0000","last_peered":"2024-09-10T04:54:12.735814+0000","last_clean":"2024-09-10T04:54:12.735814+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:54:12.735814+0000","last_undegraded":"2024-09-10T04:54:12.735814+0000","last_fullsized":"2024-09-10T04:54:12.735814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:12.735703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:12.735703+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.735703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:09.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.195700+0000","last_change":"2024-09-10T04:54:23.195615+0000","last_active":"2024-09-10T04:54:23.195700+0000","last_peered":"2024-09-10T04:54:23.195700+0000","last_clean":"2024-09-10T04:54:23.195700+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:54:23.195700+0000","last_undegraded":"2024-09-10T04:54:23.195700+0000","last_fullsized":"2024-09-10T04:54:23.195700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:23.195495+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:23.195495+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.195495+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:29.620016+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.936024+0000","last_change":"2024-09-10T04:54:19.936024+0000","last_active":"2024-09-10T04:54:19.936024+0000","last_peered":"2024-09-10T04:54:19.936024+0000","last_clean":"2024-09-10T04:54:19.936024+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:54:19.936024+0000","last_undegraded":"2024-09-10T04:54:19.936024+0000","last_fullsized":"2024-09-10T04:54:19.936024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:19.935940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:19.935940+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.935940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:52.515529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:17.292564+0000","last_change":"2024-09-10T04:50:18.854116+0000","last_active":"2024-09-10T04:52:17.292564+0000","last_peered":"2024-09-10T04:52:17.292564+0000","last_clean":"2024-09-10T04:52:17.292564+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:52:17.292564+0000","last_undegraded":"2024-09-10T04:52:17.292564+0000","last_fullsized":"2024-09-10T04:52:17.292564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:56.222176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.340290+0000","last_change":"2024-09-10T04:53:46.340290+0000","last_active":"2024-09-10T04:53:46.340290+0000","last_peered":"2024-09-10T04:53:46.340290+0000","last_clean":"2024-09-10T04:53:46.340290+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:46.340290+0000","last_undegraded":"2024-09-10T04:53:46.340290+0000","last_fullsized":"2024-09-10T04:53:46.340290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.340190+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:49.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.375559+0000","last_change":"2024-09-10T04:53:37.375559+0000","last_active":"2024-09-10T04:53:37.375559+0000","last_peered":"2024-09-10T04:53:37.375559+0000","last_clean":"2024-09-10T04:53:37.375559+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:53:37.375559+0000","last_undegraded":"2024-09-10T04:53:37.375559+0000","last_fullsized":"2024-09-10T04:53:37.375559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.375475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:54.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.961410+0000","last_change":"2024-09-10T04:54:08.961410+0000","last_active":"2024-09-10T04:54:08.961410+0000","last_peered":"2024-09-10T04:54:08.961410+0000","last_clean":"2024-09-10T04:54:08.961410+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:54:08.961410+0000","last_undegraded":"2024-09-10T04:54:08.961410+0000","last_fullsized":"2024-09-10T04:54:08.961410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:08.961321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:08.961321+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.961321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:33.180605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.196771+0000","last_change":"2024-09-10T04:54:22.196771+0000","last_active":"2024-09-10T04:54:22.196771+0000","last_peered":"2024-09-10T04:54:22.196771+0000","last_clean":"2024-09-10T04:54:22.196771+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:54:22.196771+0000","last_undegraded":"2024-09-10T04:54:22.196771+0000","last_fullsized":"2024-09-10T04:54:22.196771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:54:22.196672+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:54:22.196672+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.196672+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:29.908527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.659026+0000","last_change":"2024-09-10T04:50:16.847126+0000","last_active":"2024-09-10T04:53:24.659026+0000","last_peered":"2024-09-10T04:53:24.659026+0000","last_clean":"2024-09-10T04:53:24.659026+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:53:24.659026+0000","last_undegraded":"2024-09-10T04:53:24.659026+0000","last_fullsized":"2024-09-10T04:53:24.659026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:51:33.729922+0000","last_change":"2024-09-10T04:50:18.859827+0000","last_active":"2024-09-10T04:51:33.729922+0000","last_peered":"2024-09-10T04:51:33.729922+0000","last_clean":"2024-09-10T04:51:33.729922+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:51:33.729922+0000","last_undegraded":"2024-09-10T04:51:33.729922+0000","last_fullsized":"2024-09-10T04:51:33.729922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:57:57.273020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.310068+0000","last_change":"2024-09-10T04:53:45.310068+0000","last_active":"2024-09-10T04:53:45.310068+0000","last_peered":"2024-09-10T04:53:45.310068+0000","last_clean":"2024-09-10T04:53:45.310068+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:53:45.310068+0000","last_undegraded":"2024-09-10T04:53:45.310068+0000","last_fullsized":"2024-09-10T04:53:45.310068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.309974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.962640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.966331+0000","last_change":"2024-09-10T04:53:36.966331+0000","last_active":"2024-09-10T04:53:36.966331+0000","last_peered":"2024-09-10T04:53:36.966331+0000","last_clean":"2024-09-10T04:53:36.966331+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:53:36.966331+0000","last_undegraded":"2024-09-10T04:53:36.966331+0000","last_fullsized":"2024-09-10T04:53:36.966331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.966245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.697203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.975729+0000","last_change":"2024-09-10T04:54:07.975729+0000","last_active":"2024-09-10T04:54:07.975729+0000","last_peered":"2024-09-10T04:54:07.975729+0000","last_clean":"2024-09-10T04:54:07.975729+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:54:07.975729+0000","last_undegraded":"2024-09-10T04:54:07.975729+0000","last_fullsized":"2024-09-10T04:54:07.975729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.975638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:37.274445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.812984+0000","last_change":"2024-09-10T04:54:22.812984+0000","last_active":"2024-09-10T04:54:22.812984+0000","last_peered":"2024-09-10T04:54:22.812984+0000","last_clean":"2024-09-10T04:54:22.812984+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:54:22.812984+0000","last_undegraded":"2024-09-10T04:54:22.812984+0000","last_fullsized":"2024-09-10T04:54:22.812984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-09-10T04:54:22.812877+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-09-10T04:54:22.812877+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.812877+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:47.162758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.880184+0000","last_change":"2024-09-10T04:50:16.847731+0000","last_active":"2024-09-10T04:50:48.880184+0000","last_peered":"2024-09-10T04:50:48.880184+0000","last_clean":"2024-09-10T04:50:48.880184+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:50:48.880184+0000","last_undegraded":"2024-09-10T04:50:48.880184+0000","last_fullsized":"2024-09-10T04:50:48.880184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:06.142098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.878274+0000","last_change":"2024-09-10T04:50:18.854706+0000","last_active":"2024-09-10T04:50:48.878274+0000","last_peered":"2024-09-10T04:50:48.878274+0000","last_clean":"2024-09-10T04:50:48.878274+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:50:48.878274+0000","last_undegraded":"2024-09-10T04:50:48.878274+0000","last_fullsized":"2024-09-10T04:50:48.878274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:31.676893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.695353+0000","last_change":"2024-09-10T04:53:55.695353+0000","last_active":"2024-09-10T04:53:55.695353+0000","last_peered":"2024-09-10T04:53:55.695353+0000","last_clean":"2024-09-10T04:53:55.695353+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:55.695353+0000","last_undegraded":"2024-09-10T04:53:55.695353+0000","last_fullsized":"2024-09-10T04:53:55.695353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.695256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:02.342950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.701876+0000","last_change":"2024-09-10T04:53:43.701876+0000","last_active":"2024-09-10T04:53:43.701876+0000","last_peered":"2024-09-10T04:53:43.701876+0000","last_clean":"2024-09-10T04:53:43.701876+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:53:43.701876+0000","last_undegraded":"2024-09-10T04:53:43.701876+0000","last_fullsized":"2024-09-10T04:53:43.701876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.701760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:03.638962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.758338+0000","last_change":"2024-09-10T04:54:11.758338+0000","last_active":"2024-09-10T04:54:11.758338+0000","last_peered":"2024-09-10T04:54:11.758338+0000","last_clean":"2024-09-10T04:54:11.758338+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:54:11.758338+0000","last_undegraded":"2024-09-10T04:54:11.758338+0000","last_fullsized":"2024-09-10T04:54:11.758338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.758248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.758248+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.758248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:02.430783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.202766+0000","last_change":"2024-09-10T04:54:04.202766+0000","last_active":"2024-09-10T04:54:04.202766+0000","last_peered":"2024-09-10T04:54:04.202766+0000","last_clean":"2024-09-10T04:54:04.202766+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:54:04.202766+0000","last_undegraded":"2024-09-10T04:54:04.202766+0000","last_fullsized":"2024-09-10T04:54:04.202766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.202664+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:51.889203+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.874334+0000","last_change":"2024-09-10T04:50:16.847997+0000","last_active":"2024-09-10T04:50:48.874334+0000","last_peered":"2024-09-10T04:50:48.874334+0000","last_clean":"2024-09-10T04:50:48.874334+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:50:48.874334+0000","last_undegraded":"2024-09-10T04:50:48.874334+0000","last_fullsized":"2024-09-10T04:50:48.874334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:36:05.098757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:18.023691+0000","last_change":"2024-09-10T04:50:18.862677+0000","last_active":"2024-09-10T04:53:18.023691+0000","last_peered":"2024-09-10T04:53:18.023691+0000","last_clean":"2024-09-10T04:53:18.023691+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:53:18.023691+0000","last_undegraded":"2024-09-10T04:53:18.023691+0000","last_fullsized":"2024-09-10T04:53:18.023691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:31.633640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.284384+0000","last_change":"2024-09-10T04:54:00.284384+0000","last_active":"2024-09-10T04:54:00.284384+0000","last_peered":"2024-09-10T04:54:00.284384+0000","last_clean":"2024-09-10T04:54:00.284384+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:54:00.284384+0000","last_undegraded":"2024-09-10T04:54:00.284384+0000","last_fullsized":"2024-09-10T04:54:00.284384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.284291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.338885+0000","last_change":"2024-09-10T04:53:36.338818+0000","last_active":"2024-09-10T04:53:36.338885+0000","last_peered":"2024-09-10T04:53:36.338885+0000","last_clean":"2024-09-10T04:53:36.338885+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:53:36.338885+0000","last_undegraded":"2024-09-10T04:53:36.338885+0000","last_fullsized":"2024-09-10T04:53:36.338885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.338731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:42.753949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.956604+0000","last_change":"2024-09-10T04:54:06.956604+0000","last_active":"2024-09-10T04:54:06.956604+0000","last_peered":"2024-09-10T04:54:06.956604+0000","last_clean":"2024-09-10T04:54:06.956604+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:54:06.956604+0000","last_undegraded":"2024-09-10T04:54:06.956604+0000","last_fullsized":"2024-09-10T04:54:06.956604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.956506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:54.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'39","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.150790+0000","last_change":"2024-09-10T04:54:21.150790+0000","last_active":"2024-09-10T04:54:21.150790+0000","last_peered":"2024-09-10T04:54:21.150790+0000","last_clean":"2024-09-10T04:54:21.150790+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:54:21.150790+0000","last_undegraded":"2024-09-10T04:54:21.150790+0000","last_fullsized":"2024-09-10T04:54:21.150790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-10T04:54:21.150706+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-10T04:54:21.150706+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.150706+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:46.975486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:50:48.875218+0000","last_change":"2024-09-10T04:50:16.844914+0000","last_active":"2024-09-10T04:50:48.875218+0000","last_peered":"2024-09-10T04:50:48.875218+0000","last_clean":"2024-09-10T04:50:48.875218+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:50:48.875218+0000","last_undegraded":"2024-09-10T04:50:48.875218+0000","last_fullsized":"2024-09-10T04:50:48.875218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:15.824108+0000","last_clean_scrub_stamp":"2024-09-10T04:50:15.824108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:38.248889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.857715+0000","last_change":"2024-09-10T04:50:18.860527+0000","last_active":"2024-09-10T04:52:15.857715+0000","last_peered":"2024-09-10T04:52:15.857715+0000","last_clean":"2024-09-10T04:52:15.857715+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:52:15.857715+0000","last_undegraded":"2024-09-10T04:52:15.857715+0000","last_fullsized":"2024-09-10T04:52:15.857715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:14.569391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.326879+0000","last_change":"2024-09-10T04:53:43.326879+0000","last_active":"2024-09-10T04:53:43.326879+0000","last_peered":"2024-09-10T04:53:43.326879+0000","last_clean":"2024-09-10T04:53:43.326879+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:43.326879+0000","last_undegraded":"2024-09-10T04:53:43.326879+0000","last_fullsized":"2024-09-10T04:53:43.326879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.326755+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:11.173395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.936469+0000","last_change":"2024-09-10T04:53:37.936400+0000","last_active":"2024-09-10T04:53:37.936469+0000","last_peered":"2024-09-10T04:53:37.936469+0000","last_clean":"2024-09-10T04:53:37.936469+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:53:37.936469+0000","last_undegraded":"2024-09-10T04:53:37.936469+0000","last_fullsized":"2024-09-10T04:53:37.936469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.936312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:39.782085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.264435+0000","last_change":"2024-09-10T04:53:59.264435+0000","last_active":"2024-09-10T04:53:59.264435+0000","last_peered":"2024-09-10T04:53:59.264435+0000","last_clean":"2024-09-10T04:53:59.264435+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:53:59.264435+0000","last_undegraded":"2024-09-10T04:53:59.264435+0000","last_fullsized":"2024-09-10T04:53:59.264435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.264356+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:40.322391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:24.547057+0000","last_change":"2024-09-10T04:50:14.834213+0000","last_active":"2024-09-10T04:53:24.547057+0000","last_peered":"2024-09-10T04:53:24.547057+0000","last_clean":"2024-09-10T04:53:24.547057+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:53:24.547057+0000","last_undegraded":"2024-09-10T04:53:24.547057+0000","last_fullsized":"2024-09-10T04:53:24.547057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:13.817590+0000","last_clean_scrub_stamp":"2024-09-10T04:50:13.817590+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:03.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.216554+0000","last_change":"2024-09-10T04:54:10.216554+0000","last_active":"2024-09-10T04:54:10.216554+0000","last_peered":"2024-09-10T04:54:10.216554+0000","last_clean":"2024-09-10T04:54:10.216554+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:54:10.216554+0000","last_undegraded":"2024-09-10T04:54:10.216554+0000","last_fullsized":"2024-09-10T04:54:10.216554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.216468+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:34.427258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:52:15.860667+0000","last_change":"2024-09-10T04:50:18.855708+0000","last_active":"2024-09-10T04:52:15.860667+0000","last_peered":"2024-09-10T04:52:15.860667+0000","last_clean":"2024-09-10T04:52:15.860667+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:52:15.860667+0000","last_undegraded":"2024-09-10T04:52:15.860667+0000","last_fullsized":"2024-09-10T04:52:15.860667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:50:17.836264+0000","last_clean_scrub_stamp":"2024-09-10T04:50:17.836264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:21.831402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.999128+0000","last_change":"2024-09-10T04:53:54.999128+0000","last_active":"2024-09-10T04:53:54.999128+0000","last_peered":"2024-09-10T04:53:54.999128+0000","last_clean":"2024-09-10T04:53:54.999128+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:53:54.999128+0000","last_undegraded":"2024-09-10T04:53:54.999128+0000","last_fullsized":"2024-09-10T04:53:54.999128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.999005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.463400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.409803+0000","last_change":"2024-09-10T04:53:33.409733+0000","last_active":"2024-09-10T04:53:33.409803+0000","last_peered":"2024-09-10T04:53:33.409803+0000","last_clean":"2024-09-10T04:53:33.409803+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:53:33.409803+0000","last_undegraded":"2024-09-10T04:53:33.409803+0000","last_fullsized":"2024-09-10T04:53:33.409803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.409644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:22.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.013389+0000","last_change":"2024-09-10T04:53:54.013389+0000","last_active":"2024-09-10T04:53:54.013389+0000","last_peered":"2024-09-10T04:53:54.013389+0000","last_clean":"2024-09-10T04:53:54.013389+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:53:54.013389+0000","last_undegraded":"2024-09-10T04:53:54.013389+0000","last_fullsized":"2024-09-10T04:53:54.013389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.013284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:19.182546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.459667+0000","last_change":"2024-09-10T04:53:29.459612+0000","last_active":"2024-09-10T04:53:29.459667+0000","last_peered":"2024-09-10T04:53:29.459667+0000","last_clean":"2024-09-10T04:53:29.459667+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:53:29.459667+0000","last_undegraded":"2024-09-10T04:53:29.459667+0000","last_fullsized":"2024-09-10T04:53:29.459667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.459526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.879419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.658574+0000","last_change":"2024-09-10T04:54:03.658574+0000","last_active":"2024-09-10T04:54:03.658574+0000","last_peered":"2024-09-10T04:54:03.658574+0000","last_clean":"2024-09-10T04:54:03.658574+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:54:03.658574+0000","last_undegraded":"2024-09-10T04:54:03.658574+0000","last_fullsized":"2024-09-10T04:54:03.658574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.658476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:36.820167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.374437+0000","last_change":"2024-09-10T04:53:40.374381+0000","last_active":"2024-09-10T04:53:40.374437+0000","last_peered":"2024-09-10T04:53:40.374437+0000","last_clean":"2024-09-10T04:53:40.374437+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:53:40.374437+0000","last_undegraded":"2024-09-10T04:53:40.374437+0000","last_fullsized":"2024-09-10T04:53:40.374437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.374287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:13:03.190933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.019068+0000","last_change":"2024-09-10T04:53:53.019068+0000","last_active":"2024-09-10T04:53:53.019068+0000","last_peered":"2024-09-10T04:53:53.019068+0000","last_clean":"2024-09-10T04:53:53.019068+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:53:53.019068+0000","last_undegraded":"2024-09-10T04:53:53.019068+0000","last_fullsized":"2024-09-10T04:53:53.019068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.018985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:48.496863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.460613+0000","last_change":"2024-09-10T04:53:31.460543+0000","last_active":"2024-09-10T04:53:31.460613+0000","last_peered":"2024-09-10T04:53:31.460613+0000","last_clean":"2024-09-10T04:53:31.460613+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:31.460613+0000","last_undegraded":"2024-09-10T04:53:31.460613+0000","last_fullsized":"2024-09-10T04:53:31.460613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.460459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.855491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.356607+0000","last_change":"2024-09-10T04:54:02.356550+0000","last_active":"2024-09-10T04:54:02.356607+0000","last_peered":"2024-09-10T04:54:02.356607+0000","last_clean":"2024-09-10T04:54:02.356607+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:54:02.356607+0000","last_undegraded":"2024-09-10T04:54:02.356607+0000","last_fullsized":"2024-09-10T04:54:02.356607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.356435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:14.828280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.374890+0000","last_change":"2024-09-10T04:53:38.374822+0000","last_active":"2024-09-10T04:53:38.374890+0000","last_peered":"2024-09-10T04:53:38.374890+0000","last_clean":"2024-09-10T04:53:38.374890+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:53:38.374890+0000","last_undegraded":"2024-09-10T04:53:38.374890+0000","last_fullsized":"2024-09-10T04:53:38.374890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.374741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:27.594977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.972008+0000","last_change":"2024-09-10T04:53:51.971940+0000","last_active":"2024-09-10T04:53:51.972008+0000","last_peered":"2024-09-10T04:53:51.972008+0000","last_clean":"2024-09-10T04:53:51.972008+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:53:51.972008+0000","last_undegraded":"2024-09-10T04:53:51.972008+0000","last_fullsized":"2024-09-10T04:53:51.972008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.971848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:03.492899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.929390+0000","last_change":"2024-09-10T04:53:38.929329+0000","last_active":"2024-09-10T04:53:38.929390+0000","last_peered":"2024-09-10T04:53:38.929390+0000","last_clean":"2024-09-10T04:53:38.929390+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:38.929390+0000","last_undegraded":"2024-09-10T04:53:38.929390+0000","last_fullsized":"2024-09-10T04:53:38.929390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.929243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.588007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.313355+0000","last_change":"2024-09-10T04:54:01.313283+0000","last_active":"2024-09-10T04:54:01.313355+0000","last_peered":"2024-09-10T04:54:01.313355+0000","last_clean":"2024-09-10T04:54:01.313355+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:54:01.313355+0000","last_undegraded":"2024-09-10T04:54:01.313355+0000","last_fullsized":"2024-09-10T04:54:01.313355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.313200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:26.308298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.391670+0000","last_change":"2024-09-10T04:53:34.391611+0000","last_active":"2024-09-10T04:53:34.391670+0000","last_peered":"2024-09-10T04:53:34.391670+0000","last_clean":"2024-09-10T04:53:34.391670+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:53:34.391670+0000","last_undegraded":"2024-09-10T04:53:34.391670+0000","last_fullsized":"2024-09-10T04:53:34.391670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.391516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:34.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.648047+0000","last_change":"2024-09-10T04:53:56.647991+0000","last_active":"2024-09-10T04:53:56.648047+0000","last_peered":"2024-09-10T04:53:56.648047+0000","last_clean":"2024-09-10T04:53:56.648047+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:56.648047+0000","last_undegraded":"2024-09-10T04:53:56.648047+0000","last_fullsized":"2024-09-10T04:53:56.648047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.647894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.716571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.362038+0000","last_change":"2024-09-10T04:53:39.361951+0000","last_active":"2024-09-10T04:53:39.362038+0000","last_peered":"2024-09-10T04:53:39.362038+0000","last_clean":"2024-09-10T04:53:39.362038+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:39.362038+0000","last_undegraded":"2024-09-10T04:53:39.362038+0000","last_fullsized":"2024-09-10T04:53:39.362038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.361846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:31.211856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.967302+0000","last_change":"2024-09-10T04:53:55.967302+0000","last_active":"2024-09-10T04:53:55.967302+0000","last_peered":"2024-09-10T04:53:55.967302+0000","last_clean":"2024-09-10T04:53:55.967302+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:55.967302+0000","last_undegraded":"2024-09-10T04:53:55.967302+0000","last_fullsized":"2024-09-10T04:53:55.967302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.967182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:05.382797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.328471+0000","last_change":"2024-09-10T04:53:41.328369+0000","last_active":"2024-09-10T04:53:41.328471+0000","last_peered":"2024-09-10T04:53:41.328471+0000","last_clean":"2024-09-10T04:53:41.328471+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:53:41.328471+0000","last_undegraded":"2024-09-10T04:53:41.328471+0000","last_fullsized":"2024-09-10T04:53:41.328471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.328263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:49.638518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.293127+0000","last_change":"2024-09-10T04:54:05.293127+0000","last_active":"2024-09-10T04:54:05.293127+0000","last_peered":"2024-09-10T04:54:05.293127+0000","last_clean":"2024-09-10T04:54:05.293127+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:54:05.293127+0000","last_undegraded":"2024-09-10T04:54:05.293127+0000","last_fullsized":"2024-09-10T04:54:05.293127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.293042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:59.483409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.299822+0000","last_change":"2024-09-10T04:53:44.299822+0000","last_active":"2024-09-10T04:53:44.299822+0000","last_peered":"2024-09-10T04:53:44.299822+0000","last_clean":"2024-09-10T04:53:44.299822+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:53:44.299822+0000","last_undegraded":"2024-09-10T04:53:44.299822+0000","last_fullsized":"2024-09-10T04:53:44.299822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.299714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:38.816159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.276352+0000","last_change":"2024-09-10T04:53:48.276352+0000","last_active":"2024-09-10T04:53:48.276352+0000","last_peered":"2024-09-10T04:53:48.276352+0000","last_clean":"2024-09-10T04:53:48.276352+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:53:48.276352+0000","last_undegraded":"2024-09-10T04:53:48.276352+0000","last_fullsized":"2024-09-10T04:53:48.276352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.276257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:28.621401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.671909+0000","last_change":"2024-09-10T04:53:52.671909+0000","last_active":"2024-09-10T04:53:52.671909+0000","last_peered":"2024-09-10T04:53:52.671909+0000","last_clean":"2024-09-10T04:53:52.671909+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:53:52.671909+0000","last_undegraded":"2024-09-10T04:53:52.671909+0000","last_fullsized":"2024-09-10T04:53:52.671909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.671762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:37.070175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.954629+0000","last_change":"2024-09-10T04:53:56.954629+0000","last_active":"2024-09-10T04:53:56.954629+0000","last_peered":"2024-09-10T04:53:56.954629+0000","last_clean":"2024-09-10T04:53:56.954629+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:56.954629+0000","last_undegraded":"2024-09-10T04:53:56.954629+0000","last_fullsized":"2024-09-10T04:53:56.954629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.954538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:00.066290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.927198+0000","last_change":"2024-09-10T04:53:39.927198+0000","last_active":"2024-09-10T04:53:39.927198+0000","last_peered":"2024-09-10T04:53:39.927198+0000","last_clean":"2024-09-10T04:53:39.927198+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:53:39.927198+0000","last_undegraded":"2024-09-10T04:53:39.927198+0000","last_fullsized":"2024-09-10T04:53:39.927198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.927110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:58.183080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.702457+0000","last_change":"2024-09-10T04:53:58.702457+0000","last_active":"2024-09-10T04:53:58.702457+0000","last_peered":"2024-09-10T04:53:58.702457+0000","last_clean":"2024-09-10T04:53:58.702457+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:58.702457+0000","last_undegraded":"2024-09-10T04:53:58.702457+0000","last_fullsized":"2024-09-10T04:53:58.702457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.702328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:28.627810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.285400+0000","last_change":"2024-09-10T04:53:43.285400+0000","last_active":"2024-09-10T04:53:43.285400+0000","last_peered":"2024-09-10T04:53:43.285400+0000","last_clean":"2024-09-10T04:53:43.285400+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:53:43.285400+0000","last_undegraded":"2024-09-10T04:53:43.285400+0000","last_fullsized":"2024-09-10T04:53:43.285400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.285314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:24.124746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.937043+0000","last_change":"2024-09-10T04:53:57.937043+0000","last_active":"2024-09-10T04:53:57.937043+0000","last_peered":"2024-09-10T04:53:57.937043+0000","last_clean":"2024-09-10T04:53:57.937043+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:57.937043+0000","last_undegraded":"2024-09-10T04:53:57.937043+0000","last_fullsized":"2024-09-10T04:53:57.937043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.936960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:54.724913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.323633+0000","last_change":"2024-09-10T04:53:45.323633+0000","last_active":"2024-09-10T04:53:45.323633+0000","last_peered":"2024-09-10T04:53:45.323633+0000","last_clean":"2024-09-10T04:53:45.323633+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:53:45.323633+0000","last_undegraded":"2024-09-10T04:53:45.323633+0000","last_fullsized":"2024-09-10T04:53:45.323633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.323515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:03:20.165760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.312983+0000","last_change":"2024-09-10T04:54:03.312983+0000","last_active":"2024-09-10T04:54:03.312983+0000","last_peered":"2024-09-10T04:54:03.312983+0000","last_clean":"2024-09-10T04:54:03.312983+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:54:03.312983+0000","last_undegraded":"2024-09-10T04:54:03.312983+0000","last_fullsized":"2024-09-10T04:54:03.312983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.312896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:29.686339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.402809+0000","last_change":"2024-09-10T04:53:35.402809+0000","last_active":"2024-09-10T04:53:35.402809+0000","last_peered":"2024-09-10T04:53:35.402809+0000","last_clean":"2024-09-10T04:53:35.402809+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:53:35.402809+0000","last_undegraded":"2024-09-10T04:53:35.402809+0000","last_fullsized":"2024-09-10T04:53:35.402809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.402723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:03.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.682334+0000","last_change":"2024-09-10T04:53:57.682334+0000","last_active":"2024-09-10T04:53:57.682334+0000","last_peered":"2024-09-10T04:53:57.682334+0000","last_clean":"2024-09-10T04:53:57.682334+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:57.682334+0000","last_undegraded":"2024-09-10T04:53:57.682334+0000","last_fullsized":"2024-09-10T04:53:57.682334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.682253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:40.547619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.311732+0000","last_change":"2024-09-10T04:53:42.311732+0000","last_active":"2024-09-10T04:53:42.311732+0000","last_peered":"2024-09-10T04:53:42.311732+0000","last_clean":"2024-09-10T04:53:42.311732+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:53:42.311732+0000","last_undegraded":"2024-09-10T04:53:42.311732+0000","last_fullsized":"2024-09-10T04:53:42.311732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.311649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:45.625094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.725409+0000","last_change":"2024-09-10T04:53:44.725409+0000","last_active":"2024-09-10T04:53:44.725409+0000","last_peered":"2024-09-10T04:53:44.725409+0000","last_clean":"2024-09-10T04:53:44.725409+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:53:44.725409+0000","last_undegraded":"2024-09-10T04:53:44.725409+0000","last_fullsized":"2024-09-10T04:53:44.725409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.725321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:54.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.267391+0000","last_change":"2024-09-10T04:53:49.267391+0000","last_active":"2024-09-10T04:53:49.267391+0000","last_peered":"2024-09-10T04:53:49.267391+0000","last_clean":"2024-09-10T04:53:49.267391+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:49.267391+0000","last_undegraded":"2024-09-10T04:53:49.267391+0000","last_fullsized":"2024-09-10T04:53:49.267391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.267304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:59.269187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.954477+0000","last_change":"2024-09-10T04:53:40.954477+0000","last_active":"2024-09-10T04:53:40.954477+0000","last_peered":"2024-09-10T04:53:40.954477+0000","last_clean":"2024-09-10T04:53:40.954477+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:53:40.954477+0000","last_undegraded":"2024-09-10T04:53:40.954477+0000","last_fullsized":"2024-09-10T04:53:40.954477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.954395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:35.066147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.960016+0000","last_change":"2024-09-10T04:54:00.960016+0000","last_active":"2024-09-10T04:54:00.960016+0000","last_peered":"2024-09-10T04:54:00.960016+0000","last_clean":"2024-09-10T04:54:00.960016+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:54:00.960016+0000","last_undegraded":"2024-09-10T04:54:00.960016+0000","last_fullsized":"2024-09-10T04:54:00.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.959935+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:48.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2284,"ondisk_log_size":2284,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1776,"ondisk_log_size":1776,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":740670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673018,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":742288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673018,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:54:30.189 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.189 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.190 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.191 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.191 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.191 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.192 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.192 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.192 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.192 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.192 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.193 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.193 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.193 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.193 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.193 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.194 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.195 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T04:50:15.824108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.195 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.195 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T04:50:13.817590+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=13, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.195 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T04:50:17.836264+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=4, tm_min=53, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T04:54:30.195 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T04:54:50.197 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T04:54:50.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.305+0000 7fc5b7ce4640 1 Processor -- start 2024-09-10T04:54:50.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b7ce4640 1 -- start start 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b7ce4640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc5b0129d80 0x7fc5b012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b7ce4640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b006dc00 con 0x7fc5b012a6a0 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b7ce4640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b01299c0 con 0x7fc5b0129d80 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b5a80640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc5b0129d80 0x7fc5b012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b527f640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc5b012a6a0 0x7fc5b0110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:41428/0 (socket says 172.21.15.98:41428) 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.306+0000 7fc5b527f640 1 -- 172.21.15.98:0/3853258110 learned_addr learned my addr 172.21.15.98:0/3853258110 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.307+0000 7fc5b5a80640 1 -- 172.21.15.98:0/3853258110 >> v1:172.21.15.98:6789/0 conn(0x7fc5b012a6a0 legacy=0x7fc5b0110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.307+0000 7fc5b5a80640 1 -- 172.21.15.98:0/3853258110 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b0114d20 con 0x7fc5b0129d80 2024-09-10T04:54:50.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.307+0000 7fc5b4a7e640 1 -- 172.21.15.98:0/3853258110 <== mon.0 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510743938 0 0) 0x7fc5b006dc00 con 0x7fc5b012a6a0 2024-09-10T04:54:50.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.307+0000 7fc5b5a80640 1 --2- 172.21.15.98:0/3853258110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b012a160 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009720 tx=0x7fc5a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ea2d6f40f342f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b4a7e640 1 -- 172.21.15.98:0/3853258110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a0037070 con 0x7fc5b0129d80 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b4a7e640 1 -- 172.21.15.98:0/3853258110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a002ad90 con 0x7fc5b0129d80 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b4a7e640 1 -- 172.21.15.98:0/3853258110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a0032590 con 0x7fc5b0129d80 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/3853258110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 msgr2=0x7fc5b012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/3853258110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b012a160 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009720 tx=0x7fc5a002a110 comp rx=0 tx=0).stop 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/3853258110 shutdown_connections 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/3853258110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b012a160 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/3853258110 >> 172.21.15.98:0/3853258110 conn(0x7fc5b0070850 msgr2=0x7fc5b0072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/3853258110 shutdown_connections 2024-09-10T04:54:50.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.308+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/3853258110 wait complete. 2024-09-10T04:54:50.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.309+0000 7fc5b7ce4640 1 Processor -- start 2024-09-10T04:54:50.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.309+0000 7fc5b7ce4640 1 -- start start 2024-09-10T04:54:50.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.309+0000 7fc5b7ce4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.309+0000 7fc5b7ce4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0114940 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b5a80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b5a80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38726/0 (socket says 172.21.15.98:38726) 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b5a80640 1 -- 172.21.15.98:0/801215313 learned_addr learned my addr 172.21.15.98:0/801215313 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b5a80640 1 -- 172.21.15.98:0/801215313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b0114270 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b5a80640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0035040 tx=0x7fc5a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a0037040 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a0004160 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b0120610 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5a0004440 con 0x7fc5b0129d80 2024-09-10T04:54:50.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.310+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01c44c0 con 0x7fc5b0129d80 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.311+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b01119e0 con 0x7fc5b0129d80 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.311+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc5a0003610 con 0x7fc5b0129d80 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.312+0000 7fc5a67fc640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 0x7fc594040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.312+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7fc5a0073d50 con 0x7fc5b0129d80 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.312+0000 7fc5b527f640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 0x7fc594040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.313+0000 7fc5b527f640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 0x7fc594040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac0078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.316+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fc5a003c3d0 con 0x7fc5b0129d80 2024-09-10T04:54:50.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.487+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 --> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5b01276b0 con 0x7fc59403de90 2024-09-10T04:54:50.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.498+0000 7fc5a67fc640 1 -- 172.21.15.98:0/801215313 <== mgr.4101 v2:172.21.15.145:6824/106719016 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666482 (secure 0 0 0) 0x7fc5b01276b0 con 0x7fc59403de90 2024-09-10T04:54:50.507 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T04:54:50.512 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 msgr2=0x7fc594040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 0x7fc594040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac0078d0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 msgr2=0x7fc5b01c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0035040 tx=0x7fc5a00046c0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 shutdown_connections 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7fc59403de90 0x7fc594040350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 --2- 172.21.15.98:0/801215313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5b0129d80 0x7fc5b01c3da0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 >> 172.21.15.98:0/801215313 conn(0x7fc5b0070850 msgr2=0x7fc5b0126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 shutdown_connections 2024-09-10T04:54:50.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.502+0000 7fc5b7ce4640 1 -- 172.21.15.98:0/801215313 wait complete. 2024-09-10T04:54:50.516 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T04:54:49.280949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":636,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5006,"ondisk_log_size":5006,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1786524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":161736472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003624"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.698748+0000","last_change":"2024-09-10T04:53:49.698685+0000","last_active":"2024-09-10T04:53:49.698748+0000","last_peered":"2024-09-10T04:53:49.698748+0000","last_clean":"2024-09-10T04:53:49.698748+0000","last_became_active":"2024-09-10T04:50:08.836018+0000","last_became_peered":"2024-09-10T04:50:08.836018+0000","last_unstale":"2024-09-10T04:53:49.698748+0000","last_undegraded":"2024-09-10T04:53:49.698748+0000","last_fullsized":"2024-09-10T04:53:49.698748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.698611+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.698611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:57.933974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.700485+0000","last_change":"2024-09-10T04:54:02.700485+0000","last_active":"2024-09-10T04:54:02.700485+0000","last_peered":"2024-09-10T04:54:02.700485+0000","last_clean":"2024-09-10T04:54:02.700485+0000","last_became_active":"2024-09-10T04:50:10.826769+0000","last_became_peered":"2024-09-10T04:50:10.826769+0000","last_unstale":"2024-09-10T04:54:02.700485+0000","last_undegraded":"2024-09-10T04:54:02.700485+0000","last_fullsized":"2024-09-10T04:54:02.700485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.700385+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.700385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.433289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.001417+0000","last_change":"2024-09-10T04:53:43.001358+0000","last_active":"2024-09-10T04:53:43.001417+0000","last_peered":"2024-09-10T04:53:43.001417+0000","last_clean":"2024-09-10T04:53:43.001417+0000","last_became_active":"2024-09-10T04:50:08.847183+0000","last_became_peered":"2024-09-10T04:50:08.847183+0000","last_unstale":"2024-09-10T04:53:43.001417+0000","last_undegraded":"2024-09-10T04:53:43.001417+0000","last_fullsized":"2024-09-10T04:53:43.001417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:43.001271+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.001271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:10.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.327201+0000","last_change":"2024-09-10T04:54:06.327201+0000","last_active":"2024-09-10T04:54:06.327201+0000","last_peered":"2024-09-10T04:54:06.327201+0000","last_clean":"2024-09-10T04:54:06.327201+0000","last_became_active":"2024-09-10T04:50:10.818600+0000","last_became_peered":"2024-09-10T04:50:10.818600+0000","last_unstale":"2024-09-10T04:54:06.327201+0000","last_undegraded":"2024-09-10T04:54:06.327201+0000","last_fullsized":"2024-09-10T04:54:06.327201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:06.327112+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.327112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:25.832246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.279335+0000","last_change":"2024-09-10T04:53:50.279273+0000","last_active":"2024-09-10T04:53:50.279335+0000","last_peered":"2024-09-10T04:53:50.279335+0000","last_clean":"2024-09-10T04:53:50.279335+0000","last_became_active":"2024-09-10T04:50:08.838971+0000","last_became_peered":"2024-09-10T04:50:08.838971+0000","last_unstale":"2024-09-10T04:53:50.279335+0000","last_undegraded":"2024-09-10T04:53:50.279335+0000","last_fullsized":"2024-09-10T04:53:50.279335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:50.279186+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.279186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:17.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.275840+0000","last_change":"2024-09-10T04:53:50.275840+0000","last_active":"2024-09-10T04:53:50.275840+0000","last_peered":"2024-09-10T04:53:50.275840+0000","last_clean":"2024-09-10T04:53:50.275840+0000","last_became_active":"2024-09-10T04:50:48.879530+0000","last_became_peered":"2024-09-10T04:50:48.879530+0000","last_unstale":"2024-09-10T04:53:50.275840+0000","last_undegraded":"2024-09-10T04:53:50.275840+0000","last_fullsized":"2024-09-10T04:53:50.275840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.275751+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.275751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:45.236387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.350611+0000","last_change":"2024-09-10T04:53:37.350530+0000","last_active":"2024-09-10T04:53:37.350611+0000","last_peered":"2024-09-10T04:53:37.350611+0000","last_clean":"2024-09-10T04:53:37.350611+0000","last_became_active":"2024-09-10T04:50:08.841551+0000","last_became_peered":"2024-09-10T04:50:08.841551+0000","last_unstale":"2024-09-10T04:53:37.350611+0000","last_undegraded":"2024-09-10T04:53:37.350611+0000","last_fullsized":"2024-09-10T04:53:37.350611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.350444+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.350444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:41.145937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.343098+0000","last_change":"2024-09-10T04:53:52.343098+0000","last_active":"2024-09-10T04:53:52.343098+0000","last_peered":"2024-09-10T04:53:52.343098+0000","last_clean":"2024-09-10T04:53:52.343098+0000","last_became_active":"2024-09-10T04:50:48.879574+0000","last_became_peered":"2024-09-10T04:50:48.879574+0000","last_unstale":"2024-09-10T04:53:52.343098+0000","last_undegraded":"2024-09-10T04:53:52.343098+0000","last_fullsized":"2024-09-10T04:53:52.343098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.343002+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.343002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:01.985121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.688036+0000","last_change":"2024-09-10T04:53:47.688036+0000","last_active":"2024-09-10T04:53:47.688036+0000","last_peered":"2024-09-10T04:53:47.688036+0000","last_clean":"2024-09-10T04:53:47.688036+0000","last_became_active":"2024-09-10T04:50:08.835736+0000","last_became_peered":"2024-09-10T04:50:08.835736+0000","last_unstale":"2024-09-10T04:53:47.688036+0000","last_undegraded":"2024-09-10T04:53:47.688036+0000","last_fullsized":"2024-09-10T04:53:47.688036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:47.687954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.687954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:11.907238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.988139+0000","last_change":"2024-09-10T04:53:59.988067+0000","last_active":"2024-09-10T04:53:59.988139+0000","last_peered":"2024-09-10T04:53:59.988139+0000","last_clean":"2024-09-10T04:53:59.988139+0000","last_became_active":"2024-09-10T04:50:10.822770+0000","last_became_peered":"2024-09-10T04:50:10.822770+0000","last_unstale":"2024-09-10T04:53:59.988139+0000","last_undegraded":"2024-09-10T04:53:59.988139+0000","last_fullsized":"2024-09-10T04:53:59.988139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:59.987987+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.987987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:25.844429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.630867+0000","last_change":"2024-09-10T04:53:51.630867+0000","last_active":"2024-09-10T04:53:51.630867+0000","last_peered":"2024-09-10T04:53:51.630867+0000","last_clean":"2024-09-10T04:53:51.630867+0000","last_became_active":"2024-09-10T04:50:08.836934+0000","last_became_peered":"2024-09-10T04:50:08.836934+0000","last_unstale":"2024-09-10T04:53:51.630867+0000","last_undegraded":"2024-09-10T04:53:51.630867+0000","last_fullsized":"2024-09-10T04:53:51.630867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:51.630781+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.630781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:09.098807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.653032+0000","last_change":"2024-09-10T04:54:05.652963+0000","last_active":"2024-09-10T04:54:05.653032+0000","last_peered":"2024-09-10T04:54:05.653032+0000","last_clean":"2024-09-10T04:54:05.653032+0000","last_became_active":"2024-09-10T04:50:10.832349+0000","last_became_peered":"2024-09-10T04:50:10.832349+0000","last_unstale":"2024-09-10T04:54:05.653032+0000","last_undegraded":"2024-09-10T04:54:05.653032+0000","last_fullsized":"2024-09-10T04:54:05.653032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:54:05.652884+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.652884+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:11.501788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.274521+0000","last_change":"2024-09-10T04:53:49.274521+0000","last_active":"2024-09-10T04:53:49.274521+0000","last_peered":"2024-09-10T04:53:49.274521+0000","last_clean":"2024-09-10T04:53:49.274521+0000","last_became_active":"2024-09-10T04:50:08.833813+0000","last_became_peered":"2024-09-10T04:50:08.833813+0000","last_unstale":"2024-09-10T04:53:49.274521+0000","last_undegraded":"2024-09-10T04:53:49.274521+0000","last_fullsized":"2024-09-10T04:53:49.274521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:49.274457+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.274457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:34.463042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.681596+0000","last_change":"2024-09-10T04:54:04.681516+0000","last_active":"2024-09-10T04:54:04.681596+0000","last_peered":"2024-09-10T04:54:04.681596+0000","last_clean":"2024-09-10T04:54:04.681596+0000","last_became_active":"2024-09-10T04:50:10.825278+0000","last_became_peered":"2024-09-10T04:50:10.825278+0000","last_unstale":"2024-09-10T04:54:04.681596+0000","last_undegraded":"2024-09-10T04:54:04.681596+0000","last_fullsized":"2024-09-10T04:54:04.681596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:04.681418+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.681418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:36.857790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.321611+0000","last_change":"2024-09-10T04:53:48.321611+0000","last_active":"2024-09-10T04:53:48.321611+0000","last_peered":"2024-09-10T04:53:48.321611+0000","last_clean":"2024-09-10T04:53:48.321611+0000","last_became_active":"2024-09-10T04:50:08.841315+0000","last_became_peered":"2024-09-10T04:50:08.841315+0000","last_unstale":"2024-09-10T04:53:48.321611+0000","last_undegraded":"2024-09-10T04:53:48.321611+0000","last_fullsized":"2024-09-10T04:53:48.321611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:48.321527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.321527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:27.094894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.375969+0000","last_change":"2024-09-10T04:53:53.375914+0000","last_active":"2024-09-10T04:53:53.375969+0000","last_peered":"2024-09-10T04:53:53.375969+0000","last_clean":"2024-09-10T04:53:53.375969+0000","last_became_active":"2024-09-10T04:50:10.831383+0000","last_became_peered":"2024-09-10T04:50:10.831383+0000","last_unstale":"2024-09-10T04:53:53.375969+0000","last_undegraded":"2024-09-10T04:53:53.375969+0000","last_fullsized":"2024-09-10T04:53:53.375969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:53:53.375824+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.375824+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:30.125628+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.739403+0000","last_change":"2024-09-10T04:53:59.739403+0000","last_active":"2024-09-10T04:53:59.739403+0000","last_peered":"2024-09-10T04:53:59.739403+0000","last_clean":"2024-09-10T04:53:59.739403+0000","last_became_active":"2024-09-10T04:50:10.827114+0000","last_became_peered":"2024-09-10T04:50:10.827114+0000","last_unstale":"2024-09-10T04:53:59.739403+0000","last_undegraded":"2024-09-10T04:53:59.739403+0000","last_fullsized":"2024-09-10T04:53:59.739403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:59.739317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.739317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:04.211884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.004475+0000","last_change":"2024-09-10T04:53:42.004475+0000","last_active":"2024-09-10T04:53:42.004475+0000","last_peered":"2024-09-10T04:53:42.004475+0000","last_clean":"2024-09-10T04:53:42.004475+0000","last_became_active":"2024-09-10T04:50:08.848735+0000","last_became_peered":"2024-09-10T04:50:08.848735+0000","last_unstale":"2024-09-10T04:53:42.004475+0000","last_undegraded":"2024-09-10T04:53:42.004475+0000","last_fullsized":"2024-09-10T04:53:42.004475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.004361+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.004361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.759496+0000","last_change":"2024-09-10T04:54:00.759496+0000","last_active":"2024-09-10T04:54:00.759496+0000","last_peered":"2024-09-10T04:54:00.759496+0000","last_clean":"2024-09-10T04:54:00.759496+0000","last_became_active":"2024-09-10T04:50:10.825281+0000","last_became_peered":"2024-09-10T04:50:10.825281+0000","last_unstale":"2024-09-10T04:54:00.759496+0000","last_undegraded":"2024-09-10T04:54:00.759496+0000","last_fullsized":"2024-09-10T04:54:00.759496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:00.759398+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.759398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:36.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.373882+0000","last_change":"2024-09-10T04:53:38.373882+0000","last_active":"2024-09-10T04:53:38.373882+0000","last_peered":"2024-09-10T04:53:38.373882+0000","last_clean":"2024-09-10T04:53:38.373882+0000","last_became_active":"2024-09-10T04:50:08.855242+0000","last_became_peered":"2024-09-10T04:50:08.855242+0000","last_unstale":"2024-09-10T04:53:38.373882+0000","last_undegraded":"2024-09-10T04:53:38.373882+0000","last_fullsized":"2024-09-10T04:53:38.373882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.373750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.373750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:37.943360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.632488+0000","last_change":"2024-09-10T04:54:08.632488+0000","last_active":"2024-09-10T04:54:08.632488+0000","last_peered":"2024-09-10T04:54:08.632488+0000","last_clean":"2024-09-10T04:54:08.632488+0000","last_became_active":"2024-09-10T04:50:10.824179+0000","last_became_peered":"2024-09-10T04:50:10.824179+0000","last_unstale":"2024-09-10T04:54:08.632488+0000","last_undegraded":"2024-09-10T04:54:08.632488+0000","last_fullsized":"2024-09-10T04:54:08.632488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:08.632381+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:08.632381+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.632381+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:32.525602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.758491+0000","last_change":"2024-09-10T04:53:45.758491+0000","last_active":"2024-09-10T04:53:45.758491+0000","last_peered":"2024-09-10T04:53:45.758491+0000","last_clean":"2024-09-10T04:53:45.758491+0000","last_became_active":"2024-09-10T04:50:08.837161+0000","last_became_peered":"2024-09-10T04:50:08.837161+0000","last_unstale":"2024-09-10T04:53:45.758491+0000","last_undegraded":"2024-09-10T04:53:45.758491+0000","last_fullsized":"2024-09-10T04:53:45.758491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.758406+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.758406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:20.305511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.316685+0000","last_change":"2024-09-10T04:53:51.316685+0000","last_active":"2024-09-10T04:53:51.316685+0000","last_peered":"2024-09-10T04:53:51.316685+0000","last_clean":"2024-09-10T04:53:51.316685+0000","last_became_active":"2024-09-10T04:50:10.830841+0000","last_became_peered":"2024-09-10T04:50:10.830841+0000","last_unstale":"2024-09-10T04:53:51.316685+0000","last_undegraded":"2024-09-10T04:53:51.316685+0000","last_fullsized":"2024-09-10T04:53:51.316685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:51.316587+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.316587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:59.365417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.726404+0000","last_change":"2024-09-10T04:53:46.726404+0000","last_active":"2024-09-10T04:53:46.726404+0000","last_peered":"2024-09-10T04:53:46.726404+0000","last_clean":"2024-09-10T04:53:46.726404+0000","last_became_active":"2024-09-10T04:50:08.836373+0000","last_became_peered":"2024-09-10T04:50:08.836373+0000","last_unstale":"2024-09-10T04:53:46.726404+0000","last_undegraded":"2024-09-10T04:53:46.726404+0000","last_fullsized":"2024-09-10T04:53:46.726404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.726317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.726317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:16.025123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.294652+0000","last_change":"2024-09-10T04:53:47.294652+0000","last_active":"2024-09-10T04:53:47.294652+0000","last_peered":"2024-09-10T04:53:47.294652+0000","last_clean":"2024-09-10T04:53:47.294652+0000","last_became_active":"2024-09-10T04:50:10.823732+0000","last_became_peered":"2024-09-10T04:50:10.823732+0000","last_unstale":"2024-09-10T04:53:47.294652+0000","last_undegraded":"2024-09-10T04:53:47.294652+0000","last_fullsized":"2024-09-10T04:53:47.294652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:47.294557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.294557+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:04:50.290116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.324104+0000","last_change":"2024-09-10T04:53:47.324104+0000","last_active":"2024-09-10T04:53:47.324104+0000","last_peered":"2024-09-10T04:53:47.324104+0000","last_clean":"2024-09-10T04:53:47.324104+0000","last_became_active":"2024-09-10T04:50:08.843067+0000","last_became_peered":"2024-09-10T04:50:08.843067+0000","last_unstale":"2024-09-10T04:53:47.324104+0000","last_undegraded":"2024-09-10T04:53:47.324104+0000","last_fullsized":"2024-09-10T04:53:47.324104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:47.324019+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.324019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:42.318106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.980213+0000","last_change":"2024-09-10T04:53:58.980213+0000","last_active":"2024-09-10T04:53:58.980213+0000","last_peered":"2024-09-10T04:53:58.980213+0000","last_clean":"2024-09-10T04:53:58.980213+0000","last_became_active":"2024-09-10T04:50:10.831369+0000","last_became_peered":"2024-09-10T04:50:10.831369+0000","last_unstale":"2024-09-10T04:53:58.980213+0000","last_undegraded":"2024-09-10T04:53:58.980213+0000","last_fullsized":"2024-09-10T04:53:58.980213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:58.980132+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.980132+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:12.434041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.313978+0000","last_change":"2024-09-10T04:53:46.313891+0000","last_active":"2024-09-10T04:53:46.313978+0000","last_peered":"2024-09-10T04:53:46.313978+0000","last_clean":"2024-09-10T04:53:46.313978+0000","last_became_active":"2024-09-10T04:50:08.836840+0000","last_became_peered":"2024-09-10T04:50:08.836840+0000","last_unstale":"2024-09-10T04:53:46.313978+0000","last_undegraded":"2024-09-10T04:53:46.313978+0000","last_fullsized":"2024-09-10T04:53:46.313978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:46.313767+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.313767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:23.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:28.962586+0000","last_change":"2024-09-10T04:54:28.962586+0000","last_active":"2024-09-10T04:54:28.962586+0000","last_peered":"2024-09-10T04:54:28.962586+0000","last_clean":"2024-09-10T04:54:28.962586+0000","last_became_active":"2024-09-10T04:50:18.863049+0000","last_became_peered":"2024-09-10T04:50:18.863049+0000","last_unstale":"2024-09-10T04:54:28.962586+0000","last_undegraded":"2024-09-10T04:54:28.962586+0000","last_fullsized":"2024-09-10T04:54:28.962586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-10T04:54:28.962466+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-10T04:54:28.962466+0000","last_clean_scrub_stamp":"2024-09-10T04:54:28.962466+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:42.552227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.210504+0000","last_change":"2024-09-10T04:53:55.210504+0000","last_active":"2024-09-10T04:53:55.210504+0000","last_peered":"2024-09-10T04:53:55.210504+0000","last_clean":"2024-09-10T04:53:55.210504+0000","last_became_active":"2024-09-10T04:50:10.827091+0000","last_became_peered":"2024-09-10T04:50:10.827091+0000","last_unstale":"2024-09-10T04:53:55.210504+0000","last_undegraded":"2024-09-10T04:53:55.210504+0000","last_fullsized":"2024-09-10T04:53:55.210504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.210414+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.210414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:21:26.821090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.335640+0000","last_change":"2024-09-10T04:53:35.335583+0000","last_active":"2024-09-10T04:53:35.335640+0000","last_peered":"2024-09-10T04:53:35.335640+0000","last_clean":"2024-09-10T04:53:35.335640+0000","last_became_active":"2024-09-10T04:50:08.844542+0000","last_became_peered":"2024-09-10T04:50:08.844542+0000","last_unstale":"2024-09-10T04:53:35.335640+0000","last_undegraded":"2024-09-10T04:53:35.335640+0000","last_fullsized":"2024-09-10T04:53:35.335640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:35.335499+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.335499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:57.235909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.263834+0000","last_change":"2024-09-10T04:54:11.263834+0000","last_active":"2024-09-10T04:54:11.263834+0000","last_peered":"2024-09-10T04:54:11.263834+0000","last_clean":"2024-09-10T04:54:11.263834+0000","last_became_active":"2024-09-10T04:50:12.832410+0000","last_became_peered":"2024-09-10T04:50:12.832410+0000","last_unstale":"2024-09-10T04:54:11.263834+0000","last_undegraded":"2024-09-10T04:54:11.263834+0000","last_fullsized":"2024-09-10T04:54:11.263834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.263716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.263716+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.263716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:48.203815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'51","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.152503+0000","last_change":"2024-09-10T04:54:20.152503+0000","last_active":"2024-09-10T04:54:20.152503+0000","last_peered":"2024-09-10T04:54:20.152503+0000","last_clean":"2024-09-10T04:54:20.152503+0000","last_became_active":"2024-09-10T04:50:14.836589+0000","last_became_peered":"2024-09-10T04:50:14.836589+0000","last_unstale":"2024-09-10T04:54:20.152503+0000","last_undegraded":"2024-09-10T04:54:20.152503+0000","last_fullsized":"2024-09-10T04:54:20.152503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T04:54:20.152419+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T04:54:20.152419+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.152419+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:35.700821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:39.584676+0000","last_change":"2024-09-10T04:54:39.584676+0000","last_active":"2024-09-10T04:54:39.584676+0000","last_peered":"2024-09-10T04:54:39.584676+0000","last_clean":"2024-09-10T04:54:39.584676+0000","last_became_active":"2024-09-10T04:50:16.847774+0000","last_became_peered":"2024-09-10T04:50:16.847774+0000","last_unstale":"2024-09-10T04:54:39.584676+0000","last_undegraded":"2024-09-10T04:54:39.584676+0000","last_fullsized":"2024-09-10T04:54:39.584676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:39.584584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:39.584584+0000","last_clean_scrub_stamp":"2024-09-10T04:54:39.584584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:06.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:37.641500+0000","last_change":"2024-09-10T04:54:37.641500+0000","last_active":"2024-09-10T04:54:37.641500+0000","last_peered":"2024-09-10T04:54:37.641500+0000","last_clean":"2024-09-10T04:54:37.641500+0000","last_became_active":"2024-09-10T04:50:18.854382+0000","last_became_peered":"2024-09-10T04:50:18.854382+0000","last_unstale":"2024-09-10T04:54:37.641500+0000","last_undegraded":"2024-09-10T04:54:37.641500+0000","last_fullsized":"2024-09-10T04:54:37.641500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:54:37.641409+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:54:37.641409+0000","last_clean_scrub_stamp":"2024-09-10T04:54:37.641409+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:28.608120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.232292+0000","last_change":"2024-09-10T04:53:56.232292+0000","last_active":"2024-09-10T04:53:56.232292+0000","last_peered":"2024-09-10T04:53:56.232292+0000","last_clean":"2024-09-10T04:53:56.232292+0000","last_became_active":"2024-09-10T04:50:10.818418+0000","last_became_peered":"2024-09-10T04:50:10.818418+0000","last_unstale":"2024-09-10T04:53:56.232292+0000","last_undegraded":"2024-09-10T04:53:56.232292+0000","last_fullsized":"2024-09-10T04:53:56.232292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.232172+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.232172+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:38.675568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.477416+0000","last_change":"2024-09-10T04:53:30.477349+0000","last_active":"2024-09-10T04:53:30.477416+0000","last_peered":"2024-09-10T04:53:30.477416+0000","last_clean":"2024-09-10T04:53:30.477416+0000","last_became_active":"2024-09-10T04:50:08.841645+0000","last_became_peered":"2024-09-10T04:50:08.841645+0000","last_unstale":"2024-09-10T04:53:30.477416+0000","last_undegraded":"2024-09-10T04:53:30.477416+0000","last_fullsized":"2024-09-10T04:53:30.477416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:30.477261+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.477261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:40.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.284890+0000","last_change":"2024-09-10T04:54:10.284890+0000","last_active":"2024-09-10T04:54:10.284890+0000","last_peered":"2024-09-10T04:54:10.284890+0000","last_clean":"2024-09-10T04:54:10.284890+0000","last_became_active":"2024-09-10T04:50:12.829655+0000","last_became_peered":"2024-09-10T04:50:12.829655+0000","last_unstale":"2024-09-10T04:54:10.284890+0000","last_undegraded":"2024-09-10T04:54:10.284890+0000","last_fullsized":"2024-09-10T04:54:10.284890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.284799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.284799+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.284799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:49.115810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'16","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.853147+0000","last_change":"2024-09-10T04:54:14.853147+0000","last_active":"2024-09-10T04:54:14.853147+0000","last_peered":"2024-09-10T04:54:14.853147+0000","last_clean":"2024-09-10T04:54:14.853147+0000","last_became_active":"2024-09-10T04:50:14.841391+0000","last_became_peered":"2024-09-10T04:50:14.841391+0000","last_unstale":"2024-09-10T04:54:14.853147+0000","last_undegraded":"2024-09-10T04:54:14.853147+0000","last_fullsized":"2024-09-10T04:54:14.853147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:54:14.853017+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:54:14.853017+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.853017+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:50.898384+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:31.778214+0000","last_change":"2024-09-10T04:54:31.778214+0000","last_active":"2024-09-10T04:54:31.778214+0000","last_peered":"2024-09-10T04:54:31.778214+0000","last_clean":"2024-09-10T04:54:31.778214+0000","last_became_active":"2024-09-10T04:50:16.846521+0000","last_became_peered":"2024-09-10T04:50:16.846521+0000","last_unstale":"2024-09-10T04:54:31.778214+0000","last_undegraded":"2024-09-10T04:54:31.778214+0000","last_fullsized":"2024-09-10T04:54:31.778214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:31.778123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:31.778123+0000","last_clean_scrub_stamp":"2024-09-10T04:54:31.778123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:12.550857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:40.299739+0000","last_change":"2024-09-10T04:54:40.299739+0000","last_active":"2024-09-10T04:54:40.299739+0000","last_peered":"2024-09-10T04:54:40.299739+0000","last_clean":"2024-09-10T04:54:40.299739+0000","last_became_active":"2024-09-10T04:50:18.860126+0000","last_became_peered":"2024-09-10T04:50:18.860126+0000","last_unstale":"2024-09-10T04:54:40.299739+0000","last_undegraded":"2024-09-10T04:54:40.299739+0000","last_fullsized":"2024-09-10T04:54:40.299739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:54:40.299654+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:54:40.299654+0000","last_clean_scrub_stamp":"2024-09-10T04:54:40.299654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:34.551302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'20","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.243155+0000","last_change":"2024-09-10T04:53:57.243155+0000","last_active":"2024-09-10T04:53:57.243155+0000","last_peered":"2024-09-10T04:53:57.243155+0000","last_clean":"2024-09-10T04:53:57.243155+0000","last_became_active":"2024-09-10T04:50:10.822492+0000","last_became_peered":"2024-09-10T04:50:10.822492+0000","last_unstale":"2024-09-10T04:53:57.243155+0000","last_undegraded":"2024-09-10T04:53:57.243155+0000","last_fullsized":"2024-09-10T04:53:57.243155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:57.243066+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.243066+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:14.528708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":53,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.682183+0000","last_change":"2024-09-10T04:53:39.682127+0000","last_active":"2024-09-10T04:53:39.682183+0000","last_peered":"2024-09-10T04:53:39.682183+0000","last_clean":"2024-09-10T04:53:39.682183+0000","last_became_active":"2024-09-10T04:50:08.836981+0000","last_became_peered":"2024-09-10T04:50:08.836981+0000","last_unstale":"2024-09-10T04:53:39.682183+0000","last_undegraded":"2024-09-10T04:53:39.682183+0000","last_fullsized":"2024-09-10T04:53:39.682183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.682042+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.682042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:15.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.229135+0000","last_change":"2024-09-10T04:54:12.229135+0000","last_active":"2024-09-10T04:54:12.229135+0000","last_peered":"2024-09-10T04:54:12.229135+0000","last_clean":"2024-09-10T04:54:12.229135+0000","last_became_active":"2024-09-10T04:50:12.833255+0000","last_became_peered":"2024-09-10T04:50:12.833255+0000","last_unstale":"2024-09-10T04:54:12.229135+0000","last_undegraded":"2024-09-10T04:54:12.229135+0000","last_fullsized":"2024-09-10T04:54:12.229135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:12.229050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:12.229050+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.229050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:45.969072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'29","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.165507+0000","last_change":"2024-09-10T04:54:03.165507+0000","last_active":"2024-09-10T04:54:03.165507+0000","last_peered":"2024-09-10T04:54:03.165507+0000","last_clean":"2024-09-10T04:54:03.165507+0000","last_became_active":"2024-09-10T04:50:14.831481+0000","last_became_peered":"2024-09-10T04:50:14.831481+0000","last_unstale":"2024-09-10T04:54:03.165507+0000","last_undegraded":"2024-09-10T04:54:03.165507+0000","last_fullsized":"2024-09-10T04:54:03.165507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'29","last_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_deep_scrub":"34'29","last_deep_scrub_stamp":"2024-09-10T04:54:03.165411+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.165411+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:24.743039+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:32.758419+0000","last_change":"2024-09-10T04:54:32.758419+0000","last_active":"2024-09-10T04:54:32.758419+0000","last_peered":"2024-09-10T04:54:32.758419+0000","last_clean":"2024-09-10T04:54:32.758419+0000","last_became_active":"2024-09-10T04:50:16.853806+0000","last_became_peered":"2024-09-10T04:50:16.853806+0000","last_unstale":"2024-09-10T04:54:32.758419+0000","last_undegraded":"2024-09-10T04:54:32.758419+0000","last_fullsized":"2024-09-10T04:54:32.758419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:32.758331+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:32.758331+0000","last_clean_scrub_stamp":"2024-09-10T04:54:32.758331+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:25.012844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.228227+0000","last_change":"2024-09-10T04:54:17.228227+0000","last_active":"2024-09-10T04:54:17.228227+0000","last_peered":"2024-09-10T04:54:17.228227+0000","last_clean":"2024-09-10T04:54:17.228227+0000","last_became_active":"2024-09-10T04:50:18.848550+0000","last_became_peered":"2024-09-10T04:50:18.848550+0000","last_unstale":"2024-09-10T04:54:17.228227+0000","last_undegraded":"2024-09-10T04:54:17.228227+0000","last_fullsized":"2024-09-10T04:54:17.228227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:17.228134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:17.228134+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.228134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:10.343908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.278049+0000","last_change":"2024-09-10T04:53:58.278049+0000","last_active":"2024-09-10T04:53:58.278049+0000","last_peered":"2024-09-10T04:53:58.278049+0000","last_clean":"2024-09-10T04:53:58.278049+0000","last_became_active":"2024-09-10T04:50:10.824507+0000","last_became_peered":"2024-09-10T04:50:10.824507+0000","last_unstale":"2024-09-10T04:53:58.278049+0000","last_undegraded":"2024-09-10T04:53:58.278049+0000","last_fullsized":"2024-09-10T04:53:58.278049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:53:58.277963+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.277963+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:29.914920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.654387+0000","last_change":"2024-09-10T04:53:38.654294+0000","last_active":"2024-09-10T04:53:38.654387+0000","last_peered":"2024-09-10T04:53:38.654387+0000","last_clean":"2024-09-10T04:53:38.654387+0000","last_became_active":"2024-09-10T04:50:08.828010+0000","last_became_peered":"2024-09-10T04:50:08.828010+0000","last_unstale":"2024-09-10T04:53:38.654387+0000","last_undegraded":"2024-09-10T04:53:38.654387+0000","last_fullsized":"2024-09-10T04:53:38.654387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:38.654187+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.654187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:34.763819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.714291+0000","last_change":"2024-09-10T04:54:10.714291+0000","last_active":"2024-09-10T04:54:10.714291+0000","last_peered":"2024-09-10T04:54:10.714291+0000","last_clean":"2024-09-10T04:54:10.714291+0000","last_became_active":"2024-09-10T04:50:12.825336+0000","last_became_peered":"2024-09-10T04:50:12.825336+0000","last_unstale":"2024-09-10T04:54:10.714291+0000","last_undegraded":"2024-09-10T04:54:10.714291+0000","last_fullsized":"2024-09-10T04:54:10.714291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.714211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.714211+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.714211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:39.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'47","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.782436+0000","last_change":"2024-09-10T04:54:21.782436+0000","last_active":"2024-09-10T04:54:21.782436+0000","last_peered":"2024-09-10T04:54:21.782436+0000","last_clean":"2024-09-10T04:54:21.782436+0000","last_became_active":"2024-09-10T04:50:14.833410+0000","last_became_peered":"2024-09-10T04:50:14.833410+0000","last_unstale":"2024-09-10T04:54:21.782436+0000","last_undegraded":"2024-09-10T04:54:21.782436+0000","last_fullsized":"2024-09-10T04:54:21.782436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:21.782342+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:21.782342+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.782342+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:33.276740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:32.203476+0000","last_change":"2024-09-10T04:54:32.203476+0000","last_active":"2024-09-10T04:54:32.203476+0000","last_peered":"2024-09-10T04:54:32.203476+0000","last_clean":"2024-09-10T04:54:32.203476+0000","last_became_active":"2024-09-10T04:50:16.856637+0000","last_became_peered":"2024-09-10T04:50:16.856637+0000","last_unstale":"2024-09-10T04:54:32.203476+0000","last_undegraded":"2024-09-10T04:54:32.203476+0000","last_fullsized":"2024-09-10T04:54:32.203476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:32.203393+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:32.203393+0000","last_clean_scrub_stamp":"2024-09-10T04:54:32.203393+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:51.077255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.322241+0000","last_change":"2024-09-10T04:53:40.322241+0000","last_active":"2024-09-10T04:53:40.322241+0000","last_peered":"2024-09-10T04:53:40.322241+0000","last_clean":"2024-09-10T04:53:40.322241+0000","last_became_active":"2024-09-10T04:50:48.878460+0000","last_became_peered":"2024-09-10T04:50:48.878460+0000","last_unstale":"2024-09-10T04:53:40.322241+0000","last_undegraded":"2024-09-10T04:53:40.322241+0000","last_fullsized":"2024-09-10T04:53:40.322241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.322153+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.322153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:47.658822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.659619+0000","last_change":"2024-09-10T04:53:41.659561+0000","last_active":"2024-09-10T04:53:41.659619+0000","last_peered":"2024-09-10T04:53:41.659619+0000","last_clean":"2024-09-10T04:53:41.659619+0000","last_became_active":"2024-09-10T04:50:08.828544+0000","last_became_peered":"2024-09-10T04:50:08.828544+0000","last_unstale":"2024-09-10T04:53:41.659619+0000","last_undegraded":"2024-09-10T04:53:41.659619+0000","last_fullsized":"2024-09-10T04:53:41.659619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.659470+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.659470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:46.312054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.991625+0000","last_change":"2024-09-10T04:54:03.991571+0000","last_active":"2024-09-10T04:54:03.991625+0000","last_peered":"2024-09-10T04:54:03.991625+0000","last_clean":"2024-09-10T04:54:03.991625+0000","last_became_active":"2024-09-10T04:50:12.832696+0000","last_became_peered":"2024-09-10T04:50:12.832696+0000","last_unstale":"2024-09-10T04:54:03.991625+0000","last_undegraded":"2024-09-10T04:54:03.991625+0000","last_fullsized":"2024-09-10T04:54:03.991625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:03.991486+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.991486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:01.756702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'60","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.833319+0000","last_change":"2024-09-10T04:54:19.833253+0000","last_active":"2024-09-10T04:54:19.833319+0000","last_peered":"2024-09-10T04:54:19.833319+0000","last_clean":"2024-09-10T04:54:19.833319+0000","last_became_active":"2024-09-10T04:50:14.837203+0000","last_became_peered":"2024-09-10T04:50:14.837203+0000","last_unstale":"2024-09-10T04:54:19.833319+0000","last_undegraded":"2024-09-10T04:54:19.833319+0000","last_fullsized":"2024-09-10T04:54:19.833319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T04:54:19.833149+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T04:54:19.833149+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.833149+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:36.192946+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.908831+0000","last_change":"2024-09-10T04:54:17.908760+0000","last_active":"2024-09-10T04:54:17.908831+0000","last_peered":"2024-09-10T04:54:17.908831+0000","last_clean":"2024-09-10T04:54:17.908831+0000","last_became_active":"2024-09-10T04:50:16.845392+0000","last_became_peered":"2024-09-10T04:50:16.845392+0000","last_unstale":"2024-09-10T04:54:17.908831+0000","last_undegraded":"2024-09-10T04:54:17.908831+0000","last_fullsized":"2024-09-10T04:54:17.908831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:17.908646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:17.908646+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.908646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:25.977323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.210520+0000","last_change":"2024-09-10T04:54:13.210464+0000","last_active":"2024-09-10T04:54:13.210520+0000","last_peered":"2024-09-10T04:54:13.210520+0000","last_clean":"2024-09-10T04:54:13.210520+0000","last_became_active":"2024-09-10T04:50:18.857735+0000","last_became_peered":"2024-09-10T04:50:18.857735+0000","last_unstale":"2024-09-10T04:54:13.210520+0000","last_undegraded":"2024-09-10T04:54:13.210520+0000","last_fullsized":"2024-09-10T04:54:13.210520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:54:13.210386+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:54:13.210386+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.210386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.968720+0000","last_change":"2024-09-10T04:53:46.968650+0000","last_active":"2024-09-10T04:53:46.968720+0000","last_peered":"2024-09-10T04:53:46.968720+0000","last_clean":"2024-09-10T04:53:46.968720+0000","last_became_active":"2024-09-10T04:50:10.826260+0000","last_became_peered":"2024-09-10T04:50:10.826260+0000","last_unstale":"2024-09-10T04:53:46.968720+0000","last_undegraded":"2024-09-10T04:53:46.968720+0000","last_fullsized":"2024-09-10T04:53:46.968720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:46.968570+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.968570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:17.768222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.646463+0000","last_change":"2024-09-10T04:53:37.646386+0000","last_active":"2024-09-10T04:53:37.646463+0000","last_peered":"2024-09-10T04:53:37.646463+0000","last_clean":"2024-09-10T04:53:37.646463+0000","last_became_active":"2024-09-10T04:50:08.827672+0000","last_became_peered":"2024-09-10T04:50:08.827672+0000","last_unstale":"2024-09-10T04:53:37.646463+0000","last_undegraded":"2024-09-10T04:53:37.646463+0000","last_fullsized":"2024-09-10T04:53:37.646463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:37.646297+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.646297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"34'2","reported_seq":241,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.301287+0000","last_change":"2024-09-10T04:53:56.301224+0000","last_active":"2024-09-10T04:53:56.301287+0000","last_peered":"2024-09-10T04:53:56.301287+0000","last_clean":"2024-09-10T04:53:56.301287+0000","last_became_active":"2024-09-10T04:50:48.884931+0000","last_became_peered":"2024-09-10T04:50:48.884931+0000","last_unstale":"2024-09-10T04:53:56.301287+0000","last_undegraded":"2024-09-10T04:53:56.301287+0000","last_fullsized":"2024-09-10T04:53:56.301287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.301141+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.301141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:29.983059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'44","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.173932+0000","last_change":"2024-09-10T04:54:16.173821+0000","last_active":"2024-09-10T04:54:16.173932+0000","last_peered":"2024-09-10T04:54:16.173932+0000","last_clean":"2024-09-10T04:54:16.173932+0000","last_became_active":"2024-09-10T04:50:14.837748+0000","last_became_peered":"2024-09-10T04:50:14.837748+0000","last_unstale":"2024-09-10T04:54:16.173932+0000","last_undegraded":"2024-09-10T04:54:16.173932+0000","last_fullsized":"2024-09-10T04:54:16.173932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T04:54:16.173715+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T04:54:16.173715+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.173715+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:18.950235+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:29.196201+0000","last_change":"2024-09-10T04:54:29.196136+0000","last_active":"2024-09-10T04:54:29.196201+0000","last_peered":"2024-09-10T04:54:29.196201+0000","last_clean":"2024-09-10T04:54:29.196201+0000","last_became_active":"2024-09-10T04:50:16.857400+0000","last_became_peered":"2024-09-10T04:50:16.857400+0000","last_unstale":"2024-09-10T04:54:29.196201+0000","last_undegraded":"2024-09-10T04:54:29.196201+0000","last_fullsized":"2024-09-10T04:54:29.196201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:29.196037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:29.196037+0000","last_clean_scrub_stamp":"2024-09-10T04:54:29.196037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:13.287514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.924766+0000","last_change":"2024-09-10T04:54:22.924709+0000","last_active":"2024-09-10T04:54:22.924766+0000","last_peered":"2024-09-10T04:54:22.924766+0000","last_clean":"2024-09-10T04:54:22.924766+0000","last_became_active":"2024-09-10T04:50:18.853900+0000","last_became_peered":"2024-09-10T04:50:18.853900+0000","last_unstale":"2024-09-10T04:54:22.924766+0000","last_undegraded":"2024-09-10T04:54:22.924766+0000","last_fullsized":"2024-09-10T04:54:22.924766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:22.924630+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:22.924630+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.924630+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:37.467517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.706612+0000","last_change":"2024-09-10T04:53:53.706531+0000","last_active":"2024-09-10T04:53:53.706612+0000","last_peered":"2024-09-10T04:53:53.706612+0000","last_clean":"2024-09-10T04:53:53.706612+0000","last_became_active":"2024-09-10T04:50:10.826088+0000","last_became_peered":"2024-09-10T04:50:10.826088+0000","last_unstale":"2024-09-10T04:53:53.706612+0000","last_undegraded":"2024-09-10T04:53:53.706612+0000","last_fullsized":"2024-09-10T04:53:53.706612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.706430+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.706430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:01.447306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.674165+0000","last_change":"2024-09-10T04:53:36.674057+0000","last_active":"2024-09-10T04:53:36.674165+0000","last_peered":"2024-09-10T04:53:36.674165+0000","last_clean":"2024-09-10T04:53:36.674165+0000","last_became_active":"2024-09-10T04:50:08.836118+0000","last_became_peered":"2024-09-10T04:50:08.836118+0000","last_unstale":"2024-09-10T04:53:36.674165+0000","last_undegraded":"2024-09-10T04:53:36.674165+0000","last_fullsized":"2024-09-10T04:53:36.674165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.673934+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.673934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:50.127843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.290738+0000","last_change":"2024-09-10T04:53:58.290654+0000","last_active":"2024-09-10T04:53:58.290738+0000","last_peered":"2024-09-10T04:53:58.290738+0000","last_clean":"2024-09-10T04:53:58.290738+0000","last_became_active":"2024-09-10T04:50:48.878186+0000","last_became_peered":"2024-09-10T04:50:48.878186+0000","last_unstale":"2024-09-10T04:53:58.290738+0000","last_undegraded":"2024-09-10T04:53:58.290738+0000","last_fullsized":"2024-09-10T04:53:58.290738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:58.290557+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.290557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:05.934767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.777289+0000","last_change":"2024-09-10T04:54:17.777213+0000","last_active":"2024-09-10T04:54:17.777289+0000","last_peered":"2024-09-10T04:54:17.777289+0000","last_clean":"2024-09-10T04:54:17.777289+0000","last_became_active":"2024-09-10T04:50:14.833591+0000","last_became_peered":"2024-09-10T04:50:14.833591+0000","last_unstale":"2024-09-10T04:54:17.777289+0000","last_undegraded":"2024-09-10T04:54:17.777289+0000","last_fullsized":"2024-09-10T04:54:17.777289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-09-10T04:54:17.777117+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-09-10T04:54:17.777117+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.777117+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:54.144349+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":362,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.239720+0000","last_change":"2024-09-10T04:54:08.239662+0000","last_active":"2024-09-10T04:54:08.239720+0000","last_peered":"2024-09-10T04:54:08.239720+0000","last_clean":"2024-09-10T04:54:08.239720+0000","last_became_active":"2024-09-10T04:50:16.854328+0000","last_became_peered":"2024-09-10T04:50:16.854328+0000","last_unstale":"2024-09-10T04:54:08.239720+0000","last_undegraded":"2024-09-10T04:54:08.239720+0000","last_fullsized":"2024-09-10T04:54:08.239720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:08.239567+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.239567+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.192002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.876154+0000","last_change":"2024-09-10T04:54:26.876100+0000","last_active":"2024-09-10T04:54:26.876154+0000","last_peered":"2024-09-10T04:54:26.876154+0000","last_clean":"2024-09-10T04:54:26.876154+0000","last_became_active":"2024-09-10T04:50:18.857211+0000","last_became_peered":"2024-09-10T04:50:18.857211+0000","last_unstale":"2024-09-10T04:54:26.876154+0000","last_undegraded":"2024-09-10T04:54:26.876154+0000","last_fullsized":"2024-09-10T04:54:26.876154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:26.876020+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:26.876020+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.876020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:58.849639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.315884+0000","last_change":"2024-09-10T04:53:42.315791+0000","last_active":"2024-09-10T04:53:42.315884+0000","last_peered":"2024-09-10T04:53:42.315884+0000","last_clean":"2024-09-10T04:53:42.315884+0000","last_became_active":"2024-09-10T04:50:10.834829+0000","last_became_peered":"2024-09-10T04:50:10.834829+0000","last_unstale":"2024-09-10T04:53:42.315884+0000","last_undegraded":"2024-09-10T04:53:42.315884+0000","last_fullsized":"2024-09-10T04:53:42.315884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:42.315680+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.315680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:17.255872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'5","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.698189+0000","last_change":"2024-09-10T04:53:34.698115+0000","last_active":"2024-09-10T04:53:34.698189+0000","last_peered":"2024-09-10T04:53:34.698189+0000","last_clean":"2024-09-10T04:53:34.698189+0000","last_became_active":"2024-09-10T04:50:08.828194+0000","last_became_peered":"2024-09-10T04:50:08.828194+0000","last_unstale":"2024-09-10T04:53:34.698189+0000","last_undegraded":"2024-09-10T04:53:34.698189+0000","last_fullsized":"2024-09-10T04:53:34.698189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:34.698035+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.698035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:37.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.329188+0000","last_change":"2024-09-10T04:53:57.329124+0000","last_active":"2024-09-10T04:53:57.329188+0000","last_peered":"2024-09-10T04:53:57.329188+0000","last_clean":"2024-09-10T04:53:57.329188+0000","last_became_active":"2024-09-10T04:50:12.828643+0000","last_became_peered":"2024-09-10T04:50:12.828643+0000","last_unstale":"2024-09-10T04:53:57.329188+0000","last_undegraded":"2024-09-10T04:53:57.329188+0000","last_fullsized":"2024-09-10T04:53:57.329188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:57.329039+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.329039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:50.320602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'80","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.183828+0000","last_change":"2024-09-10T04:54:14.183770+0000","last_active":"2024-09-10T04:54:14.183828+0000","last_peered":"2024-09-10T04:54:14.183828+0000","last_clean":"2024-09-10T04:54:14.183828+0000","last_became_active":"2024-09-10T04:50:14.845624+0000","last_became_peered":"2024-09-10T04:50:14.845624+0000","last_unstale":"2024-09-10T04:54:14.183828+0000","last_undegraded":"2024-09-10T04:54:14.183828+0000","last_fullsized":"2024-09-10T04:54:14.183828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'80","last_scrub_stamp":"2024-09-10T04:54:14.183676+0000","last_deep_scrub":"34'80","last_deep_scrub_stamp":"2024-09-10T04:54:14.183676+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.183676+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:47.860877+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.235501+0000","last_change":"2024-09-10T04:54:05.235429+0000","last_active":"2024-09-10T04:54:05.235501+0000","last_peered":"2024-09-10T04:54:05.235501+0000","last_clean":"2024-09-10T04:54:05.235501+0000","last_became_active":"2024-09-10T04:50:16.850531+0000","last_became_peered":"2024-09-10T04:50:16.850531+0000","last_unstale":"2024-09-10T04:54:05.235501+0000","last_undegraded":"2024-09-10T04:54:05.235501+0000","last_fullsized":"2024-09-10T04:54:05.235501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.235334+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.235334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.026590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.915745+0000","last_change":"2024-09-10T04:54:24.915691+0000","last_active":"2024-09-10T04:54:24.915745+0000","last_peered":"2024-09-10T04:54:24.915745+0000","last_clean":"2024-09-10T04:54:24.915745+0000","last_became_active":"2024-09-10T04:50:18.862034+0000","last_became_peered":"2024-09-10T04:50:18.862034+0000","last_unstale":"2024-09-10T04:54:24.915745+0000","last_undegraded":"2024-09-10T04:54:24.915745+0000","last_fullsized":"2024-09-10T04:54:24.915745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-10T04:54:24.915577+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-10T04:54:24.915577+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.915577+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:58.077268+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:47.926262+0000","last_change":"2024-09-10T04:53:47.926197+0000","last_active":"2024-09-10T04:53:47.926262+0000","last_peered":"2024-09-10T04:53:47.926262+0000","last_clean":"2024-09-10T04:53:47.926262+0000","last_became_active":"2024-09-10T04:50:10.822151+0000","last_became_peered":"2024-09-10T04:50:10.822151+0000","last_unstale":"2024-09-10T04:53:47.926262+0000","last_undegraded":"2024-09-10T04:53:47.926262+0000","last_fullsized":"2024-09-10T04:53:47.926262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:47.926107+0000","last_clean_scrub_stamp":"2024-09-10T04:53:47.926107+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.345795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.316272+0000","last_change":"2024-09-10T04:53:34.316210+0000","last_active":"2024-09-10T04:53:34.316272+0000","last_peered":"2024-09-10T04:53:34.316272+0000","last_clean":"2024-09-10T04:53:34.316272+0000","last_became_active":"2024-09-10T04:50:08.843646+0000","last_became_peered":"2024-09-10T04:50:08.843646+0000","last_unstale":"2024-09-10T04:53:34.316272+0000","last_undegraded":"2024-09-10T04:53:34.316272+0000","last_fullsized":"2024-09-10T04:53:34.316272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:34.316125+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.316125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:51.933570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.218201+0000","last_change":"2024-09-10T04:54:00.218139+0000","last_active":"2024-09-10T04:54:00.218201+0000","last_peered":"2024-09-10T04:54:00.218201+0000","last_clean":"2024-09-10T04:54:00.218201+0000","last_became_active":"2024-09-10T04:50:12.825995+0000","last_became_peered":"2024-09-10T04:50:12.825995+0000","last_unstale":"2024-09-10T04:54:00.218201+0000","last_undegraded":"2024-09-10T04:54:00.218201+0000","last_fullsized":"2024-09-10T04:54:00.218201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:00.218033+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.218033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:17.651257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.787274+0000","last_change":"2024-09-10T04:54:20.787213+0000","last_active":"2024-09-10T04:54:20.787274+0000","last_peered":"2024-09-10T04:54:20.787274+0000","last_clean":"2024-09-10T04:54:20.787274+0000","last_became_active":"2024-09-10T04:50:14.841670+0000","last_became_peered":"2024-09-10T04:50:14.841670+0000","last_unstale":"2024-09-10T04:54:20.787274+0000","last_undegraded":"2024-09-10T04:54:20.787274+0000","last_fullsized":"2024-09-10T04:54:20.787274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:20.787118+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:20.787118+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.787118+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.273943+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:30.155875+0000","last_change":"2024-09-10T04:54:30.155798+0000","last_active":"2024-09-10T04:54:30.155875+0000","last_peered":"2024-09-10T04:54:30.155875+0000","last_clean":"2024-09-10T04:54:30.155875+0000","last_became_active":"2024-09-10T04:50:16.846048+0000","last_became_peered":"2024-09-10T04:50:16.846048+0000","last_unstale":"2024-09-10T04:54:30.155875+0000","last_undegraded":"2024-09-10T04:54:30.155875+0000","last_fullsized":"2024-09-10T04:54:30.155875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:30.155720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:30.155720+0000","last_clean_scrub_stamp":"2024-09-10T04:54:30.155720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:03.962323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:35.248935+0000","last_change":"2024-09-10T04:54:35.248935+0000","last_active":"2024-09-10T04:54:35.248935+0000","last_peered":"2024-09-10T04:54:35.248935+0000","last_clean":"2024-09-10T04:54:35.248935+0000","last_became_active":"2024-09-10T04:50:18.859594+0000","last_became_peered":"2024-09-10T04:50:18.859594+0000","last_unstale":"2024-09-10T04:54:35.248935+0000","last_undegraded":"2024-09-10T04:54:35.248935+0000","last_fullsized":"2024-09-10T04:54:35.248935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:35.248844+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:35.248844+0000","last_clean_scrub_stamp":"2024-09-10T04:54:35.248844+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:41.802239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.741729+0000","last_change":"2024-09-10T04:54:01.741624+0000","last_active":"2024-09-10T04:54:01.741729+0000","last_peered":"2024-09-10T04:54:01.741729+0000","last_clean":"2024-09-10T04:54:01.741729+0000","last_became_active":"2024-09-10T04:50:10.825912+0000","last_became_peered":"2024-09-10T04:50:10.825912+0000","last_unstale":"2024-09-10T04:54:01.741729+0000","last_undegraded":"2024-09-10T04:54:01.741729+0000","last_fullsized":"2024-09-10T04:54:01.741729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:01.741510+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.741510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.143399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.705604+0000","last_change":"2024-09-10T04:53:33.705492+0000","last_active":"2024-09-10T04:53:33.705604+0000","last_peered":"2024-09-10T04:53:33.705604+0000","last_clean":"2024-09-10T04:53:33.705604+0000","last_became_active":"2024-09-10T04:50:08.827257+0000","last_became_peered":"2024-09-10T04:50:08.827257+0000","last_unstale":"2024-09-10T04:53:33.705604+0000","last_undegraded":"2024-09-10T04:53:33.705604+0000","last_fullsized":"2024-09-10T04:53:33.705604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.705362+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.705362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:44.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.966092+0000","last_change":"2024-09-10T04:54:04.966021+0000","last_active":"2024-09-10T04:54:04.966092+0000","last_peered":"2024-09-10T04:54:04.966092+0000","last_clean":"2024-09-10T04:54:04.966092+0000","last_became_active":"2024-09-10T04:50:12.833844+0000","last_became_peered":"2024-09-10T04:50:12.833844+0000","last_unstale":"2024-09-10T04:54:04.966092+0000","last_undegraded":"2024-09-10T04:54:04.966092+0000","last_fullsized":"2024-09-10T04:54:04.966092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:04.965940+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.965940+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.903141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'47","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.188568+0000","last_change":"2024-09-10T04:54:02.188475+0000","last_active":"2024-09-10T04:54:02.188568+0000","last_peered":"2024-09-10T04:54:02.188568+0000","last_clean":"2024-09-10T04:54:02.188568+0000","last_became_active":"2024-09-10T04:50:14.837307+0000","last_became_peered":"2024-09-10T04:50:14.837307+0000","last_unstale":"2024-09-10T04:54:02.188568+0000","last_undegraded":"2024-09-10T04:54:02.188568+0000","last_fullsized":"2024-09-10T04:54:02.188568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:02.188348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.188348+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:09.968600+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.241913+0000","last_change":"2024-09-10T04:54:06.241799+0000","last_active":"2024-09-10T04:54:06.241913+0000","last_peered":"2024-09-10T04:54:06.241913+0000","last_clean":"2024-09-10T04:54:06.241913+0000","last_became_active":"2024-09-10T04:50:16.853908+0000","last_became_peered":"2024-09-10T04:50:16.853908+0000","last_unstale":"2024-09-10T04:54:06.241913+0000","last_undegraded":"2024-09-10T04:54:06.241913+0000","last_fullsized":"2024-09-10T04:54:06.241913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:06.241706+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.241706+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:36.748454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'17","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.894777+0000","last_change":"2024-09-10T04:54:21.894701+0000","last_active":"2024-09-10T04:54:21.894777+0000","last_peered":"2024-09-10T04:54:21.894777+0000","last_clean":"2024-09-10T04:54:21.894777+0000","last_became_active":"2024-09-10T04:50:18.856340+0000","last_became_peered":"2024-09-10T04:50:18.856340+0000","last_unstale":"2024-09-10T04:54:21.894777+0000","last_undegraded":"2024-09-10T04:54:21.894777+0000","last_fullsized":"2024-09-10T04:54:21.894777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-10T04:54:21.894606+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-10T04:54:21.894606+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.894606+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:35.373545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.303215+0000","last_change":"2024-09-10T04:53:41.303154+0000","last_active":"2024-09-10T04:53:41.303215+0000","last_peered":"2024-09-10T04:53:41.303215+0000","last_clean":"2024-09-10T04:53:41.303215+0000","last_became_active":"2024-09-10T04:50:10.825497+0000","last_became_peered":"2024-09-10T04:50:10.825497+0000","last_unstale":"2024-09-10T04:53:41.303215+0000","last_undegraded":"2024-09-10T04:53:41.303215+0000","last_fullsized":"2024-09-10T04:53:41.303215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:41.303062+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.303062+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:36.191501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.277904+0000","last_change":"2024-09-10T04:53:32.277832+0000","last_active":"2024-09-10T04:53:32.277904+0000","last_peered":"2024-09-10T04:53:32.277904+0000","last_clean":"2024-09-10T04:53:32.277904+0000","last_became_active":"2024-09-10T04:50:08.841889+0000","last_became_peered":"2024-09-10T04:50:08.841889+0000","last_unstale":"2024-09-10T04:53:32.277904+0000","last_undegraded":"2024-09-10T04:53:32.277904+0000","last_fullsized":"2024-09-10T04:53:32.277904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.277745+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.277745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:40.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.769946+0000","last_change":"2024-09-10T04:54:14.769879+0000","last_active":"2024-09-10T04:54:14.769946+0000","last_peered":"2024-09-10T04:54:14.769946+0000","last_clean":"2024-09-10T04:54:14.769946+0000","last_became_active":"2024-09-10T04:50:12.828545+0000","last_became_peered":"2024-09-10T04:50:12.828545+0000","last_unstale":"2024-09-10T04:54:14.769946+0000","last_undegraded":"2024-09-10T04:54:14.769946+0000","last_fullsized":"2024-09-10T04:54:14.769946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:14.769792+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:14.769792+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.769792+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:02.328008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.187628+0000","last_change":"2024-09-10T04:54:18.187560+0000","last_active":"2024-09-10T04:54:18.187628+0000","last_peered":"2024-09-10T04:54:18.187628+0000","last_clean":"2024-09-10T04:54:18.187628+0000","last_became_active":"2024-09-10T04:50:14.836481+0000","last_became_peered":"2024-09-10T04:50:14.836481+0000","last_unstale":"2024-09-10T04:54:18.187628+0000","last_undegraded":"2024-09-10T04:54:18.187628+0000","last_fullsized":"2024-09-10T04:54:18.187628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:54:18.187475+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:54:18.187475+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.187475+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:12.804445+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":524,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:28.738601+0000","last_change":"2024-09-10T04:54:28.738501+0000","last_active":"2024-09-10T04:54:28.738601+0000","last_peered":"2024-09-10T04:54:28.738601+0000","last_clean":"2024-09-10T04:54:28.738601+0000","last_became_active":"2024-09-10T04:50:16.853884+0000","last_became_peered":"2024-09-10T04:50:16.853884+0000","last_unstale":"2024-09-10T04:54:28.738601+0000","last_undegraded":"2024-09-10T04:54:28.738601+0000","last_fullsized":"2024-09-10T04:54:28.738601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:28.738378+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:28.738378+0000","last_clean_scrub_stamp":"2024-09-10T04:54:28.738378+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:42.113401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.252373+0000","last_change":"2024-09-10T04:54:12.252286+0000","last_active":"2024-09-10T04:54:12.252373+0000","last_peered":"2024-09-10T04:54:12.252373+0000","last_clean":"2024-09-10T04:54:12.252373+0000","last_became_active":"2024-09-10T04:50:18.856478+0000","last_became_peered":"2024-09-10T04:50:18.856478+0000","last_unstale":"2024-09-10T04:54:12.252373+0000","last_undegraded":"2024-09-10T04:54:12.252373+0000","last_fullsized":"2024-09-10T04:54:12.252373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:12.252165+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:12.252165+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.252165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.766994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.971005+0000","last_change":"2024-09-10T04:53:48.970935+0000","last_active":"2024-09-10T04:53:48.971005+0000","last_peered":"2024-09-10T04:53:48.971005+0000","last_clean":"2024-09-10T04:53:48.971005+0000","last_became_active":"2024-09-10T04:50:10.828662+0000","last_became_peered":"2024-09-10T04:50:10.828662+0000","last_unstale":"2024-09-10T04:53:48.971005+0000","last_undegraded":"2024-09-10T04:53:48.971005+0000","last_fullsized":"2024-09-10T04:53:48.971005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.970841+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.970841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.945727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.328682+0000","last_change":"2024-09-10T04:53:30.328609+0000","last_active":"2024-09-10T04:53:30.328682+0000","last_peered":"2024-09-10T04:53:30.328682+0000","last_clean":"2024-09-10T04:53:30.328682+0000","last_became_active":"2024-09-10T04:50:08.838649+0000","last_became_peered":"2024-09-10T04:50:08.838649+0000","last_unstale":"2024-09-10T04:53:30.328682+0000","last_undegraded":"2024-09-10T04:53:30.328682+0000","last_fullsized":"2024-09-10T04:53:30.328682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.328488+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.328488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:00.918192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.286143+0000","last_change":"2024-09-10T04:54:07.286074+0000","last_active":"2024-09-10T04:54:07.286143+0000","last_peered":"2024-09-10T04:54:07.286143+0000","last_clean":"2024-09-10T04:54:07.286143+0000","last_became_active":"2024-09-10T04:50:12.829297+0000","last_became_peered":"2024-09-10T04:50:12.829297+0000","last_unstale":"2024-09-10T04:54:07.286143+0000","last_undegraded":"2024-09-10T04:54:07.286143+0000","last_fullsized":"2024-09-10T04:54:07.286143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.285980+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.285980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:17.562378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.773223+0000","last_change":"2024-09-10T04:54:24.773150+0000","last_active":"2024-09-10T04:54:24.773223+0000","last_peered":"2024-09-10T04:54:24.773223+0000","last_clean":"2024-09-10T04:54:24.773223+0000","last_became_active":"2024-09-10T04:50:14.841566+0000","last_became_peered":"2024-09-10T04:50:14.841566+0000","last_unstale":"2024-09-10T04:54:24.773223+0000","last_undegraded":"2024-09-10T04:54:24.773223+0000","last_fullsized":"2024-09-10T04:54:24.773223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-10T04:54:24.773063+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-10T04:54:24.773063+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.773063+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:18.351493+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.699395+0000","last_change":"2024-09-10T04:54:27.699318+0000","last_active":"2024-09-10T04:54:27.699395+0000","last_peered":"2024-09-10T04:54:27.699395+0000","last_clean":"2024-09-10T04:54:27.699395+0000","last_became_active":"2024-09-10T04:50:16.844520+0000","last_became_peered":"2024-09-10T04:50:16.844520+0000","last_unstale":"2024-09-10T04:54:27.699395+0000","last_undegraded":"2024-09-10T04:54:27.699395+0000","last_fullsized":"2024-09-10T04:54:27.699395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:27.699234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:27.699234+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.699234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:19.573045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.931233+0000","last_change":"2024-09-10T04:54:23.931165+0000","last_active":"2024-09-10T04:54:23.931233+0000","last_peered":"2024-09-10T04:54:23.931233+0000","last_clean":"2024-09-10T04:54:23.931233+0000","last_became_active":"2024-09-10T04:50:18.852687+0000","last_became_peered":"2024-09-10T04:50:18.852687+0000","last_unstale":"2024-09-10T04:54:23.931233+0000","last_undegraded":"2024-09-10T04:54:23.931233+0000","last_fullsized":"2024-09-10T04:54:23.931233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-10T04:54:23.931081+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-10T04:54:23.931081+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.931081+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:01.663986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.671794+0000","last_change":"2024-09-10T04:53:50.671711+0000","last_active":"2024-09-10T04:53:50.671794+0000","last_peered":"2024-09-10T04:53:50.671794+0000","last_clean":"2024-09-10T04:53:50.671794+0000","last_became_active":"2024-09-10T04:50:10.832488+0000","last_became_peered":"2024-09-10T04:50:10.832488+0000","last_unstale":"2024-09-10T04:53:50.671794+0000","last_undegraded":"2024-09-10T04:53:50.671794+0000","last_fullsized":"2024-09-10T04:53:50.671794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:50.671613+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.671613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:06.215300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.032500+0000","last_change":"2024-09-10T04:53:29.032422+0000","last_active":"2024-09-10T04:53:29.032500+0000","last_peered":"2024-09-10T04:53:29.032500+0000","last_clean":"2024-09-10T04:53:29.032500+0000","last_became_active":"2024-09-10T04:49:54.975001+0000","last_became_peered":"2024-09-10T04:49:54.975001+0000","last_unstale":"2024-09-10T04:53:29.032500+0000","last_undegraded":"2024-09-10T04:53:29.032500+0000","last_fullsized":"2024-09-10T04:53:29.032500+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:53:29.032316+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.032316+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:21.648097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.757605+0000","last_change":"2024-09-10T04:53:28.757540+0000","last_active":"2024-09-10T04:53:28.757605+0000","last_peered":"2024-09-10T04:53:28.757605+0000","last_clean":"2024-09-10T04:53:28.757605+0000","last_became_active":"2024-09-10T04:49:59.532821+0000","last_became_peered":"2024-09-10T04:49:59.532821+0000","last_unstale":"2024-09-10T04:53:28.757605+0000","last_undegraded":"2024-09-10T04:53:28.757605+0000","last_fullsized":"2024-09-10T04:53:28.757605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:28.757471+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.757471+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:58.706956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011992000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.317397+0000","last_change":"2024-09-10T04:53:29.317328+0000","last_active":"2024-09-10T04:53:29.317397+0000","last_peered":"2024-09-10T04:53:29.317397+0000","last_clean":"2024-09-10T04:53:29.317397+0000","last_became_active":"2024-09-10T04:50:08.837488+0000","last_became_peered":"2024-09-10T04:50:08.837488+0000","last_unstale":"2024-09-10T04:53:29.317397+0000","last_undegraded":"2024-09-10T04:53:29.317397+0000","last_fullsized":"2024-09-10T04:53:29.317397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.317231+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.317231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:37.108405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.996991+0000","last_change":"2024-09-10T04:54:01.996930+0000","last_active":"2024-09-10T04:54:01.996991+0000","last_peered":"2024-09-10T04:54:01.996991+0000","last_clean":"2024-09-10T04:54:01.996991+0000","last_became_active":"2024-09-10T04:50:12.831080+0000","last_became_peered":"2024-09-10T04:50:12.831080+0000","last_unstale":"2024-09-10T04:54:01.996991+0000","last_undegraded":"2024-09-10T04:54:01.996991+0000","last_fullsized":"2024-09-10T04:54:01.996991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:01.996835+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.996835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:25.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'98","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.803260+0000","last_change":"2024-09-10T04:54:18.803172+0000","last_active":"2024-09-10T04:54:18.803260+0000","last_peered":"2024-09-10T04:54:18.803260+0000","last_clean":"2024-09-10T04:54:18.803260+0000","last_became_active":"2024-09-10T04:50:14.837891+0000","last_became_peered":"2024-09-10T04:50:14.837891+0000","last_unstale":"2024-09-10T04:54:18.803260+0000","last_undegraded":"2024-09-10T04:54:18.803260+0000","last_fullsized":"2024-09-10T04:54:18.803260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'98","last_scrub_stamp":"2024-09-10T04:54:18.803051+0000","last_deep_scrub":"34'98","last_deep_scrub_stamp":"2024-09-10T04:54:18.803051+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.803051+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:27.143882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.151557+0000","last_change":"2024-09-10T04:54:27.151465+0000","last_active":"2024-09-10T04:54:27.151557+0000","last_peered":"2024-09-10T04:54:27.151557+0000","last_clean":"2024-09-10T04:54:27.151557+0000","last_became_active":"2024-09-10T04:50:16.844501+0000","last_became_peered":"2024-09-10T04:50:16.844501+0000","last_unstale":"2024-09-10T04:54:27.151557+0000","last_undegraded":"2024-09-10T04:54:27.151557+0000","last_fullsized":"2024-09-10T04:54:27.151557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:27.151359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:27.151359+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.151359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:09.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:14.206686+0000","last_change":"2024-09-10T04:54:14.206574+0000","last_active":"2024-09-10T04:54:14.206686+0000","last_peered":"2024-09-10T04:54:14.206686+0000","last_clean":"2024-09-10T04:54:14.206686+0000","last_became_active":"2024-09-10T04:50:18.861018+0000","last_became_peered":"2024-09-10T04:50:18.861018+0000","last_unstale":"2024-09-10T04:54:14.206686+0000","last_undegraded":"2024-09-10T04:54:14.206686+0000","last_fullsized":"2024-09-10T04:54:14.206686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-09-10T04:54:14.206473+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-09-10T04:54:14.206473+0000","last_clean_scrub_stamp":"2024-09-10T04:54:14.206473+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:58.882825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.221647+0000","last_change":"2024-09-10T04:53:52.221557+0000","last_active":"2024-09-10T04:53:52.221647+0000","last_peered":"2024-09-10T04:53:52.221647+0000","last_clean":"2024-09-10T04:53:52.221647+0000","last_became_active":"2024-09-10T04:50:10.822812+0000","last_became_peered":"2024-09-10T04:50:10.822812+0000","last_unstale":"2024-09-10T04:53:52.221647+0000","last_undegraded":"2024-09-10T04:53:52.221647+0000","last_fullsized":"2024-09-10T04:53:52.221647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T04:53:52.221463+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.221463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:15.853804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:27.781682+0000","last_change":"2024-09-10T04:53:27.781601+0000","last_active":"2024-09-10T04:53:27.781682+0000","last_peered":"2024-09-10T04:53:27.781682+0000","last_clean":"2024-09-10T04:53:27.781682+0000","last_became_active":"2024-09-10T04:49:59.535370+0000","last_became_peered":"2024-09-10T04:49:59.535370+0000","last_unstale":"2024-09-10T04:53:27.781682+0000","last_undegraded":"2024-09-10T04:53:27.781682+0000","last_fullsized":"2024-09-10T04:53:27.781682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:27.781512+0000","last_clean_scrub_stamp":"2024-09-10T04:53:27.781512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:07.001654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058791599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.064680+0000","last_change":"2024-09-10T04:53:31.064620+0000","last_active":"2024-09-10T04:53:31.064680+0000","last_peered":"2024-09-10T04:53:31.064680+0000","last_clean":"2024-09-10T04:53:31.064680+0000","last_became_active":"2024-09-10T04:50:08.836081+0000","last_became_peered":"2024-09-10T04:50:08.836081+0000","last_unstale":"2024-09-10T04:53:31.064680+0000","last_undegraded":"2024-09-10T04:53:31.064680+0000","last_fullsized":"2024-09-10T04:53:31.064680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.064527+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.064527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:59.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.636761+0000","last_change":"2024-09-10T04:54:07.636690+0000","last_active":"2024-09-10T04:54:07.636761+0000","last_peered":"2024-09-10T04:54:07.636761+0000","last_clean":"2024-09-10T04:54:07.636761+0000","last_became_active":"2024-09-10T04:50:12.828585+0000","last_became_peered":"2024-09-10T04:50:12.828585+0000","last_unstale":"2024-09-10T04:54:07.636761+0000","last_undegraded":"2024-09-10T04:54:07.636761+0000","last_fullsized":"2024-09-10T04:54:07.636761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.636608+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.636608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:01.188346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'301","reported_seq":533,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.872923+0000","last_change":"2024-09-10T04:54:12.872830+0000","last_active":"2024-09-10T04:54:12.872923+0000","last_peered":"2024-09-10T04:54:12.872923+0000","last_clean":"2024-09-10T04:54:12.872923+0000","last_became_active":"2024-09-10T04:50:14.842391+0000","last_became_peered":"2024-09-10T04:50:14.842391+0000","last_unstale":"2024-09-10T04:54:12.872923+0000","last_undegraded":"2024-09-10T04:54:12.872923+0000","last_fullsized":"2024-09-10T04:54:12.872923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'301","last_scrub_stamp":"2024-09-10T04:54:12.872695+0000","last_deep_scrub":"34'301","last_deep_scrub_stamp":"2024-09-10T04:54:12.872695+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.872695+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:30.340721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.164086+0000","last_change":"2024-09-10T04:54:26.164015+0000","last_active":"2024-09-10T04:54:26.164086+0000","last_peered":"2024-09-10T04:54:26.164086+0000","last_clean":"2024-09-10T04:54:26.164086+0000","last_became_active":"2024-09-10T04:50:16.857137+0000","last_became_peered":"2024-09-10T04:50:16.857137+0000","last_unstale":"2024-09-10T04:54:26.164086+0000","last_undegraded":"2024-09-10T04:54:26.164086+0000","last_fullsized":"2024-09-10T04:54:26.164086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:26.163930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:26.163930+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.163930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:04.064439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:27.924499+0000","last_change":"2024-09-10T04:54:27.924425+0000","last_active":"2024-09-10T04:54:27.924499+0000","last_peered":"2024-09-10T04:54:27.924499+0000","last_clean":"2024-09-10T04:54:27.924499+0000","last_became_active":"2024-09-10T04:50:18.856512+0000","last_became_peered":"2024-09-10T04:50:18.856512+0000","last_unstale":"2024-09-10T04:54:27.924499+0000","last_undegraded":"2024-09-10T04:54:27.924499+0000","last_fullsized":"2024-09-10T04:54:27.924499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:27.924340+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:27.924340+0000","last_clean_scrub_stamp":"2024-09-10T04:54:27.924340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:19.480988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.984683+0000","last_change":"2024-09-10T04:53:45.984615+0000","last_active":"2024-09-10T04:53:45.984683+0000","last_peered":"2024-09-10T04:53:45.984683+0000","last_clean":"2024-09-10T04:53:45.984683+0000","last_became_active":"2024-09-10T04:50:10.826385+0000","last_became_peered":"2024-09-10T04:50:10.826385+0000","last_unstale":"2024-09-10T04:53:45.984683+0000","last_undegraded":"2024-09-10T04:53:45.984683+0000","last_fullsized":"2024-09-10T04:53:45.984683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:45.984537+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.984537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:29.250023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.495405+0000","last_change":"2024-09-10T04:53:28.495317+0000","last_active":"2024-09-10T04:53:28.495405+0000","last_peered":"2024-09-10T04:53:28.495405+0000","last_clean":"2024-09-10T04:53:28.495405+0000","last_became_active":"2024-09-10T04:49:59.532774+0000","last_became_peered":"2024-09-10T04:49:59.532774+0000","last_unstale":"2024-09-10T04:53:28.495405+0000","last_undegraded":"2024-09-10T04:53:28.495405+0000","last_fullsized":"2024-09-10T04:53:28.495405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.495201+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.495201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:10.015044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000487264,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.088894+0000","last_change":"2024-09-10T04:53:32.088819+0000","last_active":"2024-09-10T04:53:32.088894+0000","last_peered":"2024-09-10T04:53:32.088894+0000","last_clean":"2024-09-10T04:53:32.088894+0000","last_became_active":"2024-09-10T04:50:08.846904+0000","last_became_peered":"2024-09-10T04:50:08.846904+0000","last_unstale":"2024-09-10T04:53:32.088894+0000","last_undegraded":"2024-09-10T04:53:32.088894+0000","last_fullsized":"2024-09-10T04:53:32.088894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.088738+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.088738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:21.007330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.323242+0000","last_change":"2024-09-10T04:53:55.323181+0000","last_active":"2024-09-10T04:53:55.323242+0000","last_peered":"2024-09-10T04:53:55.323242+0000","last_clean":"2024-09-10T04:53:55.323242+0000","last_became_active":"2024-09-10T04:50:12.824916+0000","last_became_peered":"2024-09-10T04:50:12.824916+0000","last_unstale":"2024-09-10T04:53:55.323242+0000","last_undegraded":"2024-09-10T04:53:55.323242+0000","last_fullsized":"2024-09-10T04:53:55.323242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:55.323104+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.323104+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:01.158382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.221369+0000","last_change":"2024-09-10T04:54:01.221369+0000","last_active":"2024-09-10T04:54:01.221369+0000","last_peered":"2024-09-10T04:54:01.221369+0000","last_clean":"2024-09-10T04:54:01.221369+0000","last_became_active":"2024-09-10T04:50:48.878226+0000","last_became_peered":"2024-09-10T04:50:48.878226+0000","last_unstale":"2024-09-10T04:54:01.221369+0000","last_undegraded":"2024-09-10T04:54:01.221369+0000","last_fullsized":"2024-09-10T04:54:01.221369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-10T04:54:01.221267+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.221267+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:02.683817+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:30.910903+0000","last_change":"2024-09-10T04:54:30.910903+0000","last_active":"2024-09-10T04:54:30.910903+0000","last_peered":"2024-09-10T04:54:30.910903+0000","last_clean":"2024-09-10T04:54:30.910903+0000","last_became_active":"2024-09-10T04:50:16.855021+0000","last_became_peered":"2024-09-10T04:50:16.855021+0000","last_unstale":"2024-09-10T04:54:30.910903+0000","last_undegraded":"2024-09-10T04:54:30.910903+0000","last_fullsized":"2024-09-10T04:54:30.910903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:30.910803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:30.910803+0000","last_clean_scrub_stamp":"2024-09-10T04:54:30.910803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:31.110236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:34.211077+0000","last_change":"2024-09-10T04:54:34.211019+0000","last_active":"2024-09-10T04:54:34.211077+0000","last_peered":"2024-09-10T04:54:34.211077+0000","last_clean":"2024-09-10T04:54:34.211077+0000","last_became_active":"2024-09-10T04:50:18.860792+0000","last_became_peered":"2024-09-10T04:50:18.860792+0000","last_unstale":"2024-09-10T04:54:34.211077+0000","last_undegraded":"2024-09-10T04:54:34.211077+0000","last_fullsized":"2024-09-10T04:54:34.211077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:34.210933+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:34.210933+0000","last_clean_scrub_stamp":"2024-09-10T04:54:34.210933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:31.069326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'5","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.992949+0000","last_change":"2024-09-10T04:53:44.992890+0000","last_active":"2024-09-10T04:53:44.992949+0000","last_peered":"2024-09-10T04:53:44.992949+0000","last_clean":"2024-09-10T04:53:44.992949+0000","last_became_active":"2024-09-10T04:50:10.833640+0000","last_became_peered":"2024-09-10T04:50:10.833640+0000","last_unstale":"2024-09-10T04:53:44.992949+0000","last_undegraded":"2024-09-10T04:53:44.992949+0000","last_fullsized":"2024-09-10T04:53:44.992949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:53:44.992795+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.992795+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:39.339709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.729917+0000","last_change":"2024-09-10T04:53:31.729827+0000","last_active":"2024-09-10T04:53:31.729917+0000","last_peered":"2024-09-10T04:53:31.729917+0000","last_clean":"2024-09-10T04:53:31.729917+0000","last_became_active":"2024-09-10T04:49:59.535438+0000","last_became_peered":"2024-09-10T04:49:59.535438+0000","last_unstale":"2024-09-10T04:53:31.729917+0000","last_undegraded":"2024-09-10T04:53:31.729917+0000","last_fullsized":"2024-09-10T04:53:31.729917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:31.729700+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.729700+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:08.937521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00088603499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.700692+0000","last_change":"2024-09-10T04:53:32.700634+0000","last_active":"2024-09-10T04:53:32.700692+0000","last_peered":"2024-09-10T04:53:32.700692+0000","last_clean":"2024-09-10T04:53:32.700692+0000","last_became_active":"2024-09-10T04:50:08.827365+0000","last_became_peered":"2024-09-10T04:50:08.827365+0000","last_unstale":"2024-09-10T04:53:32.700692+0000","last_undegraded":"2024-09-10T04:53:32.700692+0000","last_fullsized":"2024-09-10T04:53:32.700692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.700535+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.700535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:14.164930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.966557+0000","last_change":"2024-09-10T04:54:02.966484+0000","last_active":"2024-09-10T04:54:02.966557+0000","last_peered":"2024-09-10T04:54:02.966557+0000","last_clean":"2024-09-10T04:54:02.966557+0000","last_became_active":"2024-09-10T04:50:12.829464+0000","last_became_peered":"2024-09-10T04:50:12.829464+0000","last_unstale":"2024-09-10T04:54:02.966557+0000","last_undegraded":"2024-09-10T04:54:02.966557+0000","last_fullsized":"2024-09-10T04:54:02.966557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:02.966403+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.966403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:09:41.433049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.204040+0000","last_change":"2024-09-10T04:54:15.203976+0000","last_active":"2024-09-10T04:54:15.204040+0000","last_peered":"2024-09-10T04:54:15.204040+0000","last_clean":"2024-09-10T04:54:15.204040+0000","last_became_active":"2024-09-10T04:50:14.837358+0000","last_became_peered":"2024-09-10T04:50:14.837358+0000","last_unstale":"2024-09-10T04:54:15.204040+0000","last_undegraded":"2024-09-10T04:54:15.204040+0000","last_fullsized":"2024-09-10T04:54:15.204040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-10T04:54:15.203892+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-10T04:54:15.203892+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.203892+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:47.717680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:28.146138+0000","last_change":"2024-09-10T04:54:28.146067+0000","last_active":"2024-09-10T04:54:28.146138+0000","last_peered":"2024-09-10T04:54:28.146138+0000","last_clean":"2024-09-10T04:54:28.146138+0000","last_became_active":"2024-09-10T04:50:16.856510+0000","last_became_peered":"2024-09-10T04:50:16.856510+0000","last_unstale":"2024-09-10T04:54:28.146138+0000","last_undegraded":"2024-09-10T04:54:28.146138+0000","last_fullsized":"2024-09-10T04:54:28.146138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:28.145983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:28.145983+0000","last_clean_scrub_stamp":"2024-09-10T04:54:28.145983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:00.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.865611+0000","last_change":"2024-09-10T04:54:25.865516+0000","last_active":"2024-09-10T04:54:25.865611+0000","last_peered":"2024-09-10T04:54:25.865611+0000","last_clean":"2024-09-10T04:54:25.865611+0000","last_became_active":"2024-09-10T04:50:18.863111+0000","last_became_peered":"2024-09-10T04:50:18.863111+0000","last_unstale":"2024-09-10T04:54:25.865611+0000","last_undegraded":"2024-09-10T04:54:25.865611+0000","last_fullsized":"2024-09-10T04:54:25.865611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:54:25.865409+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:54:25.865409+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.865409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:47.315881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.983754+0000","last_change":"2024-09-10T04:53:43.983700+0000","last_active":"2024-09-10T04:53:43.983754+0000","last_peered":"2024-09-10T04:53:43.983754+0000","last_clean":"2024-09-10T04:53:43.983754+0000","last_became_active":"2024-09-10T04:50:10.829047+0000","last_became_peered":"2024-09-10T04:50:10.829047+0000","last_unstale":"2024-09-10T04:53:43.983754+0000","last_undegraded":"2024-09-10T04:53:43.983754+0000","last_fullsized":"2024-09-10T04:53:43.983754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.983610+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.983610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:36.479094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.659336+0000","last_change":"2024-09-10T04:53:35.659260+0000","last_active":"2024-09-10T04:53:35.659336+0000","last_peered":"2024-09-10T04:53:35.659336+0000","last_clean":"2024-09-10T04:53:35.659336+0000","last_became_active":"2024-09-10T04:50:08.835874+0000","last_became_peered":"2024-09-10T04:50:08.835874+0000","last_unstale":"2024-09-10T04:53:35.659336+0000","last_undegraded":"2024-09-10T04:53:35.659336+0000","last_fullsized":"2024-09-10T04:53:35.659336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.659161+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.659161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:32.447113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.041864+0000","last_change":"2024-09-10T04:53:30.041761+0000","last_active":"2024-09-10T04:53:30.041864+0000","last_peered":"2024-09-10T04:53:30.041864+0000","last_clean":"2024-09-10T04:53:30.041864+0000","last_became_active":"2024-09-10T04:49:59.532779+0000","last_became_peered":"2024-09-10T04:49:59.532779+0000","last_unstale":"2024-09-10T04:53:30.041864+0000","last_undegraded":"2024-09-10T04:53:30.041864+0000","last_fullsized":"2024-09-10T04:53:30.041864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.041666+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.041666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:16.050227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048160800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.325588+0000","last_change":"2024-09-10T04:53:54.325503+0000","last_active":"2024-09-10T04:53:54.325588+0000","last_peered":"2024-09-10T04:53:54.325588+0000","last_clean":"2024-09-10T04:53:54.325588+0000","last_became_active":"2024-09-10T04:50:12.828819+0000","last_became_peered":"2024-09-10T04:50:12.828819+0000","last_unstale":"2024-09-10T04:53:54.325588+0000","last_undegraded":"2024-09-10T04:53:54.325588+0000","last_fullsized":"2024-09-10T04:53:54.325588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:54.325397+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.325397+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:39.140425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'91","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.913710+0000","last_change":"2024-09-10T04:54:11.913647+0000","last_active":"2024-09-10T04:54:11.913710+0000","last_peered":"2024-09-10T04:54:11.913710+0000","last_clean":"2024-09-10T04:54:11.913710+0000","last_became_active":"2024-09-10T04:50:14.844943+0000","last_became_peered":"2024-09-10T04:50:14.844943+0000","last_unstale":"2024-09-10T04:54:11.913710+0000","last_undegraded":"2024-09-10T04:54:11.913710+0000","last_fullsized":"2024-09-10T04:54:11.913710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-09-10T04:54:11.913542+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-09-10T04:54:11.913542+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.913542+0000","objects_scrubbed":11,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:03.525146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:26.746809+0000","last_change":"2024-09-10T04:54:26.746752+0000","last_active":"2024-09-10T04:54:26.746809+0000","last_peered":"2024-09-10T04:54:26.746809+0000","last_clean":"2024-09-10T04:54:26.746809+0000","last_became_active":"2024-09-10T04:50:16.842999+0000","last_became_peered":"2024-09-10T04:50:16.842999+0000","last_unstale":"2024-09-10T04:54:26.746809+0000","last_undegraded":"2024-09-10T04:54:26.746809+0000","last_fullsized":"2024-09-10T04:54:26.746809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:26.746660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:26.746660+0000","last_clean_scrub_stamp":"2024-09-10T04:54:26.746660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:18.621648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.179440+0000","last_change":"2024-09-10T04:54:16.179369+0000","last_active":"2024-09-10T04:54:16.179440+0000","last_peered":"2024-09-10T04:54:16.179440+0000","last_clean":"2024-09-10T04:54:16.179440+0000","last_became_active":"2024-09-10T04:50:18.852293+0000","last_became_peered":"2024-09-10T04:50:18.852293+0000","last_unstale":"2024-09-10T04:54:16.179440+0000","last_undegraded":"2024-09-10T04:54:16.179440+0000","last_fullsized":"2024-09-10T04:54:16.179440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-10T04:54:16.179261+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-10T04:54:16.179261+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.179261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:47.145918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.346585+0000","last_change":"2024-09-10T04:53:39.346585+0000","last_active":"2024-09-10T04:53:39.346585+0000","last_peered":"2024-09-10T04:53:39.346585+0000","last_clean":"2024-09-10T04:53:39.346585+0000","last_became_active":"2024-09-10T04:50:48.879007+0000","last_became_peered":"2024-09-10T04:50:48.879007+0000","last_unstale":"2024-09-10T04:53:39.346585+0000","last_undegraded":"2024-09-10T04:53:39.346585+0000","last_fullsized":"2024-09-10T04:53:39.346585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-10T04:53:39.346475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.346475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:40.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.040210+0000","last_change":"2024-09-10T04:53:33.040101+0000","last_active":"2024-09-10T04:53:33.040210+0000","last_peered":"2024-09-10T04:53:33.040210+0000","last_clean":"2024-09-10T04:53:33.040210+0000","last_became_active":"2024-09-10T04:50:08.836063+0000","last_became_peered":"2024-09-10T04:50:08.836063+0000","last_unstale":"2024-09-10T04:53:33.040210+0000","last_undegraded":"2024-09-10T04:53:33.040210+0000","last_fullsized":"2024-09-10T04:53:33.040210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.040007+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.040007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:55:13.761147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.707521+0000","last_change":"2024-09-10T04:53:29.707464+0000","last_active":"2024-09-10T04:53:29.707521+0000","last_peered":"2024-09-10T04:53:29.707521+0000","last_clean":"2024-09-10T04:53:29.707521+0000","last_became_active":"2024-09-10T04:49:59.532769+0000","last_became_peered":"2024-09-10T04:49:59.532769+0000","last_unstale":"2024-09-10T04:53:29.707521+0000","last_undegraded":"2024-09-10T04:53:29.707521+0000","last_fullsized":"2024-09-10T04:53:29.707521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.707394+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.707394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:41.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058268199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.733806+0000","last_change":"2024-09-10T04:54:13.733723+0000","last_active":"2024-09-10T04:54:13.733806+0000","last_peered":"2024-09-10T04:54:13.733806+0000","last_clean":"2024-09-10T04:54:13.733806+0000","last_became_active":"2024-09-10T04:50:12.829170+0000","last_became_peered":"2024-09-10T04:50:12.829170+0000","last_unstale":"2024-09-10T04:54:13.733806+0000","last_undegraded":"2024-09-10T04:54:13.733806+0000","last_fullsized":"2024-09-10T04:54:13.733806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:13.733604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:13.733604+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.733604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:46.748933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'28","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.942110+0000","last_change":"2024-09-10T04:54:10.942053+0000","last_active":"2024-09-10T04:54:10.942110+0000","last_peered":"2024-09-10T04:54:10.942110+0000","last_clean":"2024-09-10T04:54:10.942110+0000","last_became_active":"2024-09-10T04:50:14.843988+0000","last_became_peered":"2024-09-10T04:50:14.843988+0000","last_unstale":"2024-09-10T04:54:10.942110+0000","last_undegraded":"2024-09-10T04:54:10.942110+0000","last_fullsized":"2024-09-10T04:54:10.942110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-10T04:54:10.941945+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-10T04:54:10.941945+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.941945+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:37:13.031723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.814739+0000","last_change":"2024-09-10T04:54:15.814683+0000","last_active":"2024-09-10T04:54:15.814739+0000","last_peered":"2024-09-10T04:54:15.814739+0000","last_clean":"2024-09-10T04:54:15.814739+0000","last_became_active":"2024-09-10T04:50:16.855602+0000","last_became_peered":"2024-09-10T04:50:16.855602+0000","last_unstale":"2024-09-10T04:54:15.814739+0000","last_undegraded":"2024-09-10T04:54:15.814739+0000","last_fullsized":"2024-09-10T04:54:15.814739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:15.814598+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:15.814598+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.814598+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:30.326611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:36.276543+0000","last_change":"2024-09-10T04:54:36.276446+0000","last_active":"2024-09-10T04:54:36.276543+0000","last_peered":"2024-09-10T04:54:36.276543+0000","last_clean":"2024-09-10T04:54:36.276543+0000","last_became_active":"2024-09-10T04:50:18.861137+0000","last_became_peered":"2024-09-10T04:50:18.861137+0000","last_unstale":"2024-09-10T04:54:36.276543+0000","last_undegraded":"2024-09-10T04:54:36.276543+0000","last_fullsized":"2024-09-10T04:54:36.276543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:36.276355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:36.276355+0000","last_clean_scrub_stamp":"2024-09-10T04:54:36.276355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:44.235254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.239462+0000","last_change":"2024-09-10T04:53:51.239391+0000","last_active":"2024-09-10T04:53:51.239462+0000","last_peered":"2024-09-10T04:53:51.239462+0000","last_clean":"2024-09-10T04:53:51.239462+0000","last_became_active":"2024-09-10T04:50:10.835899+0000","last_became_peered":"2024-09-10T04:50:10.835899+0000","last_unstale":"2024-09-10T04:53:51.239462+0000","last_undegraded":"2024-09-10T04:53:51.239462+0000","last_fullsized":"2024-09-10T04:53:51.239462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:53:51.239300+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.239300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.849486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.288695+0000","last_change":"2024-09-10T04:53:31.288641+0000","last_active":"2024-09-10T04:53:31.288695+0000","last_peered":"2024-09-10T04:53:31.288695+0000","last_clean":"2024-09-10T04:53:31.288695+0000","last_became_active":"2024-09-10T04:50:08.846215+0000","last_became_peered":"2024-09-10T04:50:08.846215+0000","last_unstale":"2024-09-10T04:53:31.288695+0000","last_undegraded":"2024-09-10T04:53:31.288695+0000","last_fullsized":"2024-09-10T04:53:31.288695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:31.288558+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.288558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:03.075476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:28.028283+0000","last_change":"2024-09-10T04:53:28.028196+0000","last_active":"2024-09-10T04:53:28.028283+0000","last_peered":"2024-09-10T04:53:28.028283+0000","last_clean":"2024-09-10T04:53:28.028283+0000","last_became_active":"2024-09-10T04:49:59.529569+0000","last_became_peered":"2024-09-10T04:49:59.529569+0000","last_unstale":"2024-09-10T04:53:28.028283+0000","last_undegraded":"2024-09-10T04:53:28.028283+0000","last_fullsized":"2024-09-10T04:53:28.028283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:28.028080+0000","last_clean_scrub_stamp":"2024-09-10T04:53:28.028080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:07.938226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.676464+0000","last_change":"2024-09-10T04:54:06.676385+0000","last_active":"2024-09-10T04:54:06.676464+0000","last_peered":"2024-09-10T04:54:06.676464+0000","last_clean":"2024-09-10T04:54:06.676464+0000","last_became_active":"2024-09-10T04:50:12.827695+0000","last_became_peered":"2024-09-10T04:50:12.827695+0000","last_unstale":"2024-09-10T04:54:06.676464+0000","last_undegraded":"2024-09-10T04:54:06.676464+0000","last_fullsized":"2024-09-10T04:54:06.676464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.676303+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.676303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:14.695269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.209343+0000","last_change":"2024-09-10T04:54:13.209257+0000","last_active":"2024-09-10T04:54:13.209343+0000","last_peered":"2024-09-10T04:54:13.209343+0000","last_clean":"2024-09-10T04:54:13.209343+0000","last_became_active":"2024-09-10T04:50:14.835222+0000","last_became_peered":"2024-09-10T04:50:14.835222+0000","last_unstale":"2024-09-10T04:54:13.209343+0000","last_undegraded":"2024-09-10T04:54:13.209343+0000","last_fullsized":"2024-09-10T04:54:13.209343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:54:13.209124+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:54:13.209124+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.209124+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:12.186966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.193848+0000","last_change":"2024-09-10T04:54:25.193788+0000","last_active":"2024-09-10T04:54:25.193848+0000","last_peered":"2024-09-10T04:54:25.193848+0000","last_clean":"2024-09-10T04:54:25.193848+0000","last_became_active":"2024-09-10T04:50:16.857155+0000","last_became_peered":"2024-09-10T04:50:16.857155+0000","last_unstale":"2024-09-10T04:54:25.193848+0000","last_undegraded":"2024-09-10T04:54:25.193848+0000","last_fullsized":"2024-09-10T04:54:25.193848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:25.193697+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:25.193697+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.193697+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:17.859887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:29.947342+0000","last_change":"2024-09-10T04:54:29.947278+0000","last_active":"2024-09-10T04:54:29.947342+0000","last_peered":"2024-09-10T04:54:29.947342+0000","last_clean":"2024-09-10T04:54:29.947342+0000","last_became_active":"2024-09-10T04:50:18.860962+0000","last_became_peered":"2024-09-10T04:50:18.860962+0000","last_unstale":"2024-09-10T04:54:29.947342+0000","last_undegraded":"2024-09-10T04:54:29.947342+0000","last_fullsized":"2024-09-10T04:54:29.947342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T04:54:29.947186+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T04:54:29.947186+0000","last_clean_scrub_stamp":"2024-09-10T04:54:29.947186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:52.478145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.367966+0000","last_change":"2024-09-10T04:53:36.367879+0000","last_active":"2024-09-10T04:53:36.367966+0000","last_peered":"2024-09-10T04:53:36.367966+0000","last_clean":"2024-09-10T04:53:36.367966+0000","last_became_active":"2024-09-10T04:50:10.824719+0000","last_became_peered":"2024-09-10T04:50:10.824719+0000","last_unstale":"2024-09-10T04:53:36.367966+0000","last_undegraded":"2024-09-10T04:53:36.367966+0000","last_fullsized":"2024-09-10T04:53:36.367966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:36.367750+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.367750+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:06.024488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.090445+0000","last_change":"2024-09-10T04:53:34.090383+0000","last_active":"2024-09-10T04:53:34.090445+0000","last_peered":"2024-09-10T04:53:34.090445+0000","last_clean":"2024-09-10T04:53:34.090445+0000","last_became_active":"2024-09-10T04:50:08.837204+0000","last_became_peered":"2024-09-10T04:50:08.837204+0000","last_unstale":"2024-09-10T04:53:34.090445+0000","last_undegraded":"2024-09-10T04:53:34.090445+0000","last_fullsized":"2024-09-10T04:53:34.090445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.090296+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.090296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:53.934110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:30.721826+0000","last_change":"2024-09-10T04:53:30.721726+0000","last_active":"2024-09-10T04:53:30.721826+0000","last_peered":"2024-09-10T04:53:30.721826+0000","last_clean":"2024-09-10T04:53:30.721826+0000","last_became_active":"2024-09-10T04:49:59.535341+0000","last_became_peered":"2024-09-10T04:49:59.535341+0000","last_unstale":"2024-09-10T04:53:30.721826+0000","last_undegraded":"2024-09-10T04:53:30.721826+0000","last_fullsized":"2024-09-10T04:53:30.721826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:30.721635+0000","last_clean_scrub_stamp":"2024-09-10T04:53:30.721635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:26.199513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000894796,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.319796+0000","last_change":"2024-09-10T04:54:04.319734+0000","last_active":"2024-09-10T04:54:04.319796+0000","last_peered":"2024-09-10T04:54:04.319796+0000","last_clean":"2024-09-10T04:54:04.319796+0000","last_became_active":"2024-09-10T04:50:12.832671+0000","last_became_peered":"2024-09-10T04:50:12.832671+0000","last_unstale":"2024-09-10T04:54:04.319796+0000","last_undegraded":"2024-09-10T04:54:04.319796+0000","last_fullsized":"2024-09-10T04:54:04.319796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:04.319651+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.319651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:00.049390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.733922+0000","last_change":"2024-09-10T04:54:16.733861+0000","last_active":"2024-09-10T04:54:16.733922+0000","last_peered":"2024-09-10T04:54:16.733922+0000","last_clean":"2024-09-10T04:54:16.733922+0000","last_became_active":"2024-09-10T04:50:14.835330+0000","last_became_peered":"2024-09-10T04:50:14.835330+0000","last_unstale":"2024-09-10T04:54:16.733922+0000","last_undegraded":"2024-09-10T04:54:16.733922+0000","last_fullsized":"2024-09-10T04:54:16.733922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-09-10T04:54:16.733765+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-09-10T04:54:16.733765+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.733765+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:23.445805+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:24.143909+0000","last_change":"2024-09-10T04:54:24.143839+0000","last_active":"2024-09-10T04:54:24.143909+0000","last_peered":"2024-09-10T04:54:24.143909+0000","last_clean":"2024-09-10T04:54:24.143909+0000","last_became_active":"2024-09-10T04:50:16.856455+0000","last_became_peered":"2024-09-10T04:50:16.856455+0000","last_unstale":"2024-09-10T04:54:24.143909+0000","last_undegraded":"2024-09-10T04:54:24.143909+0000","last_fullsized":"2024-09-10T04:54:24.143909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:24.143739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:24.143739+0000","last_clean_scrub_stamp":"2024-09-10T04:54:24.143739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:21.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.189079+0000","last_change":"2024-09-10T04:54:15.188999+0000","last_active":"2024-09-10T04:54:15.189079+0000","last_peered":"2024-09-10T04:54:15.189079+0000","last_clean":"2024-09-10T04:54:15.189079+0000","last_became_active":"2024-09-10T04:50:18.858042+0000","last_became_peered":"2024-09-10T04:50:18.858042+0000","last_unstale":"2024-09-10T04:54:15.189079+0000","last_undegraded":"2024-09-10T04:54:15.189079+0000","last_fullsized":"2024-09-10T04:54:15.189079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:15.188913+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:15.188913+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.188913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:48.553602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.199189+0000","last_change":"2024-09-10T04:54:18.199122+0000","last_active":"2024-09-10T04:54:18.199189+0000","last_peered":"2024-09-10T04:54:18.199189+0000","last_clean":"2024-09-10T04:54:18.199189+0000","last_became_active":"2024-09-10T04:50:18.857843+0000","last_became_peered":"2024-09-10T04:50:18.857843+0000","last_unstale":"2024-09-10T04:54:18.199189+0000","last_undegraded":"2024-09-10T04:54:18.199189+0000","last_fullsized":"2024-09-10T04:54:18.199189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:18.199041+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:18.199041+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.199041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:25.990215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.327819+0000","last_change":"2024-09-10T04:53:44.327819+0000","last_active":"2024-09-10T04:53:44.327819+0000","last_peered":"2024-09-10T04:53:44.327819+0000","last_clean":"2024-09-10T04:53:44.327819+0000","last_became_active":"2024-09-10T04:50:10.824578+0000","last_became_peered":"2024-09-10T04:50:10.824578+0000","last_unstale":"2024-09-10T04:53:44.327819+0000","last_undegraded":"2024-09-10T04:53:44.327819+0000","last_fullsized":"2024-09-10T04:53:44.327819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:44.327731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.327731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:17.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.679013+0000","last_change":"2024-09-10T04:53:40.678937+0000","last_active":"2024-09-10T04:53:40.679013+0000","last_peered":"2024-09-10T04:53:40.679013+0000","last_clean":"2024-09-10T04:53:40.679013+0000","last_became_active":"2024-09-10T04:50:08.827492+0000","last_became_peered":"2024-09-10T04:50:08.827492+0000","last_unstale":"2024-09-10T04:53:40.679013+0000","last_undegraded":"2024-09-10T04:53:40.679013+0000","last_fullsized":"2024-09-10T04:53:40.679013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:40.678849+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.678849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:37.929824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.973068+0000","last_change":"2024-09-10T04:54:05.973068+0000","last_active":"2024-09-10T04:54:05.973068+0000","last_peered":"2024-09-10T04:54:05.973068+0000","last_clean":"2024-09-10T04:54:05.973068+0000","last_became_active":"2024-09-10T04:50:12.832828+0000","last_became_peered":"2024-09-10T04:50:12.832828+0000","last_unstale":"2024-09-10T04:54:05.973068+0000","last_undegraded":"2024-09-10T04:54:05.973068+0000","last_fullsized":"2024-09-10T04:54:05.973068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:05.972984+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.972984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:15.350827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:17.157546+0000","last_change":"2024-09-10T04:54:17.157546+0000","last_active":"2024-09-10T04:54:17.157546+0000","last_peered":"2024-09-10T04:54:17.157546+0000","last_clean":"2024-09-10T04:54:17.157546+0000","last_became_active":"2024-09-10T04:50:14.845648+0000","last_became_peered":"2024-09-10T04:50:14.845648+0000","last_unstale":"2024-09-10T04:54:17.157546+0000","last_undegraded":"2024-09-10T04:54:17.157546+0000","last_fullsized":"2024-09-10T04:54:17.157546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:17.157442+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:17.157442+0000","last_clean_scrub_stamp":"2024-09-10T04:54:17.157442+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:28.534441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:31.202003+0000","last_change":"2024-09-10T04:54:31.202003+0000","last_active":"2024-09-10T04:54:31.202003+0000","last_peered":"2024-09-10T04:54:31.202003+0000","last_clean":"2024-09-10T04:54:31.202003+0000","last_became_active":"2024-09-10T04:50:16.857986+0000","last_became_peered":"2024-09-10T04:50:16.857986+0000","last_unstale":"2024-09-10T04:54:31.202003+0000","last_undegraded":"2024-09-10T04:54:31.202003+0000","last_fullsized":"2024-09-10T04:54:31.202003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:31.201921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:31.201921+0000","last_clean_scrub_stamp":"2024-09-10T04:54:31.201921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:00.780299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:42.286596+0000","last_change":"2024-09-10T04:54:42.286596+0000","last_active":"2024-09-10T04:54:42.286596+0000","last_peered":"2024-09-10T04:54:42.286596+0000","last_clean":"2024-09-10T04:54:42.286596+0000","last_became_active":"2024-09-10T04:50:18.860969+0000","last_became_peered":"2024-09-10T04:50:18.860969+0000","last_unstale":"2024-09-10T04:54:42.286596+0000","last_undegraded":"2024-09-10T04:54:42.286596+0000","last_fullsized":"2024-09-10T04:54:42.286596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:54:42.286515+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:54:42.286515+0000","last_clean_scrub_stamp":"2024-09-10T04:54:42.286515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:50.698397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.931532+0000","last_change":"2024-09-10T04:53:49.931532+0000","last_active":"2024-09-10T04:53:49.931532+0000","last_peered":"2024-09-10T04:53:49.931532+0000","last_clean":"2024-09-10T04:53:49.931532+0000","last_became_active":"2024-09-10T04:50:10.828706+0000","last_became_peered":"2024-09-10T04:50:10.828706+0000","last_unstale":"2024-09-10T04:53:49.931532+0000","last_undegraded":"2024-09-10T04:53:49.931532+0000","last_fullsized":"2024-09-10T04:53:49.931532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:53:49.931431+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.931431+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:29.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":73,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:32.418743+0000","last_change":"2024-09-10T04:53:32.418743+0000","last_active":"2024-09-10T04:53:32.418743+0000","last_peered":"2024-09-10T04:53:32.418743+0000","last_clean":"2024-09-10T04:53:32.418743+0000","last_became_active":"2024-09-10T04:50:08.844545+0000","last_became_peered":"2024-09-10T04:50:08.844545+0000","last_unstale":"2024-09-10T04:53:32.418743+0000","last_undegraded":"2024-09-10T04:53:32.418743+0000","last_fullsized":"2024-09-10T04:53:32.418743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:32.418643+0000","last_clean_scrub_stamp":"2024-09-10T04:53:32.418643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:14.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.274686+0000","last_change":"2024-09-10T04:54:09.274686+0000","last_active":"2024-09-10T04:54:09.274686+0000","last_peered":"2024-09-10T04:54:09.274686+0000","last_clean":"2024-09-10T04:54:09.274686+0000","last_became_active":"2024-09-10T04:50:12.832384+0000","last_became_peered":"2024-09-10T04:50:12.832384+0000","last_unstale":"2024-09-10T04:54:09.274686+0000","last_undegraded":"2024-09-10T04:54:09.274686+0000","last_fullsized":"2024-09-10T04:54:09.274686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.274599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.274599+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.274599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:31.066695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:13.889775+0000","last_change":"2024-09-10T04:54:13.889775+0000","last_active":"2024-09-10T04:54:13.889775+0000","last_peered":"2024-09-10T04:54:13.889775+0000","last_clean":"2024-09-10T04:54:13.889775+0000","last_became_active":"2024-09-10T04:50:14.845992+0000","last_became_peered":"2024-09-10T04:50:14.845992+0000","last_unstale":"2024-09-10T04:54:13.889775+0000","last_undegraded":"2024-09-10T04:54:13.889775+0000","last_fullsized":"2024-09-10T04:54:13.889775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:54:13.889666+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:54:13.889666+0000","last_clean_scrub_stamp":"2024-09-10T04:54:13.889666+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:58.288079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.281435+0000","last_change":"2024-09-10T04:54:07.281435+0000","last_active":"2024-09-10T04:54:07.281435+0000","last_peered":"2024-09-10T04:54:07.281435+0000","last_clean":"2024-09-10T04:54:07.281435+0000","last_became_active":"2024-09-10T04:50:16.849810+0000","last_became_peered":"2024-09-10T04:50:16.849810+0000","last_unstale":"2024-09-10T04:54:07.281435+0000","last_undegraded":"2024-09-10T04:54:07.281435+0000","last_fullsized":"2024-09-10T04:54:07.281435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.281348+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.281348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:08.478561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:31.909346+0000","last_change":"2024-09-10T04:54:31.909346+0000","last_active":"2024-09-10T04:54:31.909346+0000","last_peered":"2024-09-10T04:54:31.909346+0000","last_clean":"2024-09-10T04:54:31.909346+0000","last_became_active":"2024-09-10T04:50:18.860511+0000","last_became_peered":"2024-09-10T04:50:18.860511+0000","last_unstale":"2024-09-10T04:54:31.909346+0000","last_undegraded":"2024-09-10T04:54:31.909346+0000","last_fullsized":"2024-09-10T04:54:31.909346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:31.909266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:31.909266+0000","last_clean_scrub_stamp":"2024-09-10T04:54:31.909266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:52.656318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.259529+0000","last_change":"2024-09-10T04:53:54.259529+0000","last_active":"2024-09-10T04:53:54.259529+0000","last_peered":"2024-09-10T04:53:54.259529+0000","last_clean":"2024-09-10T04:53:54.259529+0000","last_became_active":"2024-09-10T04:50:10.819795+0000","last_became_peered":"2024-09-10T04:50:10.819795+0000","last_unstale":"2024-09-10T04:53:54.259529+0000","last_undegraded":"2024-09-10T04:53:54.259529+0000","last_fullsized":"2024-09-10T04:53:54.259529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.259447+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.259447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T04:58:47.873888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.663976+0000","last_change":"2024-09-10T04:53:42.663976+0000","last_active":"2024-09-10T04:53:42.663976+0000","last_peered":"2024-09-10T04:53:42.663976+0000","last_clean":"2024-09-10T04:53:42.663976+0000","last_became_active":"2024-09-10T04:50:08.835955+0000","last_became_peered":"2024-09-10T04:50:08.835955+0000","last_unstale":"2024-09-10T04:53:42.663976+0000","last_undegraded":"2024-09-10T04:53:42.663976+0000","last_fullsized":"2024-09-10T04:53:42.663976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.663888+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.663888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.429104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.670824+0000","last_change":"2024-09-10T04:54:09.670824+0000","last_active":"2024-09-10T04:54:09.670824+0000","last_peered":"2024-09-10T04:54:09.670824+0000","last_clean":"2024-09-10T04:54:09.670824+0000","last_became_active":"2024-09-10T04:50:12.828516+0000","last_became_peered":"2024-09-10T04:50:12.828516+0000","last_unstale":"2024-09-10T04:54:09.670824+0000","last_undegraded":"2024-09-10T04:54:09.670824+0000","last_fullsized":"2024-09-10T04:54:09.670824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.670742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.670742+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.670742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.632640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.140792+0000","last_change":"2024-09-10T04:54:19.140792+0000","last_active":"2024-09-10T04:54:19.140792+0000","last_peered":"2024-09-10T04:54:19.140792+0000","last_clean":"2024-09-10T04:54:19.140792+0000","last_became_active":"2024-09-10T04:50:14.843544+0000","last_became_peered":"2024-09-10T04:50:14.843544+0000","last_unstale":"2024-09-10T04:54:19.140792+0000","last_undegraded":"2024-09-10T04:54:19.140792+0000","last_fullsized":"2024-09-10T04:54:19.140792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-10T04:54:19.140703+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-10T04:54:19.140703+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.140703+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:09.102846+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:18.890101+0000","last_change":"2024-09-10T04:54:18.890101+0000","last_active":"2024-09-10T04:54:18.890101+0000","last_peered":"2024-09-10T04:54:18.890101+0000","last_clean":"2024-09-10T04:54:18.890101+0000","last_became_active":"2024-09-10T04:50:16.849180+0000","last_became_peered":"2024-09-10T04:50:16.849180+0000","last_unstale":"2024-09-10T04:54:18.890101+0000","last_undegraded":"2024-09-10T04:54:18.890101+0000","last_fullsized":"2024-09-10T04:54:18.890101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:18.889996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:18.889996+0000","last_clean_scrub_stamp":"2024-09-10T04:54:18.889996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:37.585283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:41.281593+0000","last_change":"2024-09-10T04:54:41.281593+0000","last_active":"2024-09-10T04:54:41.281593+0000","last_peered":"2024-09-10T04:54:41.281593+0000","last_clean":"2024-09-10T04:54:41.281593+0000","last_became_active":"2024-09-10T04:50:18.850805+0000","last_became_peered":"2024-09-10T04:50:18.850805+0000","last_unstale":"2024-09-10T04:54:41.281593+0000","last_undegraded":"2024-09-10T04:54:41.281593+0000","last_fullsized":"2024-09-10T04:54:41.281593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:41.281510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:41.281510+0000","last_clean_scrub_stamp":"2024-09-10T04:54:41.281510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:16.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.253060+0000","last_change":"2024-09-10T04:53:53.253060+0000","last_active":"2024-09-10T04:53:53.253060+0000","last_peered":"2024-09-10T04:53:53.253060+0000","last_clean":"2024-09-10T04:53:53.253060+0000","last_became_active":"2024-09-10T04:50:10.834656+0000","last_became_peered":"2024-09-10T04:50:10.834656+0000","last_unstale":"2024-09-10T04:53:53.253060+0000","last_undegraded":"2024-09-10T04:53:53.253060+0000","last_fullsized":"2024-09-10T04:53:53.253060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:53.252977+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.252977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:43.553993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.053335+0000","last_change":"2024-09-10T04:53:35.053335+0000","last_active":"2024-09-10T04:53:35.053335+0000","last_peered":"2024-09-10T04:53:35.053335+0000","last_clean":"2024-09-10T04:53:35.053335+0000","last_became_active":"2024-09-10T04:50:08.846844+0000","last_became_peered":"2024-09-10T04:50:08.846844+0000","last_unstale":"2024-09-10T04:53:35.053335+0000","last_undegraded":"2024-09-10T04:53:35.053335+0000","last_fullsized":"2024-09-10T04:53:35.053335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:35.053227+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.053227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:06:46.229845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.296474+0000","last_change":"2024-09-10T04:54:08.296474+0000","last_active":"2024-09-10T04:54:08.296474+0000","last_peered":"2024-09-10T04:54:08.296474+0000","last_clean":"2024-09-10T04:54:08.296474+0000","last_became_active":"2024-09-10T04:50:12.830827+0000","last_became_peered":"2024-09-10T04:50:12.830827+0000","last_unstale":"2024-09-10T04:54:08.296474+0000","last_undegraded":"2024-09-10T04:54:08.296474+0000","last_fullsized":"2024-09-10T04:54:08.296474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:08.296376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:08.296376+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.296376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:47.645096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.771738+0000","last_change":"2024-09-10T04:54:23.771738+0000","last_active":"2024-09-10T04:54:23.771738+0000","last_peered":"2024-09-10T04:54:23.771738+0000","last_clean":"2024-09-10T04:54:23.771738+0000","last_became_active":"2024-09-10T04:50:14.832924+0000","last_became_peered":"2024-09-10T04:50:14.832924+0000","last_unstale":"2024-09-10T04:54:23.771738+0000","last_undegraded":"2024-09-10T04:54:23.771738+0000","last_fullsized":"2024-09-10T04:54:23.771738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-10T04:54:23.771652+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-10T04:54:23.771652+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.771652+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.885094+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.254311+0000","last_change":"2024-09-10T04:54:09.254311+0000","last_active":"2024-09-10T04:54:09.254311+0000","last_peered":"2024-09-10T04:54:09.254311+0000","last_clean":"2024-09-10T04:54:09.254311+0000","last_became_active":"2024-09-10T04:50:16.849664+0000","last_became_peered":"2024-09-10T04:50:16.849664+0000","last_unstale":"2024-09-10T04:54:09.254311+0000","last_undegraded":"2024-09-10T04:54:09.254311+0000","last_fullsized":"2024-09-10T04:54:09.254311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.254218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.254218+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.254218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:34.958521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.682970+0000","last_change":"2024-09-10T04:53:54.682910+0000","last_active":"2024-09-10T04:53:54.682970+0000","last_peered":"2024-09-10T04:53:54.682970+0000","last_clean":"2024-09-10T04:53:54.682970+0000","last_became_active":"2024-09-10T04:50:10.825806+0000","last_became_peered":"2024-09-10T04:50:10.825806+0000","last_unstale":"2024-09-10T04:53:54.682970+0000","last_undegraded":"2024-09-10T04:53:54.682970+0000","last_fullsized":"2024-09-10T04:53:54.682970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.682823+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.682823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.194837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.318043+0000","last_change":"2024-09-10T04:53:33.318043+0000","last_active":"2024-09-10T04:53:33.318043+0000","last_peered":"2024-09-10T04:53:33.318043+0000","last_clean":"2024-09-10T04:53:33.318043+0000","last_became_active":"2024-09-10T04:50:08.836930+0000","last_became_peered":"2024-09-10T04:50:08.836930+0000","last_unstale":"2024-09-10T04:53:33.318043+0000","last_undegraded":"2024-09-10T04:53:33.318043+0000","last_fullsized":"2024-09-10T04:53:33.318043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:33.317954+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.317954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:35.852351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:09.935671+0000","last_change":"2024-09-10T04:54:09.935623+0000","last_active":"2024-09-10T04:54:09.935671+0000","last_peered":"2024-09-10T04:54:09.935671+0000","last_clean":"2024-09-10T04:54:09.935671+0000","last_became_active":"2024-09-10T04:50:12.832672+0000","last_became_peered":"2024-09-10T04:50:12.832672+0000","last_unstale":"2024-09-10T04:54:09.935671+0000","last_undegraded":"2024-09-10T04:54:09.935671+0000","last_fullsized":"2024-09-10T04:54:09.935671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:09.935535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:09.935535+0000","last_clean_scrub_stamp":"2024-09-10T04:54:09.935535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:21.382944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'74","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:16.864560+0000","last_change":"2024-09-10T04:54:16.864560+0000","last_active":"2024-09-10T04:54:16.864560+0000","last_peered":"2024-09-10T04:54:16.864560+0000","last_clean":"2024-09-10T04:54:16.864560+0000","last_became_active":"2024-09-10T04:50:14.841364+0000","last_became_peered":"2024-09-10T04:50:14.841364+0000","last_unstale":"2024-09-10T04:54:16.864560+0000","last_undegraded":"2024-09-10T04:54:16.864560+0000","last_fullsized":"2024-09-10T04:54:16.864560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-10T04:54:16.864480+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-10T04:54:16.864480+0000","last_clean_scrub_stamp":"2024-09-10T04:54:16.864480+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:23.512175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":84,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.225383+0000","last_change":"2024-09-10T04:54:11.225383+0000","last_active":"2024-09-10T04:54:11.225383+0000","last_peered":"2024-09-10T04:54:11.225383+0000","last_clean":"2024-09-10T04:54:11.225383+0000","last_became_active":"2024-09-10T04:50:16.851163+0000","last_became_peered":"2024-09-10T04:50:16.851163+0000","last_unstale":"2024-09-10T04:54:11.225383+0000","last_undegraded":"2024-09-10T04:54:11.225383+0000","last_fullsized":"2024-09-10T04:54:11.225383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.225284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.225284+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.225284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.952541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:37.267586+0000","last_change":"2024-09-10T04:54:37.267586+0000","last_active":"2024-09-10T04:54:37.267586+0000","last_peered":"2024-09-10T04:54:37.267586+0000","last_clean":"2024-09-10T04:54:37.267586+0000","last_became_active":"2024-09-10T04:50:18.860468+0000","last_became_peered":"2024-09-10T04:50:18.860468+0000","last_unstale":"2024-09-10T04:54:37.267586+0000","last_undegraded":"2024-09-10T04:54:37.267586+0000","last_fullsized":"2024-09-10T04:54:37.267586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-10T04:54:37.267486+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-10T04:54:37.267486+0000","last_clean_scrub_stamp":"2024-09-10T04:54:37.267486+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:25.182803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:50.940166+0000","last_change":"2024-09-10T04:53:50.940056+0000","last_active":"2024-09-10T04:53:50.940166+0000","last_peered":"2024-09-10T04:53:50.940166+0000","last_clean":"2024-09-10T04:53:50.940166+0000","last_became_active":"2024-09-10T04:50:10.831643+0000","last_became_peered":"2024-09-10T04:50:10.831643+0000","last_unstale":"2024-09-10T04:53:50.940166+0000","last_undegraded":"2024-09-10T04:53:50.940166+0000","last_fullsized":"2024-09-10T04:53:50.940166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:50.939961+0000","last_clean_scrub_stamp":"2024-09-10T04:53:50.939961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:20.889446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.010426+0000","last_change":"2024-09-10T04:53:36.010426+0000","last_active":"2024-09-10T04:53:36.010426+0000","last_peered":"2024-09-10T04:53:36.010426+0000","last_clean":"2024-09-10T04:53:36.010426+0000","last_became_active":"2024-09-10T04:50:08.848374+0000","last_became_peered":"2024-09-10T04:50:08.848374+0000","last_unstale":"2024-09-10T04:53:36.010426+0000","last_undegraded":"2024-09-10T04:53:36.010426+0000","last_fullsized":"2024-09-10T04:53:36.010426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:36.010317+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.010317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:47.997647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:15.732097+0000","last_change":"2024-09-10T04:54:15.731997+0000","last_active":"2024-09-10T04:54:15.732097+0000","last_peered":"2024-09-10T04:54:15.732097+0000","last_clean":"2024-09-10T04:54:15.732097+0000","last_became_active":"2024-09-10T04:50:12.826253+0000","last_became_peered":"2024-09-10T04:50:12.826253+0000","last_unstale":"2024-09-10T04:54:15.732097+0000","last_undegraded":"2024-09-10T04:54:15.732097+0000","last_fullsized":"2024-09-10T04:54:15.732097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:15.731881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:15.731881+0000","last_clean_scrub_stamp":"2024-09-10T04:54:15.731881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:50.953318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'47","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:25.780646+0000","last_change":"2024-09-10T04:54:25.780646+0000","last_active":"2024-09-10T04:54:25.780646+0000","last_peered":"2024-09-10T04:54:25.780646+0000","last_clean":"2024-09-10T04:54:25.780646+0000","last_became_active":"2024-09-10T04:50:14.833264+0000","last_became_peered":"2024-09-10T04:50:14.833264+0000","last_unstale":"2024-09-10T04:54:25.780646+0000","last_undegraded":"2024-09-10T04:54:25.780646+0000","last_fullsized":"2024-09-10T04:54:25.780646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:25.780535+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:25.780535+0000","last_clean_scrub_stamp":"2024-09-10T04:54:25.780535+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:09.031462+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:20.900902+0000","last_change":"2024-09-10T04:54:20.900902+0000","last_active":"2024-09-10T04:54:20.900902+0000","last_peered":"2024-09-10T04:54:20.900902+0000","last_clean":"2024-09-10T04:54:20.900902+0000","last_became_active":"2024-09-10T04:50:16.855796+0000","last_became_peered":"2024-09-10T04:50:16.855796+0000","last_unstale":"2024-09-10T04:54:20.900902+0000","last_undegraded":"2024-09-10T04:54:20.900902+0000","last_fullsized":"2024-09-10T04:54:20.900902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:20.900811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:20.900811+0000","last_clean_scrub_stamp":"2024-09-10T04:54:20.900811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:25.373378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:38.612487+0000","last_change":"2024-09-10T04:54:38.612487+0000","last_active":"2024-09-10T04:54:38.612487+0000","last_peered":"2024-09-10T04:54:38.612487+0000","last_clean":"2024-09-10T04:54:38.612487+0000","last_became_active":"2024-09-10T04:50:18.853442+0000","last_became_peered":"2024-09-10T04:50:18.853442+0000","last_unstale":"2024-09-10T04:54:38.612487+0000","last_undegraded":"2024-09-10T04:54:38.612487+0000","last_fullsized":"2024-09-10T04:54:38.612487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:38.612395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:38.612395+0000","last_clean_scrub_stamp":"2024-09-10T04:54:38.612395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:00.889219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.241125+0000","last_change":"2024-09-10T04:53:59.241125+0000","last_active":"2024-09-10T04:53:59.241125+0000","last_peered":"2024-09-10T04:53:59.241125+0000","last_clean":"2024-09-10T04:53:59.241125+0000","last_became_active":"2024-09-10T04:50:10.828907+0000","last_became_peered":"2024-09-10T04:50:10.828907+0000","last_unstale":"2024-09-10T04:53:59.241125+0000","last_undegraded":"2024-09-10T04:53:59.241125+0000","last_fullsized":"2024-09-10T04:53:59.241125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:59.241037+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.241037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:07.535256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.710481+0000","last_change":"2024-09-10T04:53:48.710481+0000","last_active":"2024-09-10T04:53:48.710481+0000","last_peered":"2024-09-10T04:53:48.710481+0000","last_clean":"2024-09-10T04:53:48.710481+0000","last_became_active":"2024-09-10T04:50:08.828654+0000","last_became_peered":"2024-09-10T04:50:08.828654+0000","last_unstale":"2024-09-10T04:53:48.710481+0000","last_undegraded":"2024-09-10T04:53:48.710481+0000","last_fullsized":"2024-09-10T04:53:48.710481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:48.710387+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.710387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:16.041423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:12.735814+0000","last_change":"2024-09-10T04:54:12.735814+0000","last_active":"2024-09-10T04:54:12.735814+0000","last_peered":"2024-09-10T04:54:12.735814+0000","last_clean":"2024-09-10T04:54:12.735814+0000","last_became_active":"2024-09-10T04:50:12.825233+0000","last_became_peered":"2024-09-10T04:50:12.825233+0000","last_unstale":"2024-09-10T04:54:12.735814+0000","last_undegraded":"2024-09-10T04:54:12.735814+0000","last_fullsized":"2024-09-10T04:54:12.735814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:12.735703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:12.735703+0000","last_clean_scrub_stamp":"2024-09-10T04:54:12.735703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:09.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:23.195700+0000","last_change":"2024-09-10T04:54:23.195615+0000","last_active":"2024-09-10T04:54:23.195700+0000","last_peered":"2024-09-10T04:54:23.195700+0000","last_clean":"2024-09-10T04:54:23.195700+0000","last_became_active":"2024-09-10T04:50:14.836750+0000","last_became_peered":"2024-09-10T04:50:14.836750+0000","last_unstale":"2024-09-10T04:54:23.195700+0000","last_undegraded":"2024-09-10T04:54:23.195700+0000","last_fullsized":"2024-09-10T04:54:23.195700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-10T04:54:23.195495+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-10T04:54:23.195495+0000","last_clean_scrub_stamp":"2024-09-10T04:54:23.195495+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:29.620016+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:19.936024+0000","last_change":"2024-09-10T04:54:19.936024+0000","last_active":"2024-09-10T04:54:19.936024+0000","last_peered":"2024-09-10T04:54:19.936024+0000","last_clean":"2024-09-10T04:54:19.936024+0000","last_became_active":"2024-09-10T04:50:16.854777+0000","last_became_peered":"2024-09-10T04:50:16.854777+0000","last_unstale":"2024-09-10T04:54:19.936024+0000","last_undegraded":"2024-09-10T04:54:19.936024+0000","last_fullsized":"2024-09-10T04:54:19.936024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:19.935940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:19.935940+0000","last_clean_scrub_stamp":"2024-09-10T04:54:19.935940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:52.515529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:35.695508+0000","last_change":"2024-09-10T04:54:35.695508+0000","last_active":"2024-09-10T04:54:35.695508+0000","last_peered":"2024-09-10T04:54:35.695508+0000","last_clean":"2024-09-10T04:54:35.695508+0000","last_became_active":"2024-09-10T04:50:18.853847+0000","last_became_peered":"2024-09-10T04:50:18.853847+0000","last_unstale":"2024-09-10T04:54:35.695508+0000","last_undegraded":"2024-09-10T04:54:35.695508+0000","last_fullsized":"2024-09-10T04:54:35.695508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:54:35.695414+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:54:35.695414+0000","last_clean_scrub_stamp":"2024-09-10T04:54:35.695414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:36.068583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"34'15","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:46.340290+0000","last_change":"2024-09-10T04:53:46.340290+0000","last_active":"2024-09-10T04:53:46.340290+0000","last_peered":"2024-09-10T04:53:46.340290+0000","last_clean":"2024-09-10T04:53:46.340290+0000","last_became_active":"2024-09-10T04:50:10.832952+0000","last_became_peered":"2024-09-10T04:50:10.832952+0000","last_unstale":"2024-09-10T04:53:46.340290+0000","last_undegraded":"2024-09-10T04:53:46.340290+0000","last_fullsized":"2024-09-10T04:53:46.340290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-10T04:53:46.340190+0000","last_clean_scrub_stamp":"2024-09-10T04:53:46.340190+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:49.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":59,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.375559+0000","last_change":"2024-09-10T04:53:37.375559+0000","last_active":"2024-09-10T04:53:37.375559+0000","last_peered":"2024-09-10T04:53:37.375559+0000","last_clean":"2024-09-10T04:53:37.375559+0000","last_became_active":"2024-09-10T04:50:08.843801+0000","last_became_peered":"2024-09-10T04:50:08.843801+0000","last_unstale":"2024-09-10T04:53:37.375559+0000","last_undegraded":"2024-09-10T04:53:37.375559+0000","last_fullsized":"2024-09-10T04:53:37.375559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.375475+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.375475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:54.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:08.961410+0000","last_change":"2024-09-10T04:54:08.961410+0000","last_active":"2024-09-10T04:54:08.961410+0000","last_peered":"2024-09-10T04:54:08.961410+0000","last_clean":"2024-09-10T04:54:08.961410+0000","last_became_active":"2024-09-10T04:50:12.829190+0000","last_became_peered":"2024-09-10T04:50:12.829190+0000","last_unstale":"2024-09-10T04:54:08.961410+0000","last_undegraded":"2024-09-10T04:54:08.961410+0000","last_fullsized":"2024-09-10T04:54:08.961410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:08.961321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:08.961321+0000","last_clean_scrub_stamp":"2024-09-10T04:54:08.961321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:07:33.180605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.196771+0000","last_change":"2024-09-10T04:54:22.196771+0000","last_active":"2024-09-10T04:54:22.196771+0000","last_peered":"2024-09-10T04:54:22.196771+0000","last_clean":"2024-09-10T04:54:22.196771+0000","last_became_active":"2024-09-10T04:50:14.837684+0000","last_became_peered":"2024-09-10T04:50:14.837684+0000","last_unstale":"2024-09-10T04:54:22.196771+0000","last_undegraded":"2024-09-10T04:54:22.196771+0000","last_fullsized":"2024-09-10T04:54:22.196771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-10T04:54:22.196672+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-10T04:54:22.196672+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.196672+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:00:29.908527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:40.593975+0000","last_change":"2024-09-10T04:54:40.593975+0000","last_active":"2024-09-10T04:54:40.593975+0000","last_peered":"2024-09-10T04:54:40.593975+0000","last_clean":"2024-09-10T04:54:40.593975+0000","last_became_active":"2024-09-10T04:50:16.846656+0000","last_became_peered":"2024-09-10T04:50:16.846656+0000","last_unstale":"2024-09-10T04:54:40.593975+0000","last_undegraded":"2024-09-10T04:54:40.593975+0000","last_fullsized":"2024-09-10T04:54:40.593975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-10T04:54:40.593878+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-10T04:54:40.593878+0000","last_clean_scrub_stamp":"2024-09-10T04:54:40.593878+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:46.038487+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:33.722852+0000","last_change":"2024-09-10T04:54:33.722852+0000","last_active":"2024-09-10T04:54:33.722852+0000","last_peered":"2024-09-10T04:54:33.722852+0000","last_clean":"2024-09-10T04:54:33.722852+0000","last_became_active":"2024-09-10T04:50:18.859628+0000","last_became_peered":"2024-09-10T04:50:18.859628+0000","last_unstale":"2024-09-10T04:54:33.722852+0000","last_undegraded":"2024-09-10T04:54:33.722852+0000","last_fullsized":"2024-09-10T04:54:33.722852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:33.722766+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:33.722766+0000","last_clean_scrub_stamp":"2024-09-10T04:54:33.722766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:55.635247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.310068+0000","last_change":"2024-09-10T04:53:45.310068+0000","last_active":"2024-09-10T04:53:45.310068+0000","last_peered":"2024-09-10T04:53:45.310068+0000","last_clean":"2024-09-10T04:53:45.310068+0000","last_became_active":"2024-09-10T04:50:10.830919+0000","last_became_peered":"2024-09-10T04:50:10.830919+0000","last_unstale":"2024-09-10T04:53:45.310068+0000","last_undegraded":"2024-09-10T04:53:45.310068+0000","last_fullsized":"2024-09-10T04:53:45.310068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:45.309974+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.309974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.962640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.966331+0000","last_change":"2024-09-10T04:53:36.966331+0000","last_active":"2024-09-10T04:53:36.966331+0000","last_peered":"2024-09-10T04:53:36.966331+0000","last_clean":"2024-09-10T04:53:36.966331+0000","last_became_active":"2024-09-10T04:50:08.847268+0000","last_became_peered":"2024-09-10T04:50:08.847268+0000","last_unstale":"2024-09-10T04:53:36.966331+0000","last_undegraded":"2024-09-10T04:53:36.966331+0000","last_fullsized":"2024-09-10T04:53:36.966331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.966245+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.966245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:04.697203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:07.975729+0000","last_change":"2024-09-10T04:54:07.975729+0000","last_active":"2024-09-10T04:54:07.975729+0000","last_peered":"2024-09-10T04:54:07.975729+0000","last_clean":"2024-09-10T04:54:07.975729+0000","last_became_active":"2024-09-10T04:50:12.834238+0000","last_became_peered":"2024-09-10T04:50:12.834238+0000","last_unstale":"2024-09-10T04:54:07.975729+0000","last_undegraded":"2024-09-10T04:54:07.975729+0000","last_fullsized":"2024-09-10T04:54:07.975729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:07.975638+0000","last_clean_scrub_stamp":"2024-09-10T04:54:07.975638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:37.274445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:22.812984+0000","last_change":"2024-09-10T04:54:22.812984+0000","last_active":"2024-09-10T04:54:22.812984+0000","last_peered":"2024-09-10T04:54:22.812984+0000","last_clean":"2024-09-10T04:54:22.812984+0000","last_became_active":"2024-09-10T04:50:14.844146+0000","last_became_peered":"2024-09-10T04:50:14.844146+0000","last_unstale":"2024-09-10T04:54:22.812984+0000","last_undegraded":"2024-09-10T04:54:22.812984+0000","last_fullsized":"2024-09-10T04:54:22.812984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-09-10T04:54:22.812877+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-09-10T04:54:22.812877+0000","last_clean_scrub_stamp":"2024-09-10T04:54:22.812877+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:47.162758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:33.171046+0000","last_change":"2024-09-10T04:54:33.171046+0000","last_active":"2024-09-10T04:54:33.171046+0000","last_peered":"2024-09-10T04:54:33.171046+0000","last_clean":"2024-09-10T04:54:33.171046+0000","last_became_active":"2024-09-10T04:50:16.845128+0000","last_became_peered":"2024-09-10T04:50:16.845128+0000","last_unstale":"2024-09-10T04:54:33.171046+0000","last_undegraded":"2024-09-10T04:54:33.171046+0000","last_fullsized":"2024-09-10T04:54:33.171046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:33.170948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:33.170948+0000","last_clean_scrub_stamp":"2024-09-10T04:54:33.170948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:24.745656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:41.621465+0000","last_change":"2024-09-10T04:54:41.621465+0000","last_active":"2024-09-10T04:54:41.621465+0000","last_peered":"2024-09-10T04:54:41.621465+0000","last_clean":"2024-09-10T04:54:41.621465+0000","last_became_active":"2024-09-10T04:50:18.854409+0000","last_became_peered":"2024-09-10T04:50:18.854409+0000","last_unstale":"2024-09-10T04:54:41.621465+0000","last_undegraded":"2024-09-10T04:54:41.621465+0000","last_fullsized":"2024-09-10T04:54:41.621465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:41.621362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:41.621362+0000","last_clean_scrub_stamp":"2024-09-10T04:54:41.621362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:33.139325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.695353+0000","last_change":"2024-09-10T04:53:55.695353+0000","last_active":"2024-09-10T04:53:55.695353+0000","last_peered":"2024-09-10T04:53:55.695353+0000","last_clean":"2024-09-10T04:53:55.695353+0000","last_became_active":"2024-09-10T04:50:10.826430+0000","last_became_peered":"2024-09-10T04:50:10.826430+0000","last_unstale":"2024-09-10T04:53:55.695353+0000","last_undegraded":"2024-09-10T04:53:55.695353+0000","last_fullsized":"2024-09-10T04:53:55.695353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.695256+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.695256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:02.342950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.701876+0000","last_change":"2024-09-10T04:53:43.701876+0000","last_active":"2024-09-10T04:53:43.701876+0000","last_peered":"2024-09-10T04:53:43.701876+0000","last_clean":"2024-09-10T04:53:43.701876+0000","last_became_active":"2024-09-10T04:50:08.836578+0000","last_became_peered":"2024-09-10T04:50:08.836578+0000","last_unstale":"2024-09-10T04:53:43.701876+0000","last_undegraded":"2024-09-10T04:53:43.701876+0000","last_fullsized":"2024-09-10T04:53:43.701876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.701760+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.701760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:03.638962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:11.758338+0000","last_change":"2024-09-10T04:54:11.758338+0000","last_active":"2024-09-10T04:54:11.758338+0000","last_peered":"2024-09-10T04:54:11.758338+0000","last_clean":"2024-09-10T04:54:11.758338+0000","last_became_active":"2024-09-10T04:50:12.826226+0000","last_became_peered":"2024-09-10T04:50:12.826226+0000","last_unstale":"2024-09-10T04:54:11.758338+0000","last_undegraded":"2024-09-10T04:54:11.758338+0000","last_fullsized":"2024-09-10T04:54:11.758338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:11.758248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:11.758248+0000","last_clean_scrub_stamp":"2024-09-10T04:54:11.758248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:02.430783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:04.202766+0000","last_change":"2024-09-10T04:54:04.202766+0000","last_active":"2024-09-10T04:54:04.202766+0000","last_peered":"2024-09-10T04:54:04.202766+0000","last_clean":"2024-09-10T04:54:04.202766+0000","last_became_active":"2024-09-10T04:50:14.844718+0000","last_became_peered":"2024-09-10T04:50:14.844718+0000","last_unstale":"2024-09-10T04:54:04.202766+0000","last_undegraded":"2024-09-10T04:54:04.202766+0000","last_fullsized":"2024-09-10T04:54:04.202766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-10T04:54:04.202664+0000","last_clean_scrub_stamp":"2024-09-10T04:54:04.202664+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:51.889203+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:30.797824+0000","last_change":"2024-09-10T04:54:30.797824+0000","last_active":"2024-09-10T04:54:30.797824+0000","last_peered":"2024-09-10T04:54:30.797824+0000","last_clean":"2024-09-10T04:54:30.797824+0000","last_became_active":"2024-09-10T04:50:16.847718+0000","last_became_peered":"2024-09-10T04:50:16.847718+0000","last_unstale":"2024-09-10T04:54:30.797824+0000","last_undegraded":"2024-09-10T04:54:30.797824+0000","last_fullsized":"2024-09-10T04:54:30.797824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:30.797724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:30.797724+0000","last_clean_scrub_stamp":"2024-09-10T04:54:30.797724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:31.097633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:39.335305+0000","last_change":"2024-09-10T04:54:39.335305+0000","last_active":"2024-09-10T04:54:39.335305+0000","last_peered":"2024-09-10T04:54:39.335305+0000","last_clean":"2024-09-10T04:54:39.335305+0000","last_became_active":"2024-09-10T04:50:18.862059+0000","last_became_peered":"2024-09-10T04:50:18.862059+0000","last_unstale":"2024-09-10T04:54:39.335305+0000","last_undegraded":"2024-09-10T04:54:39.335305+0000","last_fullsized":"2024-09-10T04:54:39.335305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-10T04:54:39.335207+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-10T04:54:39.335207+0000","last_clean_scrub_stamp":"2024-09-10T04:54:39.335207+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:16:08.566859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.284384+0000","last_change":"2024-09-10T04:54:00.284384+0000","last_active":"2024-09-10T04:54:00.284384+0000","last_peered":"2024-09-10T04:54:00.284384+0000","last_clean":"2024-09-10T04:54:00.284384+0000","last_became_active":"2024-09-10T04:50:10.826064+0000","last_became_peered":"2024-09-10T04:50:10.826064+0000","last_unstale":"2024-09-10T04:54:00.284384+0000","last_undegraded":"2024-09-10T04:54:00.284384+0000","last_fullsized":"2024-09-10T04:54:00.284384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:00.284291+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.284291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:36.338885+0000","last_change":"2024-09-10T04:53:36.338818+0000","last_active":"2024-09-10T04:53:36.338885+0000","last_peered":"2024-09-10T04:53:36.338885+0000","last_clean":"2024-09-10T04:53:36.338885+0000","last_became_active":"2024-09-10T04:50:08.840122+0000","last_became_peered":"2024-09-10T04:50:08.840122+0000","last_unstale":"2024-09-10T04:53:36.338885+0000","last_undegraded":"2024-09-10T04:53:36.338885+0000","last_fullsized":"2024-09-10T04:53:36.338885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:36.338731+0000","last_clean_scrub_stamp":"2024-09-10T04:53:36.338731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:42.753949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:06.956604+0000","last_change":"2024-09-10T04:54:06.956604+0000","last_active":"2024-09-10T04:54:06.956604+0000","last_peered":"2024-09-10T04:54:06.956604+0000","last_clean":"2024-09-10T04:54:06.956604+0000","last_became_active":"2024-09-10T04:50:12.834211+0000","last_became_peered":"2024-09-10T04:50:12.834211+0000","last_unstale":"2024-09-10T04:54:06.956604+0000","last_undegraded":"2024-09-10T04:54:06.956604+0000","last_fullsized":"2024-09-10T04:54:06.956604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:06.956506+0000","last_clean_scrub_stamp":"2024-09-10T04:54:06.956506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:54.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'39","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:21.150790+0000","last_change":"2024-09-10T04:54:21.150790+0000","last_active":"2024-09-10T04:54:21.150790+0000","last_peered":"2024-09-10T04:54:21.150790+0000","last_clean":"2024-09-10T04:54:21.150790+0000","last_became_active":"2024-09-10T04:50:14.838060+0000","last_became_peered":"2024-09-10T04:50:14.838060+0000","last_unstale":"2024-09-10T04:54:21.150790+0000","last_undegraded":"2024-09-10T04:54:21.150790+0000","last_fullsized":"2024-09-10T04:54:21.150790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-10T04:54:21.150706+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-10T04:54:21.150706+0000","last_clean_scrub_stamp":"2024-09-10T04:54:21.150706+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:46.975486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:34.689681+0000","last_change":"2024-09-10T04:54:34.689681+0000","last_active":"2024-09-10T04:54:34.689681+0000","last_peered":"2024-09-10T04:54:34.689681+0000","last_clean":"2024-09-10T04:54:34.689681+0000","last_became_active":"2024-09-10T04:50:16.844571+0000","last_became_peered":"2024-09-10T04:50:16.844571+0000","last_unstale":"2024-09-10T04:54:34.689681+0000","last_undegraded":"2024-09-10T04:54:34.689681+0000","last_fullsized":"2024-09-10T04:54:34.689681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:34.689595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:34.689595+0000","last_clean_scrub_stamp":"2024-09-10T04:54:34.689595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:10.712884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:38.303960+0000","last_change":"2024-09-10T04:54:38.303960+0000","last_active":"2024-09-10T04:54:38.303960+0000","last_peered":"2024-09-10T04:54:38.303960+0000","last_clean":"2024-09-10T04:54:38.303960+0000","last_became_active":"2024-09-10T04:50:18.860062+0000","last_became_peered":"2024-09-10T04:50:18.860062+0000","last_unstale":"2024-09-10T04:54:38.303960+0000","last_undegraded":"2024-09-10T04:54:38.303960+0000","last_fullsized":"2024-09-10T04:54:38.303960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:38.303867+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:38.303867+0000","last_clean_scrub_stamp":"2024-09-10T04:54:38.303867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:00.053797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.326879+0000","last_change":"2024-09-10T04:53:43.326879+0000","last_active":"2024-09-10T04:53:43.326879+0000","last_peered":"2024-09-10T04:53:43.326879+0000","last_clean":"2024-09-10T04:53:43.326879+0000","last_became_active":"2024-09-10T04:50:48.875572+0000","last_became_peered":"2024-09-10T04:50:48.875572+0000","last_unstale":"2024-09-10T04:53:43.326879+0000","last_undegraded":"2024-09-10T04:53:43.326879+0000","last_fullsized":"2024-09-10T04:53:43.326879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-10T04:53:43.326755+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.326755+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:11.173395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:37.936469+0000","last_change":"2024-09-10T04:53:37.936400+0000","last_active":"2024-09-10T04:53:37.936469+0000","last_peered":"2024-09-10T04:53:37.936469+0000","last_clean":"2024-09-10T04:53:37.936469+0000","last_became_active":"2024-09-10T04:50:08.848136+0000","last_became_peered":"2024-09-10T04:50:08.848136+0000","last_unstale":"2024-09-10T04:53:37.936469+0000","last_undegraded":"2024-09-10T04:53:37.936469+0000","last_fullsized":"2024-09-10T04:53:37.936469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:37.936312+0000","last_clean_scrub_stamp":"2024-09-10T04:53:37.936312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:39.782085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:59.264435+0000","last_change":"2024-09-10T04:53:59.264435+0000","last_active":"2024-09-10T04:53:59.264435+0000","last_peered":"2024-09-10T04:53:59.264435+0000","last_clean":"2024-09-10T04:53:59.264435+0000","last_became_active":"2024-09-10T04:50:48.883993+0000","last_became_peered":"2024-09-10T04:50:48.883993+0000","last_unstale":"2024-09-10T04:53:59.264435+0000","last_undegraded":"2024-09-10T04:53:59.264435+0000","last_fullsized":"2024-09-10T04:53:59.264435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-10T04:53:59.264356+0000","last_clean_scrub_stamp":"2024-09-10T04:53:59.264356+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:40.322391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:29.787616+0000","last_change":"2024-09-10T04:54:29.787616+0000","last_active":"2024-09-10T04:54:29.787616+0000","last_peered":"2024-09-10T04:54:29.787616+0000","last_clean":"2024-09-10T04:54:29.787616+0000","last_became_active":"2024-09-10T04:50:14.833333+0000","last_became_peered":"2024-09-10T04:50:14.833333+0000","last_unstale":"2024-09-10T04:54:29.787616+0000","last_undegraded":"2024-09-10T04:54:29.787616+0000","last_fullsized":"2024-09-10T04:54:29.787616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-09-10T04:54:29.787520+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-09-10T04:54:29.787520+0000","last_clean_scrub_stamp":"2024-09-10T04:54:29.787520+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:01.924897+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:10.216554+0000","last_change":"2024-09-10T04:54:10.216554+0000","last_active":"2024-09-10T04:54:10.216554+0000","last_peered":"2024-09-10T04:54:10.216554+0000","last_clean":"2024-09-10T04:54:10.216554+0000","last_became_active":"2024-09-10T04:50:16.854269+0000","last_became_peered":"2024-09-10T04:50:16.854269+0000","last_unstale":"2024-09-10T04:54:10.216554+0000","last_undegraded":"2024-09-10T04:54:10.216554+0000","last_fullsized":"2024-09-10T04:54:10.216554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:54:10.216468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:54:10.216468+0000","last_clean_scrub_stamp":"2024-09-10T04:54:10.216468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:34.427258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:36.678653+0000","last_change":"2024-09-10T04:54:36.678653+0000","last_active":"2024-09-10T04:54:36.678653+0000","last_peered":"2024-09-10T04:54:36.678653+0000","last_clean":"2024-09-10T04:54:36.678653+0000","last_became_active":"2024-09-10T04:50:18.855440+0000","last_became_peered":"2024-09-10T04:50:18.855440+0000","last_unstale":"2024-09-10T04:54:36.678653+0000","last_undegraded":"2024-09-10T04:54:36.678653+0000","last_fullsized":"2024-09-10T04:54:36.678653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:54:36.678526+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:54:36.678526+0000","last_clean_scrub_stamp":"2024-09-10T04:54:36.678526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.539412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.999195+0000","last_change":"2024-09-10T04:53:54.999128+0000","last_active":"2024-09-10T04:53:54.999195+0000","last_peered":"2024-09-10T04:53:54.999195+0000","last_clean":"2024-09-10T04:53:54.999195+0000","last_became_active":"2024-09-10T04:50:10.829462+0000","last_became_peered":"2024-09-10T04:50:10.829462+0000","last_unstale":"2024-09-10T04:53:54.999195+0000","last_undegraded":"2024-09-10T04:53:54.999195+0000","last_fullsized":"2024-09-10T04:53:54.999195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:54.999005+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.999005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.463400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:33.409803+0000","last_change":"2024-09-10T04:53:33.409733+0000","last_active":"2024-09-10T04:53:33.409803+0000","last_peered":"2024-09-10T04:53:33.409803+0000","last_clean":"2024-09-10T04:53:33.409803+0000","last_became_active":"2024-09-10T04:50:08.856335+0000","last_became_peered":"2024-09-10T04:50:08.856335+0000","last_unstale":"2024-09-10T04:53:33.409803+0000","last_undegraded":"2024-09-10T04:53:33.409803+0000","last_fullsized":"2024-09-10T04:53:33.409803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:33.409644+0000","last_clean_scrub_stamp":"2024-09-10T04:53:33.409644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:22.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:54.013473+0000","last_change":"2024-09-10T04:53:54.013389+0000","last_active":"2024-09-10T04:53:54.013473+0000","last_peered":"2024-09-10T04:53:54.013473+0000","last_clean":"2024-09-10T04:53:54.013473+0000","last_became_active":"2024-09-10T04:50:10.834228+0000","last_became_peered":"2024-09-10T04:50:10.834228+0000","last_unstale":"2024-09-10T04:53:54.013473+0000","last_undegraded":"2024-09-10T04:53:54.013473+0000","last_fullsized":"2024-09-10T04:53:54.013473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-10T04:53:54.013284+0000","last_clean_scrub_stamp":"2024-09-10T04:53:54.013284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:19.182546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:29.459667+0000","last_change":"2024-09-10T04:53:29.459612+0000","last_active":"2024-09-10T04:53:29.459667+0000","last_peered":"2024-09-10T04:53:29.459667+0000","last_clean":"2024-09-10T04:53:29.459667+0000","last_became_active":"2024-09-10T04:50:08.855636+0000","last_became_peered":"2024-09-10T04:50:08.855636+0000","last_unstale":"2024-09-10T04:53:29.459667+0000","last_undegraded":"2024-09-10T04:53:29.459667+0000","last_fullsized":"2024-09-10T04:53:29.459667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:29.459526+0000","last_clean_scrub_stamp":"2024-09-10T04:53:29.459526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.879419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.658634+0000","last_change":"2024-09-10T04:54:03.658574+0000","last_active":"2024-09-10T04:54:03.658634+0000","last_peered":"2024-09-10T04:54:03.658634+0000","last_clean":"2024-09-10T04:54:03.658634+0000","last_became_active":"2024-09-10T04:50:10.827035+0000","last_became_peered":"2024-09-10T04:50:10.827035+0000","last_unstale":"2024-09-10T04:54:03.658634+0000","last_undegraded":"2024-09-10T04:54:03.658634+0000","last_fullsized":"2024-09-10T04:54:03.658634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.658476+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.658476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:36.820167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.374437+0000","last_change":"2024-09-10T04:53:40.374381+0000","last_active":"2024-09-10T04:53:40.374437+0000","last_peered":"2024-09-10T04:53:40.374437+0000","last_clean":"2024-09-10T04:53:40.374437+0000","last_became_active":"2024-09-10T04:50:08.836675+0000","last_became_peered":"2024-09-10T04:50:08.836675+0000","last_unstale":"2024-09-10T04:53:40.374437+0000","last_undegraded":"2024-09-10T04:53:40.374437+0000","last_fullsized":"2024-09-10T04:53:40.374437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:40.374287+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.374287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:13:03.190933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:53.019143+0000","last_change":"2024-09-10T04:53:53.019068+0000","last_active":"2024-09-10T04:53:53.019143+0000","last_peered":"2024-09-10T04:53:53.019143+0000","last_clean":"2024-09-10T04:53:53.019143+0000","last_became_active":"2024-09-10T04:50:10.836053+0000","last_became_peered":"2024-09-10T04:50:10.836053+0000","last_unstale":"2024-09-10T04:53:53.019143+0000","last_undegraded":"2024-09-10T04:53:53.019143+0000","last_fullsized":"2024-09-10T04:53:53.019143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:53.018985+0000","last_clean_scrub_stamp":"2024-09-10T04:53:53.018985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:15:48.496863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:31.460613+0000","last_change":"2024-09-10T04:53:31.460543+0000","last_active":"2024-09-10T04:53:31.460613+0000","last_peered":"2024-09-10T04:53:31.460613+0000","last_clean":"2024-09-10T04:53:31.460613+0000","last_became_active":"2024-09-10T04:50:08.840110+0000","last_became_peered":"2024-09-10T04:50:08.840110+0000","last_unstale":"2024-09-10T04:53:31.460613+0000","last_undegraded":"2024-09-10T04:53:31.460613+0000","last_fullsized":"2024-09-10T04:53:31.460613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:31.460459+0000","last_clean_scrub_stamp":"2024-09-10T04:53:31.460459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:25.855491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:02.356607+0000","last_change":"2024-09-10T04:54:02.356550+0000","last_active":"2024-09-10T04:54:02.356607+0000","last_peered":"2024-09-10T04:54:02.356607+0000","last_clean":"2024-09-10T04:54:02.356607+0000","last_became_active":"2024-09-10T04:50:10.818899+0000","last_became_peered":"2024-09-10T04:50:10.818899+0000","last_unstale":"2024-09-10T04:54:02.356607+0000","last_undegraded":"2024-09-10T04:54:02.356607+0000","last_fullsized":"2024-09-10T04:54:02.356607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:54:02.356435+0000","last_clean_scrub_stamp":"2024-09-10T04:54:02.356435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:14.828280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.374890+0000","last_change":"2024-09-10T04:53:38.374822+0000","last_active":"2024-09-10T04:53:38.374890+0000","last_peered":"2024-09-10T04:53:38.374890+0000","last_clean":"2024-09-10T04:53:38.374890+0000","last_became_active":"2024-09-10T04:50:08.837090+0000","last_became_peered":"2024-09-10T04:50:08.837090+0000","last_unstale":"2024-09-10T04:53:38.374890+0000","last_undegraded":"2024-09-10T04:53:38.374890+0000","last_fullsized":"2024-09-10T04:53:38.374890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T04:53:38.374741+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.374741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:27.594977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:51.972008+0000","last_change":"2024-09-10T04:53:51.971940+0000","last_active":"2024-09-10T04:53:51.972008+0000","last_peered":"2024-09-10T04:53:51.972008+0000","last_clean":"2024-09-10T04:53:51.972008+0000","last_became_active":"2024-09-10T04:50:10.831171+0000","last_became_peered":"2024-09-10T04:50:10.831171+0000","last_unstale":"2024-09-10T04:53:51.972008+0000","last_undegraded":"2024-09-10T04:53:51.972008+0000","last_fullsized":"2024-09-10T04:53:51.972008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:51.971848+0000","last_clean_scrub_stamp":"2024-09-10T04:53:51.971848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:03.492899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:38.929390+0000","last_change":"2024-09-10T04:53:38.929329+0000","last_active":"2024-09-10T04:53:38.929390+0000","last_peered":"2024-09-10T04:53:38.929390+0000","last_clean":"2024-09-10T04:53:38.929390+0000","last_became_active":"2024-09-10T04:50:08.846055+0000","last_became_peered":"2024-09-10T04:50:08.846055+0000","last_unstale":"2024-09-10T04:53:38.929390+0000","last_undegraded":"2024-09-10T04:53:38.929390+0000","last_fullsized":"2024-09-10T04:53:38.929390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:38.929243+0000","last_clean_scrub_stamp":"2024-09-10T04:53:38.929243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.588007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'18","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:01.313355+0000","last_change":"2024-09-10T04:54:01.313283+0000","last_active":"2024-09-10T04:54:01.313355+0000","last_peered":"2024-09-10T04:54:01.313355+0000","last_clean":"2024-09-10T04:54:01.313355+0000","last_became_active":"2024-09-10T04:50:10.826728+0000","last_became_peered":"2024-09-10T04:50:10.826728+0000","last_unstale":"2024-09-10T04:54:01.313355+0000","last_undegraded":"2024-09-10T04:54:01.313355+0000","last_fullsized":"2024-09-10T04:54:01.313355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:54:01.313200+0000","last_clean_scrub_stamp":"2024-09-10T04:54:01.313200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:26.308298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:34.391670+0000","last_change":"2024-09-10T04:53:34.391611+0000","last_active":"2024-09-10T04:53:34.391670+0000","last_peered":"2024-09-10T04:53:34.391670+0000","last_clean":"2024-09-10T04:53:34.391670+0000","last_became_active":"2024-09-10T04:50:08.843322+0000","last_became_peered":"2024-09-10T04:50:08.843322+0000","last_unstale":"2024-09-10T04:53:34.391670+0000","last_undegraded":"2024-09-10T04:53:34.391670+0000","last_fullsized":"2024-09-10T04:53:34.391670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:34.391516+0000","last_clean_scrub_stamp":"2024-09-10T04:53:34.391516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:34.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.648047+0000","last_change":"2024-09-10T04:53:56.647991+0000","last_active":"2024-09-10T04:53:56.648047+0000","last_peered":"2024-09-10T04:53:56.648047+0000","last_clean":"2024-09-10T04:53:56.648047+0000","last_became_active":"2024-09-10T04:50:10.826632+0000","last_became_peered":"2024-09-10T04:50:10.826632+0000","last_unstale":"2024-09-10T04:53:56.648047+0000","last_undegraded":"2024-09-10T04:53:56.648047+0000","last_fullsized":"2024-09-10T04:53:56.648047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:56.647894+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.647894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.716571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.362038+0000","last_change":"2024-09-10T04:53:39.361951+0000","last_active":"2024-09-10T04:53:39.362038+0000","last_peered":"2024-09-10T04:53:39.362038+0000","last_clean":"2024-09-10T04:53:39.362038+0000","last_became_active":"2024-09-10T04:50:08.845809+0000","last_became_peered":"2024-09-10T04:50:08.845809+0000","last_unstale":"2024-09-10T04:53:39.362038+0000","last_undegraded":"2024-09-10T04:53:39.362038+0000","last_fullsized":"2024-09-10T04:53:39.362038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:39.361846+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.361846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:31.211856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:55.967302+0000","last_change":"2024-09-10T04:53:55.967302+0000","last_active":"2024-09-10T04:53:55.967302+0000","last_peered":"2024-09-10T04:53:55.967302+0000","last_clean":"2024-09-10T04:53:55.967302+0000","last_became_active":"2024-09-10T04:50:10.834190+0000","last_became_peered":"2024-09-10T04:50:10.834190+0000","last_unstale":"2024-09-10T04:53:55.967302+0000","last_undegraded":"2024-09-10T04:53:55.967302+0000","last_fullsized":"2024-09-10T04:53:55.967302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-10T04:53:55.967182+0000","last_clean_scrub_stamp":"2024-09-10T04:53:55.967182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:05.382797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:41.328471+0000","last_change":"2024-09-10T04:53:41.328369+0000","last_active":"2024-09-10T04:53:41.328471+0000","last_peered":"2024-09-10T04:53:41.328471+0000","last_clean":"2024-09-10T04:53:41.328471+0000","last_became_active":"2024-09-10T04:50:08.836420+0000","last_became_peered":"2024-09-10T04:50:08.836420+0000","last_unstale":"2024-09-10T04:53:41.328471+0000","last_undegraded":"2024-09-10T04:53:41.328471+0000","last_fullsized":"2024-09-10T04:53:41.328471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:41.328263+0000","last_clean_scrub_stamp":"2024-09-10T04:53:41.328263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:49.638518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:05.293127+0000","last_change":"2024-09-10T04:54:05.293127+0000","last_active":"2024-09-10T04:54:05.293127+0000","last_peered":"2024-09-10T04:54:05.293127+0000","last_clean":"2024-09-10T04:54:05.293127+0000","last_became_active":"2024-09-10T04:50:10.828393+0000","last_became_peered":"2024-09-10T04:50:10.828393+0000","last_unstale":"2024-09-10T04:54:05.293127+0000","last_undegraded":"2024-09-10T04:54:05.293127+0000","last_fullsized":"2024-09-10T04:54:05.293127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:54:05.293042+0000","last_clean_scrub_stamp":"2024-09-10T04:54:05.293042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:59.483409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.299919+0000","last_change":"2024-09-10T04:53:44.299822+0000","last_active":"2024-09-10T04:53:44.299919+0000","last_peered":"2024-09-10T04:53:44.299919+0000","last_clean":"2024-09-10T04:53:44.299919+0000","last_became_active":"2024-09-10T04:50:08.839577+0000","last_became_peered":"2024-09-10T04:50:08.839577+0000","last_unstale":"2024-09-10T04:53:44.299919+0000","last_undegraded":"2024-09-10T04:53:44.299919+0000","last_fullsized":"2024-09-10T04:53:44.299919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.299714+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.299714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:38.816159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:48.276456+0000","last_change":"2024-09-10T04:53:48.276352+0000","last_active":"2024-09-10T04:53:48.276456+0000","last_peered":"2024-09-10T04:53:48.276456+0000","last_clean":"2024-09-10T04:53:48.276456+0000","last_became_active":"2024-09-10T04:50:10.831712+0000","last_became_peered":"2024-09-10T04:50:10.831712+0000","last_unstale":"2024-09-10T04:53:48.276456+0000","last_undegraded":"2024-09-10T04:53:48.276456+0000","last_fullsized":"2024-09-10T04:53:48.276456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:48.276257+0000","last_clean_scrub_stamp":"2024-09-10T04:53:48.276257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:28:28.621401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:52.672010+0000","last_change":"2024-09-10T04:53:52.671909+0000","last_active":"2024-09-10T04:53:52.672010+0000","last_peered":"2024-09-10T04:53:52.672010+0000","last_clean":"2024-09-10T04:53:52.672010+0000","last_became_active":"2024-09-10T04:50:08.836438+0000","last_became_peered":"2024-09-10T04:50:08.836438+0000","last_unstale":"2024-09-10T04:53:52.672010+0000","last_undegraded":"2024-09-10T04:53:52.672010+0000","last_fullsized":"2024-09-10T04:53:52.672010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:52.671762+0000","last_clean_scrub_stamp":"2024-09-10T04:53:52.671762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:37.070175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:56.954688+0000","last_change":"2024-09-10T04:53:56.954629+0000","last_active":"2024-09-10T04:53:56.954688+0000","last_peered":"2024-09-10T04:53:56.954688+0000","last_clean":"2024-09-10T04:53:56.954688+0000","last_became_active":"2024-09-10T04:50:10.828954+0000","last_became_peered":"2024-09-10T04:50:10.828954+0000","last_unstale":"2024-09-10T04:53:56.954688+0000","last_undegraded":"2024-09-10T04:53:56.954688+0000","last_fullsized":"2024-09-10T04:53:56.954688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:56.954538+0000","last_clean_scrub_stamp":"2024-09-10T04:53:56.954538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:00.066290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:39.927286+0000","last_change":"2024-09-10T04:53:39.927198+0000","last_active":"2024-09-10T04:53:39.927286+0000","last_peered":"2024-09-10T04:53:39.927286+0000","last_clean":"2024-09-10T04:53:39.927286+0000","last_became_active":"2024-09-10T04:50:08.847569+0000","last_became_peered":"2024-09-10T04:50:08.847569+0000","last_unstale":"2024-09-10T04:53:39.927286+0000","last_undegraded":"2024-09-10T04:53:39.927286+0000","last_fullsized":"2024-09-10T04:53:39.927286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:39.927110+0000","last_clean_scrub_stamp":"2024-09-10T04:53:39.927110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:58.183080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:58.702565+0000","last_change":"2024-09-10T04:53:58.702457+0000","last_active":"2024-09-10T04:53:58.702565+0000","last_peered":"2024-09-10T04:53:58.702565+0000","last_clean":"2024-09-10T04:53:58.702565+0000","last_became_active":"2024-09-10T04:50:10.826400+0000","last_became_peered":"2024-09-10T04:50:10.826400+0000","last_unstale":"2024-09-10T04:53:58.702565+0000","last_undegraded":"2024-09-10T04:53:58.702565+0000","last_fullsized":"2024-09-10T04:53:58.702565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:58.702328+0000","last_clean_scrub_stamp":"2024-09-10T04:53:58.702328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:28.627810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:43.285461+0000","last_change":"2024-09-10T04:53:43.285400+0000","last_active":"2024-09-10T04:53:43.285461+0000","last_peered":"2024-09-10T04:53:43.285461+0000","last_clean":"2024-09-10T04:53:43.285461+0000","last_became_active":"2024-09-10T04:50:08.839146+0000","last_became_peered":"2024-09-10T04:50:08.839146+0000","last_unstale":"2024-09-10T04:53:43.285461+0000","last_undegraded":"2024-09-10T04:53:43.285461+0000","last_fullsized":"2024-09-10T04:53:43.285461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:43.285314+0000","last_clean_scrub_stamp":"2024-09-10T04:53:43.285314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:24.124746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'18","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.937107+0000","last_change":"2024-09-10T04:53:57.937043+0000","last_active":"2024-09-10T04:53:57.937107+0000","last_peered":"2024-09-10T04:53:57.937107+0000","last_clean":"2024-09-10T04:53:57.937107+0000","last_became_active":"2024-09-10T04:50:10.829079+0000","last_became_peered":"2024-09-10T04:50:10.829079+0000","last_unstale":"2024-09-10T04:53:57.937107+0000","last_undegraded":"2024-09-10T04:53:57.937107+0000","last_fullsized":"2024-09-10T04:53:57.937107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-10T04:53:57.936960+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.936960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:54.724913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:45.323723+0000","last_change":"2024-09-10T04:53:45.323633+0000","last_active":"2024-09-10T04:53:45.323723+0000","last_peered":"2024-09-10T04:53:45.323723+0000","last_clean":"2024-09-10T04:53:45.323723+0000","last_became_active":"2024-09-10T04:50:08.840630+0000","last_became_peered":"2024-09-10T04:50:08.840630+0000","last_unstale":"2024-09-10T04:53:45.323723+0000","last_undegraded":"2024-09-10T04:53:45.323723+0000","last_fullsized":"2024-09-10T04:53:45.323723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:45.323515+0000","last_clean_scrub_stamp":"2024-09-10T04:53:45.323515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:03:20.165760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:03.313042+0000","last_change":"2024-09-10T04:54:03.312983+0000","last_active":"2024-09-10T04:54:03.313042+0000","last_peered":"2024-09-10T04:54:03.313042+0000","last_clean":"2024-09-10T04:54:03.313042+0000","last_became_active":"2024-09-10T04:50:10.826392+0000","last_became_peered":"2024-09-10T04:50:10.826392+0000","last_unstale":"2024-09-10T04:54:03.313042+0000","last_undegraded":"2024-09-10T04:54:03.313042+0000","last_fullsized":"2024-09-10T04:54:03.313042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:54:03.312896+0000","last_clean_scrub_stamp":"2024-09-10T04:54:03.312896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:29.686339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:35.402879+0000","last_change":"2024-09-10T04:53:35.402809+0000","last_active":"2024-09-10T04:53:35.402879+0000","last_peered":"2024-09-10T04:53:35.402879+0000","last_clean":"2024-09-10T04:53:35.402879+0000","last_became_active":"2024-09-10T04:50:08.842813+0000","last_became_peered":"2024-09-10T04:50:08.842813+0000","last_unstale":"2024-09-10T04:53:35.402879+0000","last_undegraded":"2024-09-10T04:53:35.402879+0000","last_fullsized":"2024-09-10T04:53:35.402879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:35.402723+0000","last_clean_scrub_stamp":"2024-09-10T04:53:35.402723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:03.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:57.682394+0000","last_change":"2024-09-10T04:53:57.682334+0000","last_active":"2024-09-10T04:53:57.682394+0000","last_peered":"2024-09-10T04:53:57.682394+0000","last_clean":"2024-09-10T04:53:57.682394+0000","last_became_active":"2024-09-10T04:50:10.826135+0000","last_became_peered":"2024-09-10T04:50:10.826135+0000","last_unstale":"2024-09-10T04:53:57.682394+0000","last_undegraded":"2024-09-10T04:53:57.682394+0000","last_fullsized":"2024-09-10T04:53:57.682394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-10T04:53:57.682253+0000","last_clean_scrub_stamp":"2024-09-10T04:53:57.682253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:40.547619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:42.311798+0000","last_change":"2024-09-10T04:53:42.311732+0000","last_active":"2024-09-10T04:53:42.311798+0000","last_peered":"2024-09-10T04:53:42.311798+0000","last_clean":"2024-09-10T04:53:42.311798+0000","last_became_active":"2024-09-10T04:50:08.840588+0000","last_became_peered":"2024-09-10T04:50:08.840588+0000","last_unstale":"2024-09-10T04:53:42.311798+0000","last_undegraded":"2024-09-10T04:53:42.311798+0000","last_fullsized":"2024-09-10T04:53:42.311798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:42.311649+0000","last_clean_scrub_stamp":"2024-09-10T04:53:42.311649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:45.625094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:44.725477+0000","last_change":"2024-09-10T04:53:44.725409+0000","last_active":"2024-09-10T04:53:44.725477+0000","last_peered":"2024-09-10T04:53:44.725477+0000","last_clean":"2024-09-10T04:53:44.725477+0000","last_became_active":"2024-09-10T04:50:08.827480+0000","last_became_peered":"2024-09-10T04:50:08.827480+0000","last_unstale":"2024-09-10T04:53:44.725477+0000","last_undegraded":"2024-09-10T04:53:44.725477+0000","last_fullsized":"2024-09-10T04:53:44.725477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T04:53:44.725321+0000","last_clean_scrub_stamp":"2024-09-10T04:53:44.725321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:32:54.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:49.267391+0000","last_change":"2024-09-10T04:53:49.267391+0000","last_active":"2024-09-10T04:53:49.267391+0000","last_peered":"2024-09-10T04:53:49.267391+0000","last_clean":"2024-09-10T04:53:49.267391+0000","last_became_active":"2024-09-10T04:50:10.831143+0000","last_became_peered":"2024-09-10T04:50:10.831143+0000","last_unstale":"2024-09-10T04:53:49.267391+0000","last_undegraded":"2024-09-10T04:53:49.267391+0000","last_fullsized":"2024-09-10T04:53:49.267391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-10T04:53:49.267304+0000","last_clean_scrub_stamp":"2024-09-10T04:53:49.267304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:59.269187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:53:40.954547+0000","last_change":"2024-09-10T04:53:40.954477+0000","last_active":"2024-09-10T04:53:40.954547+0000","last_peered":"2024-09-10T04:53:40.954547+0000","last_clean":"2024-09-10T04:53:40.954547+0000","last_became_active":"2024-09-10T04:50:08.847628+0000","last_became_peered":"2024-09-10T04:50:08.847628+0000","last_unstale":"2024-09-10T04:53:40.954547+0000","last_undegraded":"2024-09-10T04:53:40.954547+0000","last_fullsized":"2024-09-10T04:53:40.954547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-10T04:53:40.954395+0000","last_clean_scrub_stamp":"2024-09-10T04:53:40.954395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:35.066147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T04:54:00.960016+0000","last_change":"2024-09-10T04:54:00.960016+0000","last_active":"2024-09-10T04:54:00.960016+0000","last_peered":"2024-09-10T04:54:00.960016+0000","last_clean":"2024-09-10T04:54:00.960016+0000","last_became_active":"2024-09-10T04:50:10.832455+0000","last_became_peered":"2024-09-10T04:50:10.832455+0000","last_unstale":"2024-09-10T04:54:00.960016+0000","last_undegraded":"2024-09-10T04:54:00.960016+0000","last_fullsized":"2024-09-10T04:54:00.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-10T04:54:00.959935+0000","last_clean_scrub_stamp":"2024-09-10T04:54:00.959935+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:48.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1783,"ondisk_log_size":1783,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673023,"num_pgs":169,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673023,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":740670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673022,"num_pgs":163,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":742288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673022,"num_pgs":175,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":2668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T04:54:50.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T04:54:50.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.651+0000 7faee3ff5640 1 Processor -- start 2024-09-10T04:54:50.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.651+0000 7faee3ff5640 1 -- start start 2024-09-10T04:54:50.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee3ff5640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faedc12bf10 0x7faedc12c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee3ff5640 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faedc09a160 con 0x7faedc12c830 2024-09-10T04:54:50.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee3ff5640 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 -- 0x7faedc06def0 con 0x7faedc12bf10 2024-09-10T04:54:50.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee1d91640 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faedc12bf10 0x7faedc12c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee1590640 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7faedc12c830 0x7faedc094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:41444/0 (socket says 172.21.15.98:41444) 2024-09-10T04:54:50.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee1590640 1 -- 172.21.15.98:0/434934118 learned_addr learned my addr 172.21.15.98:0/434934118 (peer_addr_for_me v1:172.21.15.98:0/0) 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee1d91640 1 -- 172.21.15.98:0/434934118 >> v1:172.21.15.98:6789/0 conn(0x7faedc12c830 legacy=0x7faedc094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.652+0000 7faee1d91640 1 -- 172.21.15.98:0/434934118 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc099b10 con 0x7faedc12bf10 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.653+0000 7faee1d91640 1 --2- 172.21.15.98:0/434934118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc12c2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7faecc009720 tx=0x7faecc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cec67beb599665 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.653+0000 7faee0d8f640 1 -- 172.21.15.98:0/434934118 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faecc037070 con 0x7faedc12bf10 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.653+0000 7faee0d8f640 1 -- 172.21.15.98:0/434934118 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faecc02ad90 con 0x7faedc12bf10 2024-09-10T04:54:50.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.653+0000 7faee0d8f640 1 -- 172.21.15.98:0/434934118 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faecc032590 con 0x7faedc12bf10 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 -- 172.21.15.98:0/434934118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 msgr2=0x7faedc12c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 --2- 172.21.15.98:0/434934118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc12c2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7faecc009720 tx=0x7faecc02a110 comp rx=0 tx=0).stop 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 -- 172.21.15.98:0/434934118 shutdown_connections 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 --2- 172.21.15.98:0/434934118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc12c2f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 -- 172.21.15.98:0/434934118 >> 172.21.15.98:0/434934118 conn(0x7faedc09a930 msgr2=0x7faedc09ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:50.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 -- 172.21.15.98:0/434934118 shutdown_connections 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.654+0000 7faee3ff5640 1 -- 172.21.15.98:0/434934118 wait complete. 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee3ff5640 1 Processor -- start 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee3ff5640 1 -- start start 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee3ff5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee3ff5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faedc097b20 con 0x7faedc12bf10 2024-09-10T04:54:50.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee1d91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee1d91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38736/0 (socket says 172.21.15.98:38736) 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee1d91640 1 -- 172.21.15.98:0/1212371994 learned_addr learned my addr 172.21.15.98:0/1212371994 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee1d91640 1 -- 172.21.15.98:0/1212371994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc092950 con 0x7faedc12bf10 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.655+0000 7faee1d91640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7faecc009720 tx=0x7faecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faecc0433f0 con 0x7faedc12bf10 2024-09-10T04:54:50.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faecc043590 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc12bbc0 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faecc043870 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc093510 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.656+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faecc04a060 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.657+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faedc073180 con 0x7faedc12bf10 2024-09-10T04:54:50.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.657+0000 7faed27fc640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 0x7faec00403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T04:54:50.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.657+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6394+0+0 (secure 0 0 0) 0x7faecc074c90 con 0x7faedc12bf10 2024-09-10T04:54:50.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.657+0000 7faee1590640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 0x7faec00403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T04:54:50.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.657+0000 7faee1590640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 0x7faec00403a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faed8007fd0 tx=0x7faed8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T04:54:50.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.661+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7faedc073180 con 0x7faedc12bf10 2024-09-10T04:54:50.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.837+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7faedc093150 con 0x7faedc12bf10 2024-09-10T04:54:50.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.842+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7faedc093150 con 0x7faedc12bf10 2024-09-10T04:54:50.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.842+0000 7faed27fc640 1 -- 172.21.15.98:0/1212371994 <== mon.0 v2:172.21.15.98:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faecc0306e0 con 0x7faedc12bf10 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 msgr2=0x7faec00403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 0x7faec00403a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faed8007fd0 tx=0x7faed8007aa0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 msgr2=0x7faedc090b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7faecc009720 tx=0x7faecc0046c0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 shutdown_connections 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.145:6824/106719016,v1:172.21.15.145:6825/106719016] conn(0x7faec003dee0 0x7faec00403a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 --2- 172.21.15.98:0/1212371994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc12bf10 0x7faedc090b70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.844+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 >> 172.21.15.98:0/1212371994 conn(0x7faedc09a930 msgr2=0x7faedc072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.845+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 shutdown_connections 2024-09-10T04:54:50.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T04:54:50.845+0000 7faee3ff5640 1 -- 172.21.15.98:0/1212371994 wait complete. 2024-09-10T04:54:50.857 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T04:54:50.857 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T04:54:50.857 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T04:54:50.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:50.885 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T04:54:50.886 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T04:54:50.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:50.934 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T04:54:50.934 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T04:54:50.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:50.975 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T04:54:50.976 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T04:54:50.976 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:51.019 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T04:54:51.020 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T04:54:51.020 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T04:54:51.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:51.050 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T04:54:51.050 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T04:54:51.050 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T04:54:51.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T04:54:51.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-10T04:54:51.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-10T04:54:51.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-10T04:54:51.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-10T04:54:51.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-10T04:54:51.062 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T04:54:51.062 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T04:54:51.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-10T04:54:51.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T04:54:51.131 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T04:54:51.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:54:51.317 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T04:54:51.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:54:51.620 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T04:54:51.718 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:54:51.718 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T04:54:51.775 INFO:tasks.ceph:Archiving mon data... 2024-09-10T04:54:51.776 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/data/mon.a.tgz 2024-09-10T04:54:51.777 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-10T04:54:51.792 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.SThrZE9X9h 2024-09-10T04:54:51.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SThrZE9X9h 2024-09-10T04:54:51.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.SThrZE9X9h 2024-09-10T04:54:52.061 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.SThrZE9X9h is 266KB 2024-09-10T04:54:52.156 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.SThrZE9X9h 2024-09-10T04:54:52.171 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T04:54:52.171 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T04:54:52.213 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T04:54:52.290 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T04:54:52.309 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T04:54:52.311 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T04:54:52.313 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi098/crash 2024-09-10T04:54:52.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T04:54:52.355 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi145/crash 2024-09-10T04:54:52.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T04:54:52.395 INFO:tasks.ceph:Compressing logs... 2024-09-10T04:54:52.395 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T04:54:52.399 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32098.log 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30792.log 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.32098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30431.log 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32098.log.gz 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31467.log 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30792.log.gz 2024-09-10T04:54:52.436 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28907.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30431.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30791.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31467.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.28907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30791.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28907.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31374.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30791.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30900.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31320.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30900.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31374.log.gz 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30958.log 2024-09-10T04:54:52.437 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30900.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31722.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31320.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30960.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30958.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30790.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31722.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30960.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30790.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27043.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30487.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30790.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30648.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.tmp-client.admin.27043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31128.log 2024-09-10T04:54:52.438 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27043.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30648.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31128.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30648.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31128.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31848.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30564.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31848.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31417.log 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30564.log.gz 2024-09-10T04:54:52.439 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 85.5%/var/log/ceph/ceph-client.admin.31417.log: -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31127.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31417.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30606.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31127.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31680.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29756.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30606.log.gz 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31126.log 2024-09-10T04:54:52.440 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31680.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.29756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28751.log 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29756.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31126.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.28751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30789.log 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7%/var/log/ceph/ceph-client.admin.31638.log: -- replaced with /var/log/ceph/ceph-client.admin.28751.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30789.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30789.log.gz 2024-09-10T04:54:52.441 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31236.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30690.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31236.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31278.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31236.log.gz 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30690.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30690.log.gz 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31596.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31278.log.gz 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-09-10T04:54:52.442 INFO:teuthology.orchestra.run.smithi098.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31596.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31974.log 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32058.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31974.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.28869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30959.log 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31511.log 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.30959.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30959.log.gz 2024-09-10T04:54:52.443 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31511.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31511.log.gz 2024-09-10T04:54:52.471 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82253.log 2024-09-10T04:54:52.471 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56843.log 2024-09-10T04:54:52.474 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41113.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.82253.log: /var/log/ceph/ceph-client.0.56843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57448.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.41113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35365.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85272.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.57448.log: /var/log/ceph/ceph-client.admin.35365.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.82253.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79228.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56843.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35365.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.85272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60473.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41113.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.79228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72573.log 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.57448.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85272.log.gz 2024-09-10T04:54:52.475 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.60473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90088.log 2024-09-10T04:54:52.476 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.72573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75598.log 2024-09-10T04:54:52.476 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.90088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79228.log.gz 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr:gzip/var/log/ceph/ceph-client.0.75598.log: -5 --verbose -- /var/log/ceph/ceph-client.0.68943.log 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60473.log.gz 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48978.log 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35445.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72573.log.gz 2024-09-10T04:54:52.492 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.68943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91298.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90088.log.gz 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.48978.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75598.log.gz 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55028.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.91298.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61683.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.55028.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.48978.log.gz 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40508.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52003.log 2024-09-10T04:54:52.493 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.61683.log: /var/log/ceph/ceph-client.0.40508.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91298.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.52003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31064.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55028.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40508.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84068.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% 93.3% -- replaced with /var/log/ceph/ceph-client.0.68943.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31064.log: -- replaced with /var/log/ceph/ceph-client.0.61683.log.gz 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59263.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31064.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.52003.log.gz 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.84068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64103.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.59263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67128.log 2024-09-10T04:54:52.494 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.64103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80438.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84068.log.gz 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.67128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46558.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.80438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59868.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.46558.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.64103.log.gz 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr: -5 91.0% -- replaced with /var/log/ceph/ceph-client.0.59263.log.gz 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.0.38094.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.59868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79833.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67128.log.gz 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.38094.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80438.log.gz 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37489.log 2024-09-10T04:54:52.495 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.79833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56238.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46558.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.37489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41718.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.56238.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59868.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87668.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38094.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5/var/log/ceph/ceph-client.0.41718.log: --verbose -- /var/log/ceph/ceph-client.0.78018.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79833.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.87668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81648.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37489.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.78018.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56238.log.gz 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62288.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.81648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87069.log 2024-09-10T04:54:52.496 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41718.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.62288.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87668.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53213.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78018.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.87069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93113.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.87069.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.53213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91903.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45348.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.93113.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62288.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.91903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94323.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81648.log.gz 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.45348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42323.log 2024-09-10T04:54:52.497 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53213.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.94323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61078.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93113.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91903.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73783.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50793.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.61078.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.45348.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.73783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84673.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94323.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.50793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31104.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42323.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.84673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67733.log 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31104.log: gzip 90.5% -- replaced with /var/log/ceph/ceph-client.0.84673.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61078.log.gz 2024-09-10T04:54:52.498 INFO:teuthology.orchestra.run.smithi145.stderr: -5 91.4% -- replaced with /var/log/ceph/ceph-client.0.73783.log.gz 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.31104.log.gz 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.67733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65313.log 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50793.log.gz 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36279.log 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.65313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78623.log 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88273.log 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.36279.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.67733.log.gz 2024-09-10T04:54:52.499 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.78623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2024-09-10T04:54:52.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.88273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92508.log 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88878.log 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78623.log.gz 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.65313.log.gz 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.92508.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.36279.log.gz 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81043.log 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.88878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86470.log 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88273.log.gz 2024-09-10T04:54:52.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.81043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73178.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.86470.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92508.log.gz 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51398.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.73178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55633.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86470.log.gz 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.51398.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88878.log.gz 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76808.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83463.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.55633.log: /var/log/ceph/ceph-client.0.76808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96190.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81043.log.gz 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0%/var/log/ceph/ceph-client.0.83463.log: -- replaced with /var/log/ceph/ceph-client.0.73178.log.gz 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70153.log 2024-09-10T04:54:52.530 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51398.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.96190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45953.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55633.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.70153.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.76808.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.71968.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.45953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44138.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.71968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47163.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.44138.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83463.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74388.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45953.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.47163.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70153.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58053.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.74388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70758.log 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1%/var/log/ceph/ceph-client.0.58053.log: -- replaced with /var/log/ceph/ceph-client.0.44138.log.gz 2024-09-10T04:54:52.531 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39304.log 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96190.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69548.log 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.47163.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71968.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.70758.log: /var/log/ceph/ceph-client.0.39304.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74388.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.39304.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58053.log.gz 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71363.log 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.69548.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T04:54:52.532 INFO:teuthology.orchestra.run.smithi145.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.70758.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.71363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68338.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89483.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.68338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43533.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.89483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48373.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71363.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.43533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54423.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69548.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39903.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.48373.log: /var/log/ceph/ceph-client.0.54423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76203.log 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.39903.log: 91.3% 91.2% -- replaced with /var/log/ceph/ceph-client.0.89483.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68338.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.43533.log.gz 2024-09-10T04:54:52.533 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47768.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.76203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82858.log 91.2% -- replaced with /var/log/ceph/ceph-client.0.48373.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54423.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.47768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58658.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.39903.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.82858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74993.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76203.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.58658.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.74993.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.47768.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.77413.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mgr.x.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90693.log 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.82858.log.gz 2024-09-10T04:54:52.534 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58658.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.77413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50188.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5/var/log/ceph/ceph-client.0.90693.log: --verbose -- /var/log/ceph/ceph-client.0.63498.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7%/var/log/ceph/ceph-client.0.50188.log: -- replaced with /var/log/ceph/ceph-client.0.74993.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35405.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.63498.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77413.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35405.log: -- /var/log/ceph/ceph-client.0.85871.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50188.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr: 86.0% 91.2% -- replaced with /var/log/ceph/ceph-client.0.90693.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35405.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31184.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63498.log.gz 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.85871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49583.log 2024-09-10T04:54:52.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31184.log: gzip -5 --verbose 90.4% -- replaced with /var/log/ceph/ceph-client.0.85871.log.gz 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: -- 84.7% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: /var/log/ceph/ceph-client.0.38699.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.49583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36884.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.38699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95533.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.36884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52608.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49583.log.gz/var/log/ceph/ceph-client.0.95533.log: 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94928.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38699.log.gz/var/log/ceph/ceph-client.0.52608.log: 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64708.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.36884.log.gz 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.94928.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.64708.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95533.log.gz 2024-09-10T04:54:52.536 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52608.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62893.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93718.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94928.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.62893.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64708.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62893.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44743.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.93718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.44743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53818.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35485.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93718.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65918.log 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44743.log.gz 2024-09-10T04:54:52.537 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66523.log 2024-09-10T04:54:52.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.53818.log: /var/log/ceph/ceph-client.0.65918.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53818.log.gz 2024-09-10T04:54:52.538 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65918.log.gz 2024-09-10T04:54:52.538 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42928.log 2024-09-10T04:54:52.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.66523.log: /var/log/ceph/ceph-client.0.42928.log: 91.7% 91.1% -- replaced with /var/log/ceph/ceph-client.0.42928.log.gz 2024-09-10T04:54:52.538 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.66523.log.gz 2024-09-10T04:54:52.552 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T04:54:52.568 INFO:teuthology.orchestra.run.smithi145.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T04:54:52.593 INFO:teuthology.orchestra.run.smithi098.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T04:54:53.340 INFO:teuthology.orchestra.run.smithi145.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T04:54:53.463 INFO:teuthology.orchestra.run.smithi098.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T04:54:53.465 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-10T04:54:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m1.054s 2024-09-10T04:54:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m1.190s 2024-09-10T04:54:53.465 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.075s 2024-09-10T04:54:53.469 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T04:54:53.502 INFO:teuthology.orchestra.run.smithi145.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T04:54:53.504 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-10T04:54:53.504 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m1.043s 2024-09-10T04:54:53.504 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m2.966s 2024-09-10T04:54:53.504 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.206s 2024-09-10T04:54:53.504 INFO:tasks.ceph:Archiving logs... 2024-09-10T04:54:53.504 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi098/log 2024-09-10T04:54:53.505 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T04:54:53.748 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi145/log 2024-09-10T04:54:53.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T04:54:54.255 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T04:54:54.265 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T04:54:54.265 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T04:54:54.267 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T04:54:54.344 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T04:54:54.358 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T04:54:54.359 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T04:54:54.362 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T04:54:54.375 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-10T04:54:54.377 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +42us[ +67us] +/- 52ms 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -313us[ -288us] +/- 59ms 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +491us[ +516us] +/- 88ms 2024-09-10T04:54:54.379 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:54:54.381 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T04:54:54.381 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-10T04:54:54.381 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +45us[ +83us] +/- 52ms 2024-09-10T04:54:54.381 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -316us[ -278us] +/- 59ms 2024-09-10T04:54:54.381 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +476us[ +513us] +/- 88ms 2024-09-10T04:54:54.382 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T04:54:54.382 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T04:54:54.392 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T04:54:54.392 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T04:54:54.420 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T04:54:54.482 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T04:54:54.543 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T04:54:54.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:54:54.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T04:54:54.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:54:54.598 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T04:54:54.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T04:54:54.628 INFO:teuthology.task.internal:Duration was 688.288092 seconds 2024-09-10T04:54:54.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T04:54:54.662 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T04:54:54.662 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T04:54:54.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T04:54:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T04:54:54.703 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T04:54:55.028 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T04:54:55.028 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T04:54:55.028 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T04:54:55.072 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-10T04:54:55.072 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T04:54:55.099 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T04:54:55.100 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T04:54:55.115 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T04:54:55.167 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T04:54:55.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T04:54:55.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T04:54:55.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T04:54:55.314 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T04:54:55.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T04:54:55.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T04:54:55.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T04:54:55.455 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T04:54:55.457 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T04:54:55.478 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-10T04:54:55.480 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-10T04:54:55.506 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T04:54:55.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:54:55.552 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T04:54:55.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T04:54:55.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T04:54:55.576 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T04:54:55.578 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi098 2024-09-10T04:54:55.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T04:54:55.626 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898669/remote/smithi145 2024-09-10T04:54:55.626 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T04:54:55.662 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T04:54:55.662 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T04:54:55.664 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T04:54:55.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T04:54:55.724 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T04:54:55.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T04:54:55.746 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T04:54:55.747 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T04:54:55.749 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T04:54:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 04:54 /home/ubuntu/cephtest 2024-09-10T04:54:55.768 INFO:teuthology.orchestra.run.smithi145.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 04:54 /home/ubuntu/cephtest 2024-09-10T04:54:55.769 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T04:54:55.779 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T04:54:55.849 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 688.288092136383 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T04:54:55.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T04:54:55.921 INFO:teuthology.run:pass